There's definitely limits on what you can do with collision. A house with more than a room you can go in is a nono. Also it's going to be difficult mapping out the grids so that you could still build inside whatever house brick you ended up with.
Additionally it's also questionable whether the bricks will retain the texture (by the looks of it, no).