Terrible idea.
One reason why: Spam a cube of lattices and see how your performance drops. Spam the same sized cube out of 1x1 bricks and see how your performance drops.
Bricks that have complex shapes like this are probably not a very good idea unless they're basic shapes, e.g. wedges, ramps, octagonal bricks.