You shouldn't be copying something 10k-20k bricks.
I suppose you also want to have 500,000 bricks onscreen at once?This isn't plausible. There is absolutely no way to do this. It's a huge amount of processing to do just for a couple of thousand bricks, let alone ten or twenty thousand.