if you use the default colorset this will work fine. my guess is it just uses a fixed color id when it generates the brick - from my experience this seems to be the case, but i never bothered to check. Usually i just black-and-white the image in my image editor afterwards if the color is not too extremely off, or just manually color it white and realign the camera.