Keep walls that are tan or grey in a limited number of shades.
2-3 shades used evenly and nicely can look good, but if you end up cramming every single shade you have into a wall, it looks cluttered and un-realistic, as far as Lego brick realism goes. :)