Most people are and should be running 64 bit machines. If everything was 'optimized' (which it's not even really a case of optimization but whatever) for the lowest end, then you're severely limiting what you can push. If you don't choose to invest into something better, then stay behind, don't promote the idea of dragging everyone else down to your level.
I didn't really mean that the program should be 32 bit only, i think that usually you should build for both 64 and 32 bit versions unless your game absolutely needs more than 4gb of ram processing at any time.
anyways i completely forgot to consider the size of these games nowadays. i mostly play smaller games that all run 32 bit so i didn't really take into consideration that a lot of big games like Doom and stuff use a ton of physical memory, mb. I'm sure if developers targeted both 32 and 64 bit they could probably make big triple A games run efficiently on both, but it makes sense that they wouldn't since like only 2% of gamers use 32 bit processors.