it would beep twice if it was memory
No it doesn't, for example, the computer could hang in testing memory or it might not have a PC speaker.
What you need to do is take the processor, ram, video card, etc out. Everything but the motherboard and powersupply. Boot it up and see if it works. Then introduce each part one at a time until it fails.