pretty sure the eraser is setting it to white if you're using paint
paint doesn't actually handle transparency, only transparency in regards to your background color that you have selected (which is useful for pasting images on top of eachother)
you're going to need a program that can actually save in the correct format, you could try paint.net, gimp, or photoshop or other things