Right click your background layer in the layers windows and click (I think it's) Alpha to Selection
Just click the one that has the white and gray checkered dots. Then when you erase, it's transparent.
Or do this to any layer you want the ability to make transparent. c: