Yeah that's what I've been doing and the pain is minor compared to how it was before.
If it starts to get bad, try to get it removed. Trust me, it doesn't hurt. I just had one removed last week. If it's the same there as it is here, they'll numb your toe (or foot) completely and it'll just feel like tickling (minus the laughter). Only downside is having to soak your toe in salty-water twice a day for like 20 mins. It helps so it's not too bad, it's just time consuming.