It seems to be a graphical glitch, I've tested this with another channel that I was subscribed to and did this glitch with another account. When the account hit zero my main channel was still subscribed even though it said it had zero subs.
EDIT: Youtube seems to have fixed the glitch since the channel that I've tested this on has regain it's subs.