Fever doesn't necessarily mean a contagious sickness, does it? I don't think it does.
Either way, it can cause discomfort and make it difficult to concentrate. If your attendance is literally perfect, it's up to you I guess. Are you gunning for perfect attendance awards?