Fedoras add nothing and detract nothing from your overall appearance
a greasy neckbeard still looks like a greasy neckbeard, with or without a fedora
a hipster looking

still looks like a a hipster looking

, even without the hat
just
wear it if it looks good on you, don't if it doesn't