if your friends aren't into it, they won't play as long and it ends up being boring.
That's most of the issues with any Minecraft MP server I played with friends, I always want to continue but someone always gets bored even if there's lots of things to do and we don't even reach vanilla endgame, and it goes downhill from there.
The biggest issue is I believe that everyone's 'scared' of trying something new. I had mods recommended by friends so I added them in the server, but everyone did their own thing. The person that wanted x played that, the person that wanted y played that and so on and so forth, nobody was willing to just slam a wiki up and figure out how to play something else, and one thing's endgame content ran out much faster than the other's.