This is default behavior for a dedicated server. If you're happy to edit manually you can go into config/client/ADD_ON_LIST.cs (might be config/server) and change anything you want to disable to -1 instead of 0 or 1.