When installing choose not to create a desktop shortcut or if the option is available choose not to install for all users.
That only applies to only that one thing you're installing, i was hoping there'd be a way to do it for all downloads