Is it updating them?
When an update is released for TF2, it usually has source engine changes/fixes, so it will probably download their respective updates.
To stop it, either A: pause the downloads using the button at the top of the download page, or B: let them finish downloading (should take at the most 5 minutes) and it won't happen again for a while.