There's no modding system out, but you can decompile the source code and modify it. Though I'm fairly certain it's either illegal or against the terms of use.
You can use wrappers though, there is one where you can play Terraria on a mac with a C# wrapper.