Anyone know how transparency in milkshape works?
The arrow disappearing on the bow is not the work of LOD or moving the arrow really far away, it's actually done using Visibility Channels.

You can use the Visibility Channel panel on the right hand side to define which frames of animation the group is invisible for. Remember, the bit you want to disappear must be in it's own group!