This is a known bug with the terrain bricks. The problem stems from the fact that the raycasting box is a cube or box shape and the collision box is something else (like the ramps here). Thusly, they have a nasty tendency to disrupt your aim. There is no known fix at the moment.
Basically, the bullets think that the ramp brick is a box (cube) of equivalent dimensions.