Chances are that this is just a question of how fast you're swinging. Try swinging exactly as fast as you would when you're trying to hit a winner.