First how far is the line tie from the nose of the bait, also it just might be the lip not grabbing enough of the water, what I mean is that your angle is a little off. The closer to the nose ill give you a tighter wobble the closer to the tip of the lip will give you a lure all over the place, but before you start changing get a set of pliers and adjust it first just to make sure that is not the problem. Send a picture plus type of lip you have on the bait.
Wayne