Servo or stepper???

Slow down the feed (servo) to reduce "hunting" from overshoot.

Try slowing down your feed or use microstepping (steppers) - sounds like you're running into an oscillation problem that microstepping might solve.

Look for RF noise in cableing - this causes all kinds of buggaboos.