Read the program and see what it is telling the machine to do.
Did you check backlash in a dynamic state?
I usually overcomp the backlash and cut a circle with a light spring cut. I can then sweep the circle with a dial indicator and measure the steps where the axis reverses direction. This is the amount an axis is overcomped and needs to be subtracted from the exaggerated value just used.
It is a lot easier to measure a step than a flat (if zero comp was used).
Use cutter comp and adjust the tool diameter so it comes out correct.
Was it a G79 that is such a beautifully simple was to circular interpolate a hole? You could try that.
You have many options.
George
(Note: The opinions expressed in this post are my own and are not necessarily those of CNCzone and its management)