You did not list or provide any of you feeds and speeds, but I would not rough with a ball endmill. Too much contact area and not good for heavy roughing.
I would use a good 1/2 inch or larger regular endmill and leave .010" or .020" for finish. Finish with a larger ball endmill to, the smaller the endmill the shorter your step over has to be for a good finish and your endmill is weaker. A 1/2 inch ball with a .005" step over would probably finish that nice. A 1" would be even nicer, you do have two inches of diameter there.
High Speed Steel does slow you down some too. Do you have flood coolant? Also remember that slow and steady wins the race unless you are doing mass production.
Mike
Two Haas VF-2's, Haas HA5C, Haas HRT-9, Hardinge CHNC 1, Bother HS-300 Wire EDM, BobCAD V23, BobCAD V28