I don't think you'd have much choice except to grind the face. You'd need to set up a vertical grinding spindle on the table of your machine, with a cup style wheel, orient and lock the spindle so the lugs are aligned with the table travel, and write a little program to surface grind the spindle face on each side of the lugs.
First you get good, then you get fast. Then grouchiness sets in.
(Note: The opinions expressed in this post are my own and are not necessarily those of CNCzone and its management)