4 and 6 IPM is really too slow a feed. The cutter will probably rub and that'll produce a decent finish, but a shorter tool life. I wouldn't try to go much slower than 8 IPM. To understand this "rubbing" phenomenon, the diagrams here may be helpful:
CNC Milling Chiploads, Surface Speed, and Other Concepts
Incidentally, also on that page is a brief discussion of radial chip thinning, which causes very light cuts (0.010" width of cut) to make it worse if you don't speed up the feedrate.
A more ideal feedrate for aluminum with that cutter, depth of cut, and width of cut is actually 38 IPM. Not clear if that router is up to that, but that's what the cutter numbers call for.
The grabbing at higher feedrates could be from several sources. If you're climb milling, that wants to pull the cutter along. A good CNC can resist that can use climb milling to advantage, but you could try conventional milling and see if you get better results. That's all described in the feeds and speeds tutorial the first link is a part of.
Last thing, the grabbing may also be the onset of what's called "Built Up Edge". Aluminum likes to weld itself to the cutter if you give it half a chance. If you plan to cut much aluminum, check out this article from my blog:
10 Tips for CNC Router Aluminum Cutting Success « CNCCookbook CNC Blog CNCCookbook CNC Blog
Cheers,
BW
Try G-Wizard Machinist's Calculator for free:
http://www.cnccookbook.com/CCGWizard.html