I was reading a report about how the taper shank tools swell at the small end from having the pullstud installed. Apparently it is a significant amount, due to the leverage of the slope of the threads, I suppose. Although this report was created by someone who was selling an 'anti-swell' type of pullstud, it might be worth checking out.
It would be fairly important not to overtighten the pullstud for this reason. It might even make sense to use blue loctite on the threads to ensure good stud retention under conditions of less torque.
First you get good, then you get fast. Then grouchiness sets in.
(Note: The opinions expressed in this post are my own and are not necessarily those of CNCzone and its management)