If the holder is pulling out of the collet, then you're not tightening the drawbar enough. The outside taper of the collet should be very lightly coated with anti-sieze. The collet bore, and the TTS shank should be completely clean and dry. Drawbar should be tightened to 15-25 ft-lbs.
Regards,
Ray L.