Sorry to hear that. Brass is especially fun because it "Hogs In."
When drilling brass you need to grind a very little on the drill point. Line the drill's axis parallel to the side surface of the wheel. Then just touch the cutting edge on the inside of the flute edge and make about a .010 to .020" flat along the flute cutting edge. This will make a small ground surface parallel of the length of the drill. Do it for both flutes. Try to make them as even as you can.
Sometimes straight fluted drills are used in brass for this reason.
Not much will help if the drill press has slop from the handle to the spindle quill.
Please be safe,
Stanley Dornfeld
www.quad-i.com