Low quality drill press is my guess - the bearing are sloppy and don't hold the chuck centered. As a test, with no bit/no work on the table/power off, plunge the chuck to its maximum depth, and see if you can wiggle it side to side.
The other possibility is insufficiently rigid bits.
You do have your block clamped tightly, right?
|