I wouldn't recommend using a drill press and cross feed table for milling specially if the chuck in the drill press is fitted to the spindle via a taper, Jacobs into the chuck, and Morse into the spindle, the sideways action of milling will cause the tapers to fall out, I know 'cause that's how I started.
Ian S C