Good tips throughout this thread, and the video of squaring up the aly block was entertainingly done and worked well for the light cuts taken on some very crisply machining alloy. I think that I might have liked a bit more initial gripping surface if needing to take a fair amount off a steel block.
Seeing the photo of Roger's milling set up using the versatile lathe / mill combination, with the lathe carriage effectively being the milling table, and with a neat but quite small vice attached, I would suggest that , even with optimisation of the cutter type, sharpness, and lubrication , the lack of metal mass in the arrangement is going to always tend to vibration snags when tackling tougher material like the EN8. The beefy machine tables and chunky vices attached , even of the hobby sized milling machines, do in themselves inhibit some of this difficulty by their inertia. Dave