Downtime when transferring a domain from previous hosting provider

I've been experiencing Downtime when transferring a domain from my previous hosting provider to a current server. How can I go about this without having and Downtime and what's causing it?
