Configuration Manager Site System Server

My question is does my site systems have to be in the same domain in the same forest? If no, what are the exceptions for this? And also, I want to install clients from other forest but I don’t want to download the client installation source files from the site server, is that possible? Thanks.
