Can you give permission for only 1 DHCP server in a network?

I have installed lot of DHCP servers in various locations on DCs. I want to give permission for handling DHCP server in that site to a local administrator in a remote office. It should not allow access to all servers. If I create an administrator to the current local DHCP administrator group on ADUC, it will give access to all DHCP servers. I just want to give permission to only one DHCP server. Can anybody help?
