How to protect computers from anonymous desktop control

In free remote control applications such as Team Viewer, are they allowing anonymous desktop control? How could I protect my computer from this intrusion since I am a consistent user of these applications?
