[iPod] Device overheats and exits out of apps

When I am using my iPod 4g, it gets extremely hot and also exits out of apps, mostly from playing the game Infinity Blade. However, I also experienced this while playing Tap Tap Revenge. I restored it but it was not successful.
What could be the cause of the heating issue?
