What is backward compatibility? Is it important?

I have heard this term more than 100 times while going through the PS3's features. It is stated that PS3 is not backward compatible with the PS2.
1. What is the meaning of backward compatibility?
2. Are the Android apps also influenced by backward compatibility?
3. Explain the importance of backward compatibility.
Please describe everything about the term above.
