Here is a detailed examination concerning Can Cinnamon Hurt a Cat.
The simple answer is yes — but while bananas aren't toxic to cats, they can cause digestive issues. Many "people foods," like chocolate, are toxic for cats and other pets, and they should be avoided altogether.