Slice bananas. Mix sugar, cinnamon and nutmeg in a small bowl.
Heat olive oil in a large skillet over medium.
Place bananas in skillet and cook for 1-2 minutes.
Sprinkle with half the cinnamon mixture and flip slices over. Cook for 1-2 more minutes. Sprinkle with remaining cinnamon mixture and flip once again and cook for an additional minute.