You'll want to browse the exhibits at National Museum of Prehistory and Taitung Art Museum. While you're exploring, swing by Taitung Railway Art Village, Taitung Tianhou Temple, and Haishan Temple to learn a bit about the area. You can wander around Taitung Seashore Park, Taidong Forest Park, or Siaoyeliou if you want a dose of fresh air.