Fort Frederick was built by the Portuguese in the year 1624 CE. Fort Frederick was built from the debris of a Hindu temple known as Koneswaram temple after destroying the same. Fort Frederick changed hands multiple times moving from the occupation of Portuguese to Dutch, French and then British. Two main tourist attractions of Fort Frederick are the rebuilt Koneswaram temple, and Gokanna temple. Another attraction for traveller is the Lover’s leap or Swami rock, which is a 130 m high cliff giving scenic view of surroundings.