It was also the head quarters of the Gingee Nayaks, during the Nayak domination in Tamil Nadu. The fort was built as a strategic place for fending off any invading army. The fort was further strengthened by the Marathas under the leadership of Shivaji in 1677 AD. He recaptured it from the Bijapur sultans who had originally overthrown the Marathas.

During Aurangzeb's campaign in the Deccan, Shivaji's second son who had assumed the throne, Chhatrapati Rajaram escaped to Gingee in the distant South and continued the fight with Moghuls from Gingee. The Moghuls could not capture the fort for seven years in spite of laying siege.

The fort was finally captured in 1698, but not before Chhatrapati Rajaram escaped. It was later passed on to the Carnatic Nawabs who lost it to the French in 1750 before the British finally took control in 1761 despite losing it to Hyder Ali for a brief period.