This area was once a sandstone quarry, established around 1850 to supply stone for the construction of Fort Denison as well as ballast for ships returning to England. Hence original name of Ballast Point, and the multi-layered reserve that’s well sited for a quiet picnic and play.
The area was described as “a delightful watering suburb” in 1915. And it’s about to regain its status as a suburb – not just a mere locality in Neutral Bay.
This information and a lot more is part of a walking tour guide called Gem of the Harbour (PDF) from North Sydney Council.