The land on which these gardens were laid out was granted to the Albany Botanical Gardens in 1853 by the Governor of the Cape, Sir George Cathcart. It originally formed part of the Drostdy estate. There Botanical Gardens are the second oldest in the country.
The cottage on the grounds, which dates from the 1830s, was erected in the Romantic style known as cottage orne, with peaked gothic windows and a Georgian chimney. It is unique in the Eastern Cape.