The Megalithic Portal (megalithic.co.uk) gives a grid reference of SW 514 298 and says it is on the edge of the cliff, below the castle, on the south side of the island.
Reproduced from an old etching which shows the site of the Old Telegraph Office and three Public houses; The Fish Tin Copper, the One Ball plus one other name not known?