He caddied at the all-White Tennison Park Golf Club