Guests came from all over to enjoy high tea at Abercrombie House