Aberdeenshire health bosses have been slammed after refusing to attend a public meeting on the fate of a community hospital.