LePage’s frustration with job is evident, associates say