Neighbors concerned about future of tree estimated to be 500