The second stanza of "To Autumn" describes the people in the autumn suffering the hard work of the autumn.