The exit is variable but here is what my Williamson book says... Most depart northern edge of range by late August. Females lag males, juveniles lag females. There are many records of Rufous on the east coast and some instances of birds spending the winter. No harm in keeping your feeder out, just make sure that is gets refreshed. Once activity declines keep just enough in the feeder so that you don't feel bad about replacing it when it needs to be cleaned. Get some pictures.....
Northern range is Canada.
Latest Birds: Sage Thrasher, Ferruginous Hawk, Common Goldeneye