The daughter of Charles Wilkes, a New York banker, and great-niece of the radical John Wilkes; in 1813 the became the second wife of the critic Francis Jeffrey. Their daughter was also named Charlotte.