The son of Cornelius O'Callaghan, first Baron Lismore of Shanbally (1749-1797); in 1808 he married Lady Eleanor Butler, daughter of John Butler, 17th Earl of Ormonde, whom he divorced in 1826.