On 9 April 1904 he married 35-year-old Emily Mary Dorman, with whom he shared a love of literature, particularly Robert Browning. The marriage produced three children.

Shackleton wrote long letters to his wife during his explorations, but also engaged in several extramarital affairs, including one with the American actress Rosalind Chetwynd.