His father was the eldest son of John Manners, MP for Newark, and Louisa Tollemache, 7th Countess of Dysart. As his father, the heir apparent to the earldom of Dysart, predeceased his grandmother, the suo jureCountess of Dysart, upon his grandmother's death on 22 September 1840, Hugh and his surviving siblings were granted precedence as the children of an earl on 6 November 1840. His maternal grandparents were Francis Gray and Elizabeth (née Ruddock) Gray.
He became rector of the Parish of Harrington in Northamptonshire from 1831 until his death in 1890, when he was succeeded by a priest named Atkins.
Personal life
On 22 June 1824 Tollemache married Matilda Hume, a daughter of Joseph Hume of Notting Hill. Together, they had ten children:
Matilda Anne Frances Tollemache (1825–1899), who married Rev. George Edmond Maunsell, son of Thomas Philip Maunsell and Hon. Caroline Elizabeth Cokayne, in 1869.
Ralph William Lyonel Tollemache (1826–1895), a reverend who married his cousin, Caroline Tollemache, daughter of Hon. Felix Tollemache, in 1853. After her death, he married Dora Cleopatra Maria Lorenza de Orellana, daughter of Col. Ignacio Antonio de Orellana y Revest, in 1869.
An unnamed child (1827–1828), who died young.
Louisa Harrington Tollemache (1833–1928), who married Thomas Edward Taylor, son of Rev. Hon. Henry Edward Taylor and Marianne St. Leger, in 1862.
Clement Reginald Tollemache (1835–1895), a reverend who married Frances Josephine Simpson, daughter of Henry Simpson, in 1869. They had three children, including Aethel Tollemache.
Cornelia Katherine Tollemache (b. 1836)
Ernest Celestine Tollemache (1838–1880), a reverend who married Henrietta Maria Dixon, daughter of Col. Henry Dixon, in 1870.
Augustus Francis Tollemache (1839–1923), a reverend.
Cecilia Eleanor Tollemache (b. 1840)
Anastasius Eugene Tollemache (1842–1912), who married Alice Elizabeth Cursham, daughter of Reverend Curzon Cursham, in 1870.
↑George Edward Cokayne, editor, The Complete Baronetage, 5 volumes (no date (c. 1900); reprint, Gloucester, U.K.: Alan Sutton Publishing, 1983), volume V, page 248.