Harriet was the daughter of unknown parents. The date and place of her birth have not been found.
Her husband was John Caller, who she married in 1865 in Church of St Peter and St Paul, South Petherton, Somerset, England . Their thirteen known children were Elizabeth (1865-?), Ellen (1867-?), Albert (1868-?), Emily (1869-?), Albert (1870-?), Gilbert (1872-?), Thomas (1873-?), Edward (1874-?), Florence (1876-?), Richard (1877-?), Minnie (1879-?), Arthur (1880-?) and Oliver (1880-?).