Pilgrim was the son of unknown parents. The date and place of his birth have not been found.
He had two marriages/partners. His first wife was Elsbeth von Tottelbach. They were married, but the date and place have not been found. Their two known children were Albrecht (?-1384) and Pilgrim (?-1396).
His second wife was Kunigund Stuchsin von Trautmansdorf. They were married, but the date and place have not been found. They had no known children.