Olivier was the son of Simon van der Banck and NN de Baenst. The date and place of his birth have not been found.
His wife was Margaretha Brouckx. They were married, but the date and place have not been found. Their two known children were Margaretha (?-1462) and Antoine (?-1458).