Commentators unanimously explain that Mary and Joseph were not negligent. It was customary to travel from feasts in large caravans of family and neighbors. These groups often separated by age and gender, making it easy for each parent to assume Jesus was with the other in a different part of the company.