Commentators explain that the brothers' fear was not based on Joseph's actions, but on their own guilty consciences. Years after being forgiven, their past sin resurfaced, causing them to project their own potential for revenge onto Joseph. As John Calvin notes, this shows how an evil conscience can be its own tormentor, creating fear and distrust where there is no cause.