Commentators explain that the stone didn't literally hear the people's promise. Instead, Joshua used a figure of speech (prosopopoeia) to make a powerful point. The stone would serve as a permanent, physical witness to their covenant. If they later denied God, they would be more senseless than the very rock that stood as a silent testament to their vow, which would then metaphorically 'testify' against them.