All the commentaries agree that the people wept because hearing the Law read aloud made them acutely aware of their sins and failures. Matthew Henry notes this was not a bad thing, but a "good sign that their hearts were tender." This shows that a proper response to God's Word often begins with a heartfelt conviction of sin.