Albert Barnes Commentary Judges 8:17

"And he brake down the tower of Penuel, and slew the men of the city." — Judges 8:17 (ASV)

The men of the city - Perhaps the rulers: who, it is likely, had possession of the tower or citadel, and so could tyrannize over the people. Gideon killed the great men, and beat down their towers, but did not injure the inhabitants.