Most commentators believe the women of the community are speaking here. Stung by Jeremiah's rebuke, they deflect responsibility by claiming their husbands knew about and approved of their idolatrous worship. It's a classic case of shifting blame, arguing, 'We didn't do it alone, our husbands sanctioned it!'