Commentators explain that 'forsaking God' wasn't an outright denial of His existence. Rather, it was corrupting pure worship by adding rituals and gods not commanded by Him. The people likely thought they were being extra religious, but God defines faithfulness as obedience to His revealed word alone. As John Calvin notes, God is forsaken as soon as people turn aside from His pure word.