Albert Barnes Commentary Psalms 105:3

"Glory ye in his holy name: Let the heart of them rejoice that seek Jehovah." — Psalms 105:3 (ASV)

Glory ye in his holy name - The original word rendered “glory” is the same word which is commonly used to denote “praise,” and it has that meaning here. The idea is, in your praises let the main subject be the name of God—that holy name by which he chooses to be known. The Hebrew is, “the name of his holiness.” It implies:

• that we should rejoice in God—in his very name—in that by which he chooses to make himself known;
• that it is a special subject of praise and rejoicing that his name is “holy;” that is, that he is a holy Being.

This can be a subject of real rejoicing only to those who are themselves holy; but properly considered, one of the highest reasons for rejoicing in God is the fact that he is holy—that he cannot look upon sin but with abhorrence. There would be no ground of confidence in God if this were not so.

Let the heart of them rejoice that seek the Lord - That desire to know him; that come to praise him. Let their hearts rejoice—or, let them be happy:

• because they are “permitted” to seek him;
• because they are inclined to seek him;
• because they have such a God to come to—One so mighty, so holy, so good, so gracious.