Psalm 2:11

Worship the Lord with reverence
And rejoice with trembling.

Philippians 2:12

So then, my beloved, just as you have always obeyed, not as in my presence only, but now much more in my absence, work out your salvation with fear and trembling;

Psalm 89:7

A God greatly feared in the council of the holy ones,
And awesome above all those who are around Him?

Psalm 95:1-8

O come, let us sing for joy to the Lord,
Let us shout joyfully to the rock of our salvation.

Psalm 97:1

The Lord reigns, let the earth rejoice;
Let the many islands be glad.

Psalm 99:1

The Lord reigns, let the peoples tremble;
He is enthroned above the cherubim, let the earth shake!

Psalm 119:119-120

You have removed all the wicked of the earth like dross;
Therefore I love Your testimonies.

Hebrews 4:1-2

Therefore, let us fear if, while a promise remains of entering His rest, any one of you may seem to have come short of it.

Hebrews 12:25

See to it that you do not refuse Him who is speaking. For if those did not escape when they refused him who warned them on earth, much less will we escape who turn away from Him who warns from heaven.

Hebrews 12:28-29

Therefore, since we receive a kingdom which cannot be shaken, let us show gratitude, by which we may offer to God an acceptable service with reverence and awe;

Treasury of Scripture Knowledge

Summary

Serve the LORD with fear, and rejoice with trembling.

Bible References

Serve

Psalm 89:7
A God greatly feared in the council of the holy ones,
And awesome above all those who are around Him?
Hebrews 12:28
Therefore, since we receive a kingdom which cannot be shaken, let us show gratitude, by which we may offer to God an acceptable service with reverence and awe;

Rejoice

Psalm 95:1
O come, let us sing for joy to the Lord,
Let us shout joyfully to the rock of our salvation.
Psalm 97:1
The Lord reigns, let the earth rejoice;
Let the many islands be glad.
Psalm 99:1
The Lord reigns, let the peoples tremble;
He is enthroned above the cherubim, let the earth shake!
Psalm 119:120
My flesh trembles for fear of You,
And I am afraid of Your judgments.
Philippians 2:12
So then, my beloved, just as you have always obeyed, not as in my presence only, but now much more in my absence, work out your salvation with fear and trembling;
Hebrews 4:1
Therefore, let us fear if, while a promise remains of entering His rest, any one of you may seem to have come short of it.
Hebrews 12:25
See to it that you do not refuse Him who is speaking. For if those did not escape when they refused him who warned them on earth, much less will we escape who turn away from Him who warns from heaven.