Psalm 2:11

Serve Jehovah with fear, And rejoice with trembling.

Philippians 2:12

So then, my beloved, even as ye have always obeyed, not as in my presence only, but now much more in my absence, work out your own salvation with fear and trembling;

Psalm 89:7

A God very terrible in the council of the holy ones, And to be feared above all them that are round about him?

Psalm 95:1-8

Oh come, let us sing unto Jehovah; Let us make a joyful noise to the rock of our salvation.

Psalm 97:1

Jehovah reigneth; let the earth rejoice; Let the multitude of isles be glad.

Psalm 99:1

Jehovah reigneth; let the peoples tremble: He sitteth above the cherubim; let the earth be moved.

Psalm 119:119-120

Thou puttest away all the wicked of the earth like dross: Therefore I love thy testimonies.

Hebrews 4:1-2

Let us fear therefore, lest haply, a promise being left of entering into his rest, any one of you should seem to have come short of it.

Hebrews 12:25

See that ye refuse not him that speaketh. For if they escaped not when they refused him that warned them on earth, much more'shall not we escape who turn away from him that warneth from heaven:

Hebrews 12:28-29

Wherefore, receiving a kingdom that cannot be shaken, let us have grace, whereby we may offer service well-pleasing to God with reverence and awe:

Treasury of Scripture Knowledge

Summary

Serve the LORD with fear, and rejoice with trembling.

Bible References

Serve

Psalm 89:7
A God very terrible in the council of the holy ones, And to be feared above all them that are round about him?
Hebrews 12:28
Wherefore, receiving a kingdom that cannot be shaken, let us have grace, whereby we may offer service well-pleasing to God with reverence and awe:

Rejoice

Psalm 95:1
Oh come, let us sing unto Jehovah; Let us make a joyful noise to the rock of our salvation.
Psalm 97:1
Jehovah reigneth; let the earth rejoice; Let the multitude of isles be glad.
Psalm 99:1
Jehovah reigneth; let the peoples tremble: He sitteth above the cherubim; let the earth be moved.
Psalm 119:120
My flesh trembleth for fear of thee; And I am afraid of thy judgments.
Philippians 2:12
So then, my beloved, even as ye have always obeyed, not as in my presence only, but now much more in my absence, work out your own salvation with fear and trembling;
Hebrews 4:1
Let us fear therefore, lest haply, a promise being left of entering into his rest, any one of you should seem to have come short of it.
Hebrews 12:25
See that ye refuse not him that speaketh. For if they escaped not when they refused him that warned them on earth, much more'shall not we escape who turn away from him that warneth from heaven:

American Standard Version Public Domain