Psalm 2:11

Serve ye Jehovah with fear, And rejoice with trembling.

Philippians 2:12

So that, my beloved, as ye always obey, not as in my presence only, but now much more in my absence, with fear and trembling your own salvation work out,

Psalm 89:7

God is very terrible, In the secret counsel of His holy ones, And fearful over all surrounding Him.

Psalm 95:1-8

Come, we sing to Jehovah, We shout to the rock of our salvation.

Psalm 97:1

Jehovah hath reigned, The earth is joyful, many isles rejoice.

Psalm 99:1

Jehovah hath reigned, peoples tremble, The Inhabitant of the cherubs, the earth shaketh.

Psalm 119:119-120

Dross! Thou hast caused to cease All the wicked of the earth; Therefore I have loved Thy testimonies.

Hebrews 4:1-2

We may fear, then, lest a promise being left of entering into His rest, any one of you may seem to have come short,

Hebrews 12:25

See, may ye not refuse him who is speaking, for if those did not escape who refused him who upon earth was divinely speaking -- much less we who do turn away from him who speaketh from heaven,

Hebrews 12:28-29

wherefore, a kingdom that cannot be shaken receiving, may we have grace, through which we may serve God well-pleasingly, with reverence and religious fear;

Treasury of Scripture Knowledge

Summary

Serve the LORD with fear, and rejoice with trembling.

Bible References

Serve

Psalm 89:7
God is very terrible, In the secret counsel of His holy ones, And fearful over all surrounding Him.
Hebrews 12:28
wherefore, a kingdom that cannot be shaken receiving, may we have grace, through which we may serve God well-pleasingly, with reverence and religious fear;

Rejoice

Psalm 95:1
Come, we sing to Jehovah, We shout to the rock of our salvation.
Psalm 97:1
Jehovah hath reigned, The earth is joyful, many isles rejoice.
Psalm 99:1
Jehovah hath reigned, peoples tremble, The Inhabitant of the cherubs, the earth shaketh.
Psalm 119:120
Trembled from Thy fear hath my flesh, And from Thy judgments I have been afraid!
Philippians 2:12
So that, my beloved, as ye always obey, not as in my presence only, but now much more in my absence, with fear and trembling your own salvation work out,
Hebrews 4:1
We may fear, then, lest a promise being left of entering into His rest, any one of you may seem to have come short,
Hebrews 12:25
See, may ye not refuse him who is speaking, for if those did not escape who refused him who upon earth was divinely speaking -- much less we who do turn away from him who speaketh from heaven,