Psalm 2:11

Serve the LORD in fear, and rejoice unto him in reverence.

Philippians 2:12

Wherefore, my dearly beloved, as ye have always obeyed - not when I was present only, but now much more in mine absence - even so work out your own salvation with fear and trembling.

Psalm 89:7

God is greatly to be feared in the council of the saints, and to be had in reverence of all them that are about him.

Psalm 95:1-8

{An exhortation to the earnest praising of God} O come, let us sing unto the LORD; let us heartily rejoice in the strength of our salvation.

Psalm 97:1

The LORD is king. The earth may be glad thereof; yea, the multitude of the isles may be glad thereof.

Psalm 99:1

The LORD is king, be the people never so inpatient; he sitteth upon the cherubims, be the earth never so unquiet.

Psalm 119:119-120

Thou puttest away all the ungodly of the earth like dross; therefore I love thy testimonies.

Hebrews 4:1-2

Let us fear, therefore, lest any of us forsaking the promise of entering into his rest, should seem to come behind.

Hebrews 12:25

See that ye despise not him that speaketh. For if they escaped not which refused him that spake on earth; Much more shall we not escape, if we turn away from him that speaketh from heaven:

Hebrews 12:28-29

Wherefore if we receive a kingdom which is not moved, we have grace, whereby we may serve God and please him with reverence and godly fear.

Treasury of Scripture Knowledge

Summary

Serve the LORD with fear, and rejoice with trembling.

Bible References

Serve

Psalm 89:7
God is greatly to be feared in the council of the saints, and to be had in reverence of all them that are about him.
Hebrews 12:28
Wherefore if we receive a kingdom which is not moved, we have grace, whereby we may serve God and please him with reverence and godly fear.

Rejoice

Psalm 95:1
{An exhortation to the earnest praising of God} O come, let us sing unto the LORD; let us heartily rejoice in the strength of our salvation.
Psalm 97:1
The LORD is king. The earth may be glad thereof; yea, the multitude of the isles may be glad thereof.
Psalm 99:1
The LORD is king, be the people never so inpatient; he sitteth upon the cherubims, be the earth never so unquiet.
Psalm 119:120
My flesh trembleth for fear of thee; and I am afraid of thy judgments.
Philippians 2:12
Wherefore, my dearly beloved, as ye have always obeyed - not when I was present only, but now much more in mine absence - even so work out your own salvation with fear and trembling.
Hebrews 4:1
Let us fear, therefore, lest any of us forsaking the promise of entering into his rest, should seem to come behind.
Hebrews 12:25
See that ye despise not him that speaketh. For if they escaped not which refused him that spake on earth; Much more shall we not escape, if we turn away from him that speaketh from heaven: