Luke 1:47

and my spirit has rejoiced in God, my Savior.

Romans 5:2-11

Through Jesus we have also gained access by [our] faith to this unearned favor [of God]. We stand firm in it, and are glad that we have the hope of being honored by God.

Romans 8:15

For you did not receive the Holy Spirit, to enslave you again to fear, [Note: Some translators take "Holy Spirit" here to be "spirit," making the verse say "you did not receive the spirit of slavery"], but you received the Holy Spirit [who produces] sonship, so we can call out, "Abba", [which means] "Father."

Romans 14:4

Who [do you think] you are, to pass judgment on someone else's household servant? He stands [approved] or falls [into disapproval] before his own Master [only]. Yes, [surely] he will stand [approved], for the Lord is capable of helping him to stand.

2 Corinthians 3:17

Now the Lord [i.e., Christ] is the Holy Spirit, and there is freedom [from the bondage of sin and fear] wherever the Spirit of the Lord is.

Galatians 4:6-7

And because you are [His] children, God sent the Holy Spirit of His Son into our hearts, to call out, "Abba," [which means] "Father."

1 Peter 1:5

Through God's power you are protected by [your] faith, so that you can expect to be saved in the end.

Jude 1:24

Now, may there be honor and majesty and power to God, who is able to guard you people from stumbling [and falling away from Him, See Gal. 5:4], and [who is able] to place you before His glorious presence without any [moral] blemish, but with great joy.

Treasury of Scripture Knowledge

Summary

Restore unto me the joy of thy salvation; and uphold me with thy free spirit.

Bible References

Joy

Luke 1:47
and my spirit has rejoiced in God, my Savior.
Romans 5:2
Through Jesus we have also gained access by [our] faith to this unearned favor [of God]. We stand firm in it, and are glad that we have the hope of being honored by God.

Uphold

Romans 14:4
Who [do you think] you are, to pass judgment on someone else's household servant? He stands [approved] or falls [into disapproval] before his own Master [only]. Yes, [surely] he will stand [approved], for the Lord is capable of helping him to stand.
1 Peter 1:5
Through God's power you are protected by [your] faith, so that you can expect to be saved in the end.
Jude 1:24
Now, may there be honor and majesty and power to God, who is able to guard you people from stumbling [and falling away from Him, See Gal. 5:4], and [who is able] to place you before His glorious presence without any [moral] blemish, but with great joy.

Free

Romans 8:15
For you did not receive the Holy Spirit, to enslave you again to fear, [Note: Some translators take "Holy Spirit" here to be "spirit," making the verse say "you did not receive the spirit of slavery"], but you received the Holy Spirit [who produces] sonship, so we can call out, "Abba", [which means] "Father."
2 Corinthians 3:17
Now the Lord [i.e., Christ] is the Holy Spirit, and there is freedom [from the bondage of sin and fear] wherever the Spirit of the Lord is.
Galatians 4:6
And because you are [His] children, God sent the Holy Spirit of His Son into our hearts, to call out, "Abba," [which means] "Father."