'Privily' in the Bible

Then Joseph her husband, being a just man, and not willing to make her a publick example, was minded to put her away privily.

Then Herod, when he had privily called the wise men, inquired of them diligently what time the star appeared.

But Paul said unto them, They have beaten us openly uncondemned, being Romans, and have cast us into prison; and now do they thrust us out privily? nay verily; but let them come themselves and fetch us out.

And that because of false brethren unawares brought in, who came in privily to spy out our liberty which we have in Christ Jesus, that they might bring us into bondage:

But there were false prophets also among the people, even as there shall be false teachers among you, who privily shall bring in damnable heresies, even denying the Lord that bought them, and bring upon themselves swift destruction.