1 John 2:19

They went out from us, but they were not of us: for if they had been indeed of us, they would have continued with us; but this was done that they might be made manifest, because all, that are with us, are not indeed of us.

Acts 20:30

And from among yourselves shall men arise, speaking perverse things to draw away disciples after them.

1 Corinthians 11:19

For there must be even heresies among you, that they who are approved may be made manifest among you.

Matthew 13:20-21

And he who received the seed as upon stony grounds, is one that heareth the word and immediately receiveth it with joy:

Matthew 24:24

for there shall rise up false Christs, and false prophets, who shall shew great signs and prodigies, so as to deceive, if possible, even the elect.

Mark 4:5-6

and some fell on stony ground, where it had not much earth, and it sprang up immediately, because it had not depth of earth;

Mark 4:16-17

And in like manner, they that are sown as on stony grounds are such, as when they hear the word,

Mark 13:22

for there shall rise up false Christs, and false prophets, who shall work signs and wonders, to seduce, if possible, even the elect.

Luke 8:13

And those on stony-ground are such as when they hear, receive the word with joy; but have no root, and so believe only for a while, and in the time of trial fall away.

John 4:14

but he that drinketh of the water which I shall give him, shall never thirst: but the water, which I shall give him, will be in him a fountain of water springing up unto eternal life.

John 6:37-39

All that the Father giveth me, will come unto me; and him that cometh to me I will not cast out.

John 10:28-30

And I give them eternal life, and they shall never perish; nor shall any one force them out of my hand.

John 15:2

every branch in me that beareth not fruit He taketh away, and every one that beareth fruit, He purgeth, that it may bear more fruit.

Acts 15:24

Forasmuch as we have heard, that some who went out from us, have troubled you by their discourses, unsettling your minds, saying, ye must be circumcised, and keep the law; to whom we gave no such commission;

Romans 9:6

Not that the word of God hath failed. For they are not all Israel, who are descended from Israel.

Romans 11:5-6

And so in the present time also there is a remnant according to the election of grace.

2 Timothy 2:10

Therefore I submit to every thing for the sake of the elect, that they also may obtain the salvation which is by Christ Jesus, with eternal glory.

2 Timothy 2:19

However, the foundation of God standeth firm, having this inscription, The Lord knoweth them that are his; and, Let every one that nameth the name of Christ depart from iniquity.

2 Timothy 3:9

But they shall not proceed far: for their folly shall be evident to all, as theirs also was.

Hebrews 10:39

But we are not of those who withdraw to perdition; but of them that believe to the saving of the soul.

1 Peter 1:2-5

Asia, and Bithynia, chosen according to the fore-knowledge of God, through sanctification of the Spirit, unto obedience, and to the sprinkling of the blood of Jesus Christ,---may grace and peace be multiplied unto you.

2 Peter 2:20-21

For if, after they had escaped the pollutions of the world, through the knowledge of the Lord and Saviour Jesus Christ, they are again entangled and vanquished by them, their last state is worse than the first;

Jude 1:1

Jude a servant of Jesus Christ, and brother of James, to them that are sanctified in God the Father, and who are preserved and called in Jesus Christ;

Jude 1:19

These are they who separate themselves, sensualists, not having the Spirit.

Treasury of Scripture Knowledge

Summary

They went out from us, but they were not of us; for if they had been of us, they would no doubt have continued with us: but they went out, that they might be made manifest that they were not all of us.

Bible References

Went out

Matthew 13:20
And he who received the seed as upon stony grounds, is one that heareth the word and immediately receiveth it with joy:
Mark 4:5
and some fell on stony ground, where it had not much earth, and it sprang up immediately, because it had not depth of earth;
Luke 8:13
And those on stony-ground are such as when they hear, receive the word with joy; but have no root, and so believe only for a while, and in the time of trial fall away.
John 15:2
every branch in me that beareth not fruit He taketh away, and every one that beareth fruit, He purgeth, that it may bear more fruit.
Acts 15:24
Forasmuch as we have heard, that some who went out from us, have troubled you by their discourses, unsettling your minds, saying, ye must be circumcised, and keep the law; to whom we gave no such commission;
Acts 20:30
And from among yourselves shall men arise, speaking perverse things to draw away disciples after them.
2 Peter 2:20
For if, after they had escaped the pollutions of the world, through the knowledge of the Lord and Saviour Jesus Christ, they are again entangled and vanquished by them, their last state is worse than the first;
Jude 1:19
These are they who separate themselves, sensualists, not having the Spirit.

They might

Romans 9:6
Not that the word of God hath failed. For they are not all Israel, who are descended from Israel.
Romans 11:5
And so in the present time also there is a remnant according to the election of grace.
1 Corinthians 11:19
For there must be even heresies among you, that they who are approved may be made manifest among you.
2 Timothy 3:9
But they shall not proceed far: for their folly shall be evident to all, as theirs also was.
Hebrews 10:39
But we are not of those who withdraw to perdition; but of them that believe to the saving of the soul.

General references

Matthew 25:2
and five were foolish.
John 10:5
But they will not follow a stranger, but will flee from him; because they know not the voice of strangers.
1 Timothy 5:15
For some are already turned aside after Satan.