The King James Bible addresses being alone in several passages:
Deuteronomy 31:6 (KJV)
6 Be strong and of a good courage, fear not, nor be afraid of them: for the LORD thy God, he it is that doth go with thee; he will not fail thee, nor forsake thee.
Hebrews 13:5 (KJV)
5 Let your conversation be without covetousness; and be content with such things as ye have: for he hath said, I will never leave thee, nor forsake thee.
Psalms 25:16 (KJV)
16 Turn thee unto me, and have mercy upon me; for I am desolate and afflicted.
Psalms 68:6 (KJV)
6 God setteth the solitary in families: he bringeth out those which are bound with chains: but the rebellious dwell in a dry land.
Matthew 28:20 (KJV)
20 Teaching them to observe all things whatsoever I have commanded you: and, lo, I am with you alway, even unto the end of the world. Amen.