[wstein]

Originally Posted by VishalPathak

Now the speed of traveling away from the physical body became a challenge because you have to navigate back also....

Usually its not required to 'navigate back'. If fact most people have the opposite problem of returning when they don't want to.

There are many ways to 'return' to your body location.
-If you see a silver or white cord attached to you follow it back.
-fall asleep where you are, you will wake up in your body
-if you have energy skills, turn off the energy flow energizing your astral body
-if you are moving via intent (not flying, swimming, walking as a being) change your destination to your your body
-learn to teleport
-if you have spirit guides ask them to accompany you

Originally Posted by VishalPathak

Majorly because of some fear and being unaware of the route that I'm heading and will I be able to come back or not..

This is most likely the real issue. Fear will interfere with astral travel in all sorts of ways.

Originally Posted by VishalPathak

What's your observations on speed of astral body? What factors can alter it?

The maximum speed of the astral body is essentially infinite. How 'fast' you can go all depends on what locomotion mode you select. If you create a fully functional astral body, you can crawl, walk, swim, fly at speeds typical for animals doing the same. If you move by intent, you can get to the edge of this galaxy in under a minute. If you teleport, you can get nearly anywhere in a few seconds.

[advanced] the 'time' it takes to travel when you are doing it and how long your body experiences differs drastically. What you experience as a few second astral travel, is several minutes in your body location.