With a high outdoorsman, and certain squares giving you almost 100 exp (highest I have encountered was 87? I think) It would make grinding a little too easy.
Loner has average od or perhaps no od at all. So if they use this speedy travel, they will drop in forced encounters more often and thus actually reach their destination slower. Taxi will basically never drop in those encs and moves super fast.