I did 7 yrs out of 20 in LTL, I hated it, came right back to food and I'm happy again, your relationship with your customers is a closer one than in LTL, as long as hard physical labor and long hrs don't bother you, getting into food could be very rewarding for you.
I can understand the fear of change, especially if you are up the board a ways, however, we only have this one life, and we gotta work, the way I figure it, a guy may as well be happy at the place he goes to more than his own home!
There are several of us food guys, and even one girl, on here, you can go to the general foodservice section and get more opinions, there is many years of experience between all of us, we are glad to help anyway we can!