Downsizing tow vehicle will I regret it

[ichrisdr]

Hello. If this topic has already been discussed please just point me in the right direction. So I have been contemplating downsizing my tow vehicle from a GMC Sierra full size with the 6.2L V-8 motor (420 horsepower and 460 lb-ft of torque) to a mid size pickup like the Ranger, Tacoma or Colorado. I'm towing an Escape 19. During the summer months I travel full time with my wife and dog around Colorado, Utah, Montana, Washington, Oregon, Idaho etc. Places with real mountains. We hike, SUP, mountain bike, explore towns, explore wilderness. With that in mind here is my list of pros and cons:

My gut tells me downsizing is a bad idea but I figured it would be fun to have the conversation. Any thoughts or opinions are greatly appreciated. Feel free to add anything I may not have thought of. Thanks in advance.

Pros:
Mid size truck much easier getting around while not trailing the camper.
Theoretically mid size truck will have better fuel economy when not trailing the camper. I currently get 14mpg around town and 20mpg on the highway while not towing.
Something better offroad. My current truck is decent off road but I would get something like the Tacoma TRD Pro. Something that will make me more comfortable exploring off the beaten path.
Current truck easily pulls the camper and I feel secure knowing the truck is much heavier than the camper.
Cheaper maintenance costs

Cons
I'm concerned that I will get worse fuel economy with a mid size truck while towing the Escape 19.
My fuel range will be much shorter.
I'm concerned that coming from a full size truck I will feel like I just don't have enough power. With the full size I feel very comfortable merging onto highways or passing if I have to while towing. I usually drive 65mph even when the speed limit is 80mph while towing.
With the mid size truck I'll probably feel the trailer a lot more. Now I don't even know it's there.
Lower payload capacity although I don't think this will be an issue but something I need to consider.