That factor alone is one of the big reasons I'm shopping used. I'd much rather have someone else take that initial hit. I know there is still a substantial price difference on most used vehicles depending on trim level, but it usually isn't nearly as bad as the disparity in prices on new vehicles.
Trim level is another thing that I learned can be a huge headache in dealing with sellers that aren't local. Actual vehicle condition, as well. That includes dealerships. People are willing to flat out lie to you about what they have, just to get you to show up. All in hopes that you'll just accept whatever it is because you don't want to waste a trip. When buying the wife's 6 we had to walk away from multiple dealerships, despite having driven for hours to check out a car. In some cases, we were in the office ready to sign papers and ended up walking away. That is a fun way to piss off a salesman.
You have to be willing to walk. At any point. I think it is in my blood though. My parents almost walked on a dealership when the monthly payment on the paperwork was $0.01 more than what they had agreed to verbally. Dad might have signed, mom wasn't having it. The salesman just looked at my dad and said, "Is she serious?" Dad laughed and said, "I wouldn't test her." They adjusted the payment.