The 22 percent gap is real and the contractor's explanation is partly legitimate. Labor and subs do price by neighborhood because logistics, parking, security, and the expectation of exacting punch-list work all cost more on a high-end site. That is a documented pattern, not a bluff.
The carrying-cost argument is different, though. When a contractor says he is pricing in your carrying cost, he is essentially charging you for the risk that delays on his end leave you holding an expensive asset longer. That framing puts his execution risk onto your balance sheet, which is worth pushing back on directly.
The standard move is to get a second bid from a contractor who has worked at this price point before. A competing number does two things: it tells you whether the 22 percent is market or margin, and it gives you a concrete data point to take back to your current contractor. If the second bid comes in close, the premium is probably real. If it comes in 10 to 12 percent lower, you have room to negotiate.
One thing worth knowing before you decide: the strategy guide for luxury flips flags that renovation budgets at this level have very little margin for error, because every cost input is magnified. A contractor who already bakes in an assumption about your carrying exposure may also be less motivated to keep the timeline tight, since he has already priced that risk rather than trying to avoid it. That dynamic is worth weighing alongside the dollar difference.
I cannot tell you what the right number is without knowing your market and the specific scope, so this is a starting point for your own due diligence rather than a final answer.
What did the second bid come back at, or are you still deciding whether to pull one?