Many speculators get their license specifically to avoid these fees; so the professional speculators can speculate for less marginal overhead than an individual that intends to live in the home.
Most housing that is “speculated” on is still rented out. Encouraging price discovery lets us provide cheaper housing in areas of high demand before it becomes a major problem.
Most homeowners are not jumping houses every year or so.