As washedup accurately points out they only launch south because in the event of a scrub they are over the ocean. And while Spacex could request an eastward flight plan, its unlikely the FAA would grant such a request because it is unlikely that SpaceX could assure them adequately that Bakersfield would not be at risk. For grins and giggles I confirmed this with the Air Force (their response was "Safety concerns restrict the available launches from this facility."

Interestingly SpacePort America (http://spaceportamerica.com/) has a similar problem, although if you look (https://www.google.com/maps/place/Spaceport+America/@33.0125...) you will see there isn't much east of it.