The rapid growth and rising housing costs in St. Johns County are forcing workers and seniors to leave the area.