Manifolds polarized by vector bundles