Varieties swept out by Grassmannians of lines