What Are the Limits of Viewpoint Diversity?