Patient portals that provide secure online access to medical record information and provider communication can improve health care. Yet new technologies can exacerbate existing disparities. We analyzed information about 2,325 insured respondents to the nationally representative 2017 Health Information National Trends Survey to examine characteristics of portal nonusers and reasons for nonuse. Sixty-three percent reported not using a portal during the prior year. In multivariable analysis, we found that nonusers were more likely to be male, be on Medicaid, lack a regular provider, and have less than a college education, compared to users. Similar disparities existed in who reported being offered access to a portal, with nonwhites also less likely to report being offered access. Reasons for nonuse included the desire to speak directly to providers and privacy concerns, both of which require recognition of the important role of provider communication and patient-provider relationships.