Current SARS-CoV-2 serological assays generate discrepant results, and the longitudinal characteristics of antibodies targeting various antigens after asymptomatic to mild COVID-19 are yet to be established. This longitudinal cohort study including 1965 healthcare workers, of which 381 participants exhibited antibodies against the SARS-CoV-2 spike antigen at study inclusion, reveal that these antibodies remain detectable in most participants, 96%, at least four months post infection, despite having had no or mild symptoms. Virus neutralization capacity was confirmed by microneutralization assay in 91% of study participants at least four months post infection. Contrary to antibodies targeting the spike protein, antibodies against the nucleocapsid protein were only detected in 80% of previously anti-nucleocapsid IgG positive healthcare workers. Both anti-spike and anti-nucleocapsid IgG levels were significantly higher in previously hospitalized COVID-19 patients four months post infection than in healthcare workers four months post infection (p = 2*10-23 and 2*10-13 respectively). Although the magnitude of humoral response was associated with disease severity, our findings support a durable and functional humoral response after SARS-CoV-2 infection even after no or mild symptoms. We further demonstrate differences in antibody kinetics depending on the antigen, arguing against the use of the nucleocapsid protein as target antigen in population-based SARS-CoV-2 serological surveys.