Bacterial infections and antibiotic abuse are a global threat to human health. In recent years, there has been a boom in research on antimicrobial agents with low toxicity and efficient nanomaterials. Boric acid-functionalized carbon dots (B-CDs) with negative surface charge were synthesized by the hydrothermal method. Covalent bonds were formed between the boric acid groups and the cis-diol groups of the polysaccharide in the bacterial cell wall, and numerous B-CDs were trapped on the bacterial surface. In the experiments of antibacterial activity, B-CDs presented strong bactericidal activity against Escherichia coli (E. coli) with a minimum bactericidal concentration of 12.5 μg/mL. The antibacterial mechanism suggested that B-CDs entered the cell interior by diffusion and posed significant damage to the double helix structure of E. coli DNA. Furthermore, B-CDs exhibited low toxicity. The results demonstrated that the novel antimicrobial B-CDs not only fought against E. coli infection and antibiotic misuse but also provided new ideas for safe and effective antimicrobial agents of carbon nanomaterials.