Rice is critical for sustainable food and nutritional security; however, nominal micronutrient quantities in grains aggravate malnutrition in rice-eating poor populations. In this study, we evaluated genetic diversity in grain iron (Fe) and zinc (Zn) contents using trait-linked simple sequence repeat (SSR) markers in the representative subset of a large collection of local and exotic rice germplasm. Results demonstrated that aromatic fine grain accessions contained relatively higher Fe and Zn contents in brown rice (BR) than coarse grain accessions and a strong positive correlation between both mineral elements. Genotyping with 24 trait-linked SSR markers identified 21 polymorphic markers, among which 17 demonstrated higher gene diversity and polymorphism information content (PIC) values, strongly indicating that markers used in current research were moderate to highly informative for evaluating the genetic diversity. Population structure, principal coordinate and phylogenetic analyses classified studied rice accessions into two fine grain specific and one fine and coarse grain admixture subpopulations. Single marker analysis recognized four ZnBR and single FeBR significant marker-trait associations (MTAs) contributing 15.41-39.72% in total observed phenotypic variance. Furthermore, high grain Fe and Zn contents linked marker alleles from significant MTAs were also identified. Collectively, these results indicate a wide genetic diversity exist in grain Fe and Zn contents of studied rice accessions and reveal perspective for marker-assisted biofortification breeding.