Small abalone (Haliotis diversicolor) is a commercially valuable species for both fisheries and aquaculture. The production of annual farmed small abalone in Taiwan, once the highest in the world, has dramatically decreased in the past 15 years, and currently, the industry is close to collapse. Understanding the genetic diversity of small abalone and developing stock identification methods will be useful for genetic breeding, restoring collapsed stocks, managing stocks, and preventing illegal trade. We investigated 307 cultured and wild individuals from Taiwan, Japan, and Bali Island (Indonesia) by using the mitochondrial cytochrome c oxidase subunit I (COI) gene. Network analysis of mtDNA COI gene sequences revealed that the individuals collected from Taiwan, Japan, and Indonesia could be identified, and showed significant genetic divergence. In addition, the Indonesian population (Haliotis diversicolor squamata) was significantly different from the other populations and might need to be considered a separate species. We discovered a single nucleotide polymorphism marker in the mtDNA COI gene that can be used to distinguish the Taiwan population from the Japan population. We also developed a polymerase chain reaction-restriction fragment length polymorphism method for rapid detection. Furthermore, we could identify the cultured stocks, wild population, and hybrid stocks by using 6 microsatellites and amplified fragment length polymorphism. This study contributes useful tools for stock identification and the production of high-disease resistant small abalone strains (Japan × Taiwan or Taiwan × Japan). Efforts should be made to avoid unintentional random genetic mixing of the Taiwan population with the Japan population and subsequent breakdown of population differentiation, which impair local adaptation of the Taiwan wild population. Molecular markers revealed a split between the Taiwan and Japan populations, and the existence of a possible barrier to the free dispersal of small abalone is discussed.