Advances in surface-enhanced Raman scattering (SERS) detection have helped to overcome the limitations of traditional in vitro diagnostic methods, such as fluorescence and chemiluminescence, owing to its high sensitivity and multiplex detection capability. However, for the implementation of SERS detection technology in disease diagnosis, a SERS-based assay platform capable of analyzing clinical samples is essential. Moreover, infectious diseases like COVID-19 require the development of point-of-care (POC) diagnostic technologies that can rapidly and accurately determine infection status. As an effective assay platform, SERS-based bioassays utilize SERS nanotags labeled with protein or DNA receptors on Au or Ag nanoparticles, serving as highly sensitive optical probes. Additionally, a microdevice is necessary as an interface between the target biomolecules and SERS nanotags. This review aims to introduce various microdevices developed for SERS detection, available for POC diagnostics, including LFA strips, microfluidic chips, and microarray chips. Furthermore, the article presents research findings reported in the last 20 years for the SERS-based bioassay of various diseases, such as cancer, cardiovascular diseases, and infectious diseases. Finally, the prospects of SERS bioassays are discussed concerning the integration of SERS-based microdevices and portable Raman readers into POC systems, along with the utilization of artificial intelligence technology.