The application of mid-infrared laser spectroscopy to the reagent-free quantification of the concentration of glucose was investigated using cryogenically cooled lead salt lasers or, alternatively, quantum cascade lasers operating at room temperature. The concentration of glucose in aqueous solutions was quantified by means of fiber-based attenuated total reflection (ATR) spectroscopy (fiber-optical evanescent field analysis, FEFA) as well as fiber-based transmission spectroscopy. Both methods have the potential to be utilized by small fiber sensors, which can be inserted into the subcutaneous tissue in order to continuously measure the local concentration of glucose. In our in vitro experiments, noise-equivalent concentrations as low as 10 mg/dL were achieved. The mid-term stability of the measurement schemes was investigated by means of Allan variance analysis. Based on the research presented in this manuscript, an all-room-temperature measurement scheme using quantum cascade lasers, miniaturized fiber-optic sensors, and pyroelectric detectors appears well suited for the continuous monitoring of glucose concentrations at physiological levels.