Type 2 diabetes mellitus (T2DM) can cause multidimensional cognitive deficits, among which working memory (WM) is usually involved at an early stage. However, the neural substrates underlying impaired WM in T2DM patients are still unclear. To clarify this issue, we utilized functional magnetic resonance imaging (fMRI) and independent component analysis to evaluate T2DM patients for alterations in brain activation and functional connectivity (FC) in WM networks and to determine their associations with cognitive and clinical variables. Twenty complication-free T2DM patients and 19 matched healthy controls (HCs) were enrolled, and fMRI data were acquired during a block-designed 1-back WM task. The WM metrics of the T2DM patients showed no differences compared with those of the HCs, except for a slightly lower accuracy rate in the T2DM patients. Compared with the HCs, the T2DM patients demonstrated increased activation within their WM fronto-parietal networks, and activation strength was significantly correlated with WM performance. The T2DM patients also showed decreased FC within and between their WM networks. Our results indicate that the functional integration of WM sub-networks was disrupted in the complication-free T2DM patients and that strengthened regional activity in fronto-parietal networks may compensate for the WM impairment caused by T2DM.