The neocortex contains multiple types of inhibitory neurons whose properties suggest they may play different roles within the cortical circuit. By recording from three cell types during two distinct network states (UP and DOWN states) in vitro, we were able to quantify differences in firing characteristics between these cells during different network regimes. We recorded from regular-spiking (RS) excitatory cells and two types of inhibitory neurons, the fast-spiking (FS) neurons and GFP- (and somatostatin-) expressing inhibitory neurons (GIN), in layer 2/3 of slices from mouse somatosensory neocortex. Comparisons of firing characteristics between these cells during UP- and DOWN-states showed several patterns. First, of these cell types, only GIN cells fired persistently during DOWN-states, whereas all three cell types fired readily during UP-states. Second, the onset of firing and distribution of action potentials throughout UP-states differed by cell type, showing that FS cell UP-state firing occurred preferentially near the beginning of the UP-state, whereas the firing of RS cells was slower to develop at the start of the UP-state, and GIN cell firing was sustained throughout the duration of the UP-state. Finally, membrane potential and spike correlations between heterogeneous cell types were more pronounced during UP-states and, in the case of RS synapses onto GIN cells, varied throughout the UP-state. These results suggest that there is a division of labor between FS and GIN cells as the UP-state progresses and suggest that GIN cells could be important in the termination of UP-states.