Syntactic processing and verbal working memory are both essential components to sentence comprehension. Nonetheless, the separability of these systems in the brain remains unclear. To address this issue, we performed causal-inference analyses based on lesion and connectome network mapping using MRI and behavioral testing in 103 individuals with chronic post-stroke aphasia. We employed a rhyme judgment task with heavy working memory load without articulatory confounds, controlling for the overall ability to match auditory words to pictures and to perform a metalinguistic rhyme judgment, isolating the effect of working memory load. We assessed noncanonical sentence comprehension, isolating syntactic processing by incorporating residual rhyme judgment performance as a covariate for working memory load. Voxel-based lesion analyses and structural connectome-based lesion symptom mapping controlling for total lesion volume were performed, with permutation testing to correct for multiple comparisons (4,000 permutations). We observed that effects of working memory load localized to dorsal stream damage: posterior temporal-parietal lesions and frontal-parietal white matter disconnections. These effects were differentiated from syntactic comprehension deficits, which were primarily associated with ventral stream damage: lesions to temporal lobe and temporal-parietal white matter disconnections, particularly when incorporating the residual measure of working memory load as a covariate. Our results support the conclusion that working memory and syntactic processing are associated with distinct brain networks, largely loading onto dorsal and ventral streams, respectively.