Evaluating the contribution of the tumour microenvironment (TME) in tumour progression has proven a complex challenge due to the intricate interactions within the TME. Multiplexed imaging is an emerging technology that allows concurrent assessment of multiple of these components simultaneously. Here we utilise a highly multiplexed dataset of 61 markers across 746 colorectal tumours to investigate how complex mTOR signalling in different tissue compartments influences patient prognosis. We found that the signalling of mTOR pathway can have heterogeneous activation patterns in tumour and immune compartments which correlate with patient prognosis. Using graph neural networks, we determined the most predictive features of mTOR activity in immune cells and identified relevant cellular subpopulations. We validated our observations using spatial transcriptomics data analysis in an independent patient cohort. Our work provides a framework for studying complex cell signalling and reveals important insights for developing mTOR-based therapies.