Low physical activity and high sedentary behaviour have been clearly linked with colorectal cancer development, yet data on their potential role in colorectal cancer survival is limited. Better characterisation of these relationships is needed for the development of post-diagnosis physical activity and sedentary behaviour guidance for colorectal cancer survivors. We searched PubMed and Embase through 28 February 2022 for studies assessing post-diagnosis physical activity, and/or sedentary behaviour in relation to all-cause and cause-specific mortality and recurrence after colorectal cancer diagnosis. Total and recreational physical activity were assessed overall and by frequency, duration, intensity, and volume using categorical, linear, and non-linear dose–response random-effects meta-analyses. The Global Cancer Update Programme (CUP Global) independent Expert Committee on Cancer Survivorship and Expert Panel interpreted and graded the likelihood of causality. We identified 16 observational studies on 82,220 non-overlapping patients from six countries. Physical activity was consistently inversely associated with colorectal cancer morbidity and mortality outcomes, with 13%–60% estimated reductions in risk. Sedentary behaviour was positively associated with all-cause mortality. The evidence had methodological limitations including potential confounding, selection bias and reverse causation, coupled with a limited number of studies for most associations. The CUP Global Expert panel concluded limited-suggestive evidence for recreational physical activity with all-cause mortality and cancer recurrence. Total physical activity and its specific domains and dimensions, and sedentary behaviour were all graded as limited-no conclusion for all outcomes. Future research should focus on randomised trials, while observational studies should obtain objective and repeated physical activity measures and better adjustment for confounders.