Markov Cohort State-Transition Model: A Multinomial Distribution Representation

Med Decis Making. 2023 Jan;43(1):139-142. doi: 10.1177/0272989X221112420. Epub 2022 Jul 15.

Abstract

A Markov model simulates the average experience of a cohort of patients.Monte Carlo simulation, the standard approach for estimating the variance, is computationally expensive.A multinomial distribution provides an exact representation of a Markov model.Using the known formulas of a multinomial distribution, the mean and variance of a Markov model can be readily calculated.

Keywords: cohort model; cost-effectiveness analysis; decision-analytic model; markov model; state-transition model.

MeSH terms

  • Humans
  • Markov Chains*
  • Monte Carlo Method