Obesity is associated with increased macrophage and extracellular matrix accumulation in adipose tissue, which can be partially reversed following weight loss by daily caloric restriction. This study examined the effects of 8 weeks of intermittent fasting (IF; 24-hour fast on 3 nonconsecutive days per week) in mice fed a chow or high-fat diet (HFD; 43% fat) on markers of adipose tissue inflammation and fibrosis. We found that IF decreased energy intake, body weight, and fat cell size in HFD-fed mice and decreased fat mass and improved glucose tolerance in chow- and HFD-fed mice. IF decreased mRNA levels of macrophage markers (Lgals3, Itgax, Ccl2, and Ccl3) in inguinal and gonadal fat, as well as adipose tissue macrophage numbers in HFD-fed mice only, and altered genes involved in NLRP3 inflammasome pathway in both diet groups. IF increased mRNA levels of matrix metallopeptidase 9, which is involved in extracellular matrix degradation, and reduced mRNA levels of collagen 6 α-1 and tissue inhibitor of matrix metallopeptidase 1, as well as fibrosis in gonadal fat in HFD-fed mice. In summary, our results show that intermittent fasting improved glucose tolerance in chow- and HFD-fed mice and ameliorated adipose tissue inflammation and fibrosis in HFD-fed mice.