Butyrate in the gut of animals has potential properties including regulating the innate immune, modulating the lipid metabolism, and protecting gut healthy. So far, only limited information on the impact of butyrate on the neonatal is available. This study aimed to investigate effects of oral administration of sodium butyrate (SB) on gut microbiota and the expression of inflammatory cytokine in neonatal piglets. Ten litters of crossbred newborn piglets were randomly allocated to the SB and control (CO) groups, each group consisted of five litters (replicates). Piglets in the SB group were orally administrated with 7 to 13 ml sodium butyrate solution (150 mmol/l) per day from the age of 1 to 7 days, respectively; piglets in the CO group were treated with the same dose of physiological saline. On days 8 and 21 (of age), gut digesta and tissues were collected for the analysis of microbiota, butyrate concentration and gene expression of inflammatory cytokine. Results showed that there was no difference in the butyrate concentration in the gut of piglets on days 8 and 21 between two groups. Real-time PCR assay showed that SB had no effect on the numbers of total bacteria in the stomach, ileum, and colon. MiSeq sequencing of the V3-V4 region of the 16S rRNA gene revealed that SB increased the richness in the stomach and colon, and the diversity of colonic microbiota on day 8 (P < 0.05). Genera Acinetobacter, Actinobacillus, Facklamia, Globicatella, Kocuria, Rothia, unclassified Leptotrichiaceae, unclassified Neisseriaceae, and unclassified Prevotellaceae in the stomach were increased in relative abundance by SB treatment, whereas the abundances of Lactobacillus decreased on day 8 (P < 0.05). At the genus and operational taxonomic unit (OTU) levels, SB had low impact on bacterial community in the ileum and colon on days 8 and 21. SB treatment decreased the expression of IL-6, IL-8, IFN-γ, IL-10, TGF-β, and histone deacetylase 1 (HDAC1) in the ileum of piglets on day 8 (P < 0.05). SB treatment down-regulated the expression of IL-8, IFN-γ, and IL-1β on day 21 (P < 0.05). Correlation analysis on the combined datasets revealed some potential relationships between gut microbiota and the expression of inflammatory cytokines. The results show that early intervention with sodium butyrate can modulate the ileum inflammatory cytokine in neonatal piglets with low impact on intestinal microbial structure, which suggests oral administration of SB may have a benefit role in the health of neonatal piglets.