In this work, a series of multitargeting histone deacetylase (HDAC) inhibitors capable of regulating the signal transduction between RAS protein and downstream effectors were obtained by introducing a zinc-ion-binding group into the framework of rigosertib via different linkers. Among them, two representative compounds, XSJ-7 and XSJ-10, not only showed stronger antiproliferative activity against many types of cancer cells including solid tumor cells but also presented more potent inhibition on different subtypes of HDAC than suberoylanilide hydroxamic acid (SAHA). Significantly, XSJ-10 presented moderate pharmacokinetic behaviors and showed stronger antitumor activity than oxaliplatin, SAHA, and rigosertib in the HT-29 xenograft mouse models without significant systemic toxicity. Research on the anticancer mechanism of XSJ-10 revealed that it can effectively induce the apoptosis of cancer cells and suppress the tumor by strongly inhibiting the RAS-RAF-MEK-ERK signaling pathway and the acetylation level of HDAC3.