The aim of this study is to formulate a new methodology based upon informational tools to detect patients with cardiac arrhythmias. As it is known, sudden death is the consequence of a final arrhythmia, and here lies the relevance of the efforts aimed at the early detection of arrhythmias. The information content in the time series from an electrocardiogram (ECG) signal is conveyed in the form of a probability distribution function, to compute the permutation entropy proposed by Bandt and Pompe. This selection was made seeking its remarkable conceptual simplicity, computational speed, and robustness to noise. In this work, two well-known databases were used, one containing normal sinus rhythms and another one containing arrhythmias, both from the MIT medical databank. For different values of embedding time delay τ, normalized permutation entropy and statistical complexity measure are computed to finally represent them on the horizontal and vertical axes, respectively, which define the causal plane H×C. To improve the results obtained in previous works, a feature set composed by these two magnitudes is built to train the following supervised machine learning algorithms: random forest (RF), support vector machine (SVM), and k nearest neighbors (kNN). To evaluate the performance of each classification technique, a 10-fold cross-validation scheme repeated 10 times was implemented. Finally, to select the best model, three quality parameters were computed, namely, accuracy, the area under the receiver operative characteristic (ROC) curve (AUC), and the F1-score. The results obtained show that the best classification model to detect the ECG coming from arrhythmic patients is RF. The values of the quality parameters were at the same levels reported in the available literature using a larger data set, thus supporting this proposal that uses a very small-sized feature space to train the model later used to classify. Summarizing, the attained results show the possibility to discriminate both groups of patients, with normal sinus rhythm or arrhythmic ECG, showing a promising efficiency in the definition of new markers for the detection of cardiovascular pathologies.