Diabodies (Dbs) and tandem single-chain variable fragments (taFv) are the most widely used recombinant formats for constructing small bispecific antibodies. However, only a few studies have compared these formats, and none have discussed their binding kinetics and cross-linking ability. We previously reported the usefulness for cancer immunotherapy of a humanized bispecific Db (hEx3-Db) and its single-chain format (hEx3-scDb) that target epidermal growth factor receptor and CD3. Here, we converted hEx3-Db into a taFv format to investigate how format affects the function of a small bispecific antibody; our investigation included a cytotoxicity assay, surface plasmon resonance spectroscopy, thermodynamic analysis, and flow cytometry. The prepared taFv (hEx3-taFv) showed an enhanced cytotoxicity, which may be attributable to a structural superiority to the diabody format in cross-linking target cells but not to differences in the binding affinities of the formats. Comparable cross-linking ability for soluble antigens was observed among hEx3-Db, hEx3-scDb, and hEx3-taFv with surface plasmon resonance spectroscopy. Furthermore, drastic increases in cytotoxicity were found in the dimeric form of hEx3-taFv, especially when the two hEx3-taFv were covalently linked. Our results show that converting the format of small bispecific antibodies can improve their function. In particular, for small bispecific antibodies that target tumor and immune cells, a functional orientation that avoids steric hindrance in cross-linking two target cells may be important in enhancing the growth inhibition effect.