Intra-individual response time variability (IIRTV) is proposed as a viable endophenotype for many psychiatric disorders, particularly attention-deficit hyperactivity disorder (ADHD). Here we assessed whether IIRTV was associated with common DNA variation genome-wide and whether IIRTV mediated the relationship between any associated loci and self-reported ADHD symptoms. A final data set from 857 Australian young adults (489 females and 368 males; Mage = 22.14 years, SDage = 4.82 years) who completed five response time tasks and self-reported symptoms of ADHD using the Conners' Adult ADHD Rating Scale was used. Principal components analysis (PCA) on these response time measures (standard deviation of reaction times and the intra-individual coefficient of variation) produced two variability factors (labelled response selection and selective attention). To understand the genetic drivers of IIRTV we performed a genome-wide association analysis (GWAS) on these PCA-derived indices of IIRTV. For the selective attention variability factor, we identified one single-nucleotide polymorphism (SNP) attaining genome-wide significance; rs62182100 in the HDAC4 gene located on chromosome 2q37. A bootstrapping mediation analysis demonstrated that the selective attention variability factor mediated the relationship between rs62182100 and self-reported ADHD symptoms. Our findings provide the first evidence of a genome-wide significant SNP association with IIRTV and support the potential utility of IIRTV as a valid endophenotype for ADHD symptoms. However, limitations of this study suggest that these observations should be interpreted with caution until replication samples become available.