The serotonin system plays a critical role in the modulation of impulsive aggression. Although serotonin transporters (SERT) are key in modulating synaptic serotonin levels, few studies have investigated the role of SERT levels in human impulsive aggression. The aim of this study was to investigate whether brain SERT levels are associated with trait impulsive aggression. We included 148 healthy individuals (mean age 29.3 ± 13.0, range 18–80 years, 91 females) who had undergone positron emission positron (PET) examinations with the SERT tracer [11C]DASB and filled in self-report questionnaires of trait aggression, trait impulsivity and state aggression. We evaluated the association between cerebral SERT binding (BPND) and trait impulsive aggression in a latent variable model, with one latent variable (LVSERT) modelled from SERT BPND in frontostriatal and frontolimbic networks implicated in impulsive aggression, and another latent variable (LVIA) modelled from various trait measures of impulsivity and aggression. The LVSERT was not significantly associated with the LVIA (p = 0.8). Post-hoc univariate analyses did not reveal any significant associations between regional SERT levels and trait aggression, trait impulsivity or state aggression, but we found that state aggression at the day of PET scan was significantly lower in LA/LA homozygotes vs S-carriers of the 5-HTTLPR gene (p = 0.008). We conclude that brain SERT binding was not related to variations in trait impulsive aggression or state aggression. Our findings do not support that SERT is involved in mediating the serotonergic effects on aggression and impulsivity, at least not in individuals with non-pathological levels of impulsive aggression.