Genebanks collect and preserve vast collections of plants and detailed passport information, with the aim of preserving genetic diversity for conservation and breeding. Genetic characterization of such collections has the potential to elucidate the genetic histories of important crops, use marker-trait associations to identify loci controlling traits of interest, search for loci undergoing selection, and contribute to genebank management by identifying taxonomic misassignments and duplicates. We conducted a genomic scan with genotyping by sequencing (GBS) derived single nucleotide polymorphisms (SNPs) of 10,038 pepper (Capsicum spp.) accessions from worldwide genebanks and investigated the recent history of this iconic staple. Genomic data detected up to 1,618 duplicate accessions within and between genebanks and showed that taxonomic ambiguity and misclassification often involve interspecific hybrids that are difficult to classify morphologically. We deeply interrogated the genetic diversity of the commonly consumed Capsicum annuum to investigate its history, finding that the kinds of peppers collected in broad regions across the globe overlap considerably. The method ReMIXTURE-using genetic data to quantify the similarity between the complement of peppers from a focal region and those from other regions-was developed to supplement traditional population genetic analyses. The results reflect a vision of pepper as a highly desirable and tradable cultural commodity, spreading rapidly throughout the globe along major maritime and terrestrial trade routes. Marker associations and possible selective sweeps affecting traits such as pungency were observed, and these traits were shown to be distributed nonuniformly across the globe, suggesting that human preferences exerted a primary influence over domesticated pepper genetic structure.