Genetic drift is sampling error. Each generation, the alleles of the newborns are a random draw from the parents' gene pool, and a small draw misses things. Lower the founding size and watch one colour take over the chart; raise it and watch the frequency barely move while the generations tick by.
Genetic drift is sampling error: small populations lose alleles by chance, and large-scale studies need huge samples so real patterns rise above the same noise.