We present Adaptive IMLE, a generative modeling approach that covers all the modes and produces high-quality results. Adaptive IMLE is capble of learning from a few samples from scratch without any auxiliary datasets. We apply our method to the challenging task of few-shot unconditional image generation with as few as 100 data examples.