Colab notebooks for text-to-image generators

❗️ This repository is not maintained since 2022, as closed-source state-of-the-art text-to-image solutions are now widely available for everyone.

User-friendly Colab notebooks for various text prompt steered synthetic image generators. These notebooks are not actively maintained, though issues and pull requests are welcome.

Available notebooks (latest to oldest):

• Stable Diffusion (v1.4, v1.5, waifu diffusion)
• DALL·E Mini (craiyon.ai)
• Latent Diffusion LAION 400M
• ruDALLE Malevich
• JAX CLIP Guided Diffusion
• CLIP+VQGAN
• Latent Vision
• Big Sleep

---

These techniques are all more or less descendants of Big Sleep (2021), the original concept of reversing OCR by using CLIP (OpenAI) to steer BigGAN (Andrew Brock et al.) in a consumer-accessible manner, as introduced by Ryan Murdock in his original notebook. The technique has since branched and evolved into what we now know as Midjourney, Dall-E, Stable Diffusion, etc.

I do not use these notebooks on a regular basis, and hence I'm mostly unaware when some library gets updated and a notebook may no longer function; Please do raise an issue should any problems occur.

---

Stable Diffusion by CompVis, Stability AI and LAION

This colab requires registering with Hugging Face for login token and accepting model card terms to download required models here and here.

"Satanism in the 1900s"

---

DALL·E Mini (craiyon.ai) by Boris Dayma

This colab requires registering with wandb for an authentication key to download required models.

"Satanism in the 1900s"

---

Latent Diffusion LAION 400M by CompVis

"Satanism in the 1900s" (upscaled)

---

ruDALLE Malevich by Sberbank-AI

<br> "Satanism in the 1900s"

---

JAX CLIP Guided Diffusion by nshepperd<br>

Method originally by Katherine Crowson<br>

<br> 300 iterations of "Satanism in the 1900s".

---

CLIP+VQGAN by Katherine Crowson<br>

Papers: 1) VQGAN by Patrick Esser et al, 2) CLIP by OpenAI

<br> 400 iterations of "Satanism in the 1900s".

---

Latent Vision by Ryan Murdock<br>

Papers: 1) VQGAN by Patrick Esser et al, 2) CLIP by OpenAI

<br> 400 iterations of "Satanism in the 1900s".

---

Big Sleep by Phil Wang (more precisely this fork)<br>

Papers: 1) BigGAN by Andrew Brock et al, 2) CLIP by OpenAI

Original Big Sleep method.

<br> 400 iterations of "Satanism in the 1900s".