ControlNet: Adding Conditional Control to Text-to-Image Diffusion Models

web

Credibility Rating

3/5

Good(3)

Good quality. Reputable source with community review or editorial standards, but less rigorous than peer-reviewed venues.

Rating inherited from publication venue: GitHub

ControlNet is relevant to AI safety discussions around misuse of image generation capabilities, including deepfakes and disinformation, though the repository itself is a technical tool rather than a safety or policy resource.

Metadata

Importance: 42/100tool pagetool

Summary

ControlNet is an open-source neural network architecture that adds fine-grained spatial control to large pretrained text-to-image diffusion models like Stable Diffusion. It enables users to condition image generation on inputs such as edge maps, depth maps, pose skeletons, and segmentation maps. The repository provides the official implementation and has become a widely used tool in AI image generation research and applications.

Key Points

•Introduces a trainable copy of diffusion model encoder blocks that accepts additional conditioning inputs while preserving the original model weights.
•Supports diverse spatial conditioning signals including Canny edges, depth maps, human pose (OpenPose), segmentation masks, and more.
•Enables precise compositional control over generated images without retraining the base diffusion model from scratch.
•Widely adopted in creative AI workflows and downstream research, demonstrating significant capability advancement in controllable generation.
•Open-source repository with pretrained models, training code, and inference scripts, lowering barrier to reproducing and extending results.

Cited by 1 page

Page	Type	Quality
AI Disinformation	Risk	54.0

Cached Content Preview

HTTP 200Fetched Mar 20, 202639 KB

[Skip to content](https://github.com/lllyasviel/ControlNet#start-of-content)

You signed in with another tab or window. [Reload](https://github.com/lllyasviel/ControlNet) to refresh your session.You signed out in another tab or window. [Reload](https://github.com/lllyasviel/ControlNet) to refresh your session.You switched accounts on another tab or window. [Reload](https://github.com/lllyasviel/ControlNet) to refresh your session.Dismiss alert

{{ message }}

[lllyasviel](https://github.com/lllyasviel)/ **[ControlNet](https://github.com/lllyasviel/ControlNet)** Public

- [Notifications](https://github.com/login?return_to=%2Flllyasviel%2FControlNet) You must be signed in to change notification settings
- [Fork\\
3k](https://github.com/login?return_to=%2Flllyasviel%2FControlNet)
- [Star\\
33.8k](https://github.com/login?return_to=%2Flllyasviel%2FControlNet)


main

[**1** Branch](https://github.com/lllyasviel/ControlNet/branches) [**0** Tags](https://github.com/lllyasviel/ControlNet/tags)

[Go to Branches page](https://github.com/lllyasviel/ControlNet/branches)[Go to Tags page](https://github.com/lllyasviel/ControlNet/tags)

Go to file

Code

Open more actions menu

## Folders and files

| Name | Name | Last commit message | Last commit date |
| --- | --- | --- | --- |
| ## Latest commit<br>[![lllyasviel](https://avatars.githubusercontent.com/u/19834515?v=4&size=40)](https://github.com/lllyasviel)[lllyasviel](https://github.com/lllyasviel/ControlNet/commits?author=lllyasviel)<br>[Update README.md](https://github.com/lllyasviel/ControlNet/commit/ed85cd1e25a5ed592f7d8178495b4483de0331bf)<br>3 years agoSep 9, 2023<br>[ed85cd1](https://github.com/lllyasviel/ControlNet/commit/ed85cd1e25a5ed592f7d8178495b4483de0331bf) · 3 years agoSep 9, 2023<br>## History<br>[188 Commits](https://github.com/lllyasviel/ControlNet/commits/main/) <br>Open commit details<br>[View commit history for this file.](https://github.com/lllyasviel/ControlNet/commits/main/) 188 Commits |
| [annotator](https://github.com/lllyasviel/ControlNet/tree/main/annotator "annotator") | [annotator](https://github.com/lllyasviel/ControlNet/tree/main/annotator "annotator") | [Change requested by an important anonymous user](https://github.com/lllyasviel/ControlNet/commit/d3284fcd0972c510635a4f5abe2eeb71dc0de524 "Change requested by an important anonymous user  Change requested by an important anonymous user") | 3 years agoApr 22, 2023 |
| [cldm](https://github.com/lllyasviel/ControlNet/tree/main/cldm "cldm") | [cldm](https://github.com/lllyasviel/ControlNet/tree/main/cldm "cldm") | [fix a bug for DDIM inversion](https://github.com/lllyasviel/ControlNet/commit/2d12a1bc315f4be1deee464cd9434316f5867b8d "fix a bug for DDIM inversion  fix a bug of the incorrect timestep in DDIMSampler.encode() for DDIM inversion") | 3 years agoMar 28, 2023 |
| [docs](https://github.com/lllyasviel/ControlNet/tree/main/docs "docs") | [docs](https://github.com/lllyasviel/ControlNet/tree/main/docs "docs") | [Fix link to 

... (truncated, 39 KB total)

Resource ID: 8e6dfe3346e322e8 | Stable ID: OWUzMTIyN2