I’ve been experimenting with ControlNet for the past few days. At this moment (2025/01/22), SD1.5, SDXL and FLUX models all have their corresponding ControlNet models, all of which are supported in Forge UI.
This post is a note to put the resources together. I’ll try to keep it up to date.
ControlNet models for SD1.5
https://huggingface.co/lllyasviel/ControlNet-v1-1/tree/main
SD1.5 has the most control net types, including canny, depth, line art, tile, soft edge, etc.
ControlNet models for SDXL
https://huggingface.co/lllyasviel/sd_control_collection/tree/main
As stated in the model card, this package is a “collection of community SD control models”. It’s contributed by different community users, and they are all great models. I haven’t found models developed by the official SD team.
ControlNet models for FLUX
https://huggingface.co/XLabs-AI/flux-controlnet-collections/tree/main
So far, only canny, depth and hed are available.