Skip to content

[modular diffusers] introducing ModularLoader #11462

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 40 commits into from
Apr 30, 2025
Merged

[modular diffusers] introducing ModularLoader #11462

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
40 commits
Select commit Hold shift + click to select a range
0c4c1a8
cfg; slg; pag; sdxl without controlnet
a-r-r-o-w Apr 14, 2025
9da8a9d
support sdxl controlnet
a-r-r-o-w Apr 14, 2025
b81bd78
support controlnet union
a-r-r-o-w Apr 14, 2025
31593e2
update
a-r-r-o-w Apr 14, 2025
6255302
update
a-r-r-o-w Apr 14, 2025
2238f55
cfg zero*
a-r-r-o-w Apr 14, 2025
52b9b61
use unwrap_module for torch compiled modules
a-r-r-o-w Apr 14, 2025
d8d2ea3
remove guider kwargs
a-r-r-o-w Apr 14, 2025
b31904b
remove commented code
a-r-r-o-w Apr 14, 2025
57c7e15
remove old guider
a-r-r-o-w Apr 14, 2025
8d31c69
fix slg bug
a-r-r-o-w Apr 15, 2025
1c1d1d5
remove debug print
a-r-r-o-w Apr 15, 2025
ba579f4
autoguidance
a-r-r-o-w Apr 15, 2025
720783e
smoothed energy guidance
a-r-r-o-w Apr 15, 2025
b9bcd46
add note about seg
a-r-r-o-w Apr 15, 2025
2dc673a
tangential cfg
a-r-r-o-w Apr 16, 2025
77d8a28
cfg plus plus
a-r-r-o-w Apr 16, 2025
78fca12
support cfgpp in ddim
a-r-r-o-w Apr 16, 2025
19555e9
update doc & repr
yiyixuxu Apr 22, 2025
01e9a5a
move formating utilitys to modular_pipeline_util.py
yiyixuxu Apr 22, 2025
170a3c5
attemp to break ModularPipeline base into componentstate and a pipeli…
yiyixuxu Apr 22, 2025
e38f09b
update components manageer: add -collection arg, allow subfoldeer arg…
yiyixuxu Apr 23, 2025
2571c00
move componentspec, configspec, input output param to utils
yiyixuxu Apr 23, 2025
3b30e79
modularpipeloine -> modularpipelineloader, setup_loader, make loader …
yiyixuxu Apr 23, 2025
d456a97
update components manager, allow loading with spec
yiyixuxu Apr 24, 2025
a1eb9ee
make component spec loadable: add load/create method
yiyixuxu Apr 24, 2025
e2dcf9a
update ModularLarder, add save/from_pretrained, proper register_compo…
yiyixuxu Apr 24, 2025
267a1af
up
yiyixuxu Apr 25, 2025
3e4a772
fix
yiyixuxu Apr 25, 2025
e8b5cde
up!
yiyixuxu Apr 28, 2025
1952941
up!
yiyixuxu Apr 29, 2025
de8ce52
up
yiyixuxu Apr 29, 2025
9113613
component manager update get and get_one
yiyixuxu Apr 30, 2025
40c7d2b
merge conflict
yiyixuxu Apr 30, 2025
aaab69c
fix merge
yiyixuxu Apr 30, 2025
c1084b8
more merge fix
yiyixuxu Apr 30, 2025
9bfddfe
Apply suggestions from code review
yiyixuxu Apr 30, 2025
cdb31df
more merge fix
yiyixuxu Apr 30, 2025
45ca430
ModularPipeline -> ModularLoader
yiyixuxu Apr 30, 2025
35fa520
up
yiyixuxu Apr 30, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions src/diffusers/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -249,7 +249,7 @@
"KarrasVePipeline",
"LDMPipeline",
"LDMSuperResolutionPipeline",
"ModularPipeline",
"ModularLoader",
"PNDMPipeline",
"RePaintPipeline",
"ScoreSdeVePipeline",
Expand Down Expand Up @@ -502,7 +502,7 @@
"StableDiffusionXLImg2ImgPipeline",
"StableDiffusionXLInpaintPipeline",
"StableDiffusionXLInstructPix2PixPipeline",
"StableDiffusionXLModularPipeline",
"StableDiffusionXLModularLoader",
"StableDiffusionXLPAGImg2ImgPipeline",
"StableDiffusionXLPAGInpaintPipeline",
"StableDiffusionXLPAGPipeline",
Expand Down Expand Up @@ -840,7 +840,7 @@
KarrasVePipeline,
LDMPipeline,
LDMSuperResolutionPipeline,
ModularPipeline,
ModularLoader,
PNDMPipeline,
RePaintPipeline,
ScoreSdeVePipeline,
Expand Down Expand Up @@ -1071,7 +1071,7 @@
StableDiffusionXLImg2ImgPipeline,
StableDiffusionXLInpaintPipeline,
StableDiffusionXLInstructPix2PixPipeline,
StableDiffusionXLModularPipeline,
StableDiffusionXLModularLoader,
StableDiffusionXLPAGImg2ImgPipeline,
StableDiffusionXLPAGInpaintPipeline,
StableDiffusionXLPAGPipeline,
Expand Down
8 changes: 4 additions & 4 deletions src/diffusers/pipelines/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@
"AutoPipelineForInpainting",
"AutoPipelineForText2Image",
]
_import_structure["modular_pipeline"] = ["ModularPipeline"]
_import_structure["modular_pipeline"] = ["ModularLoader"]
_import_structure["consistency_models"] = ["ConsistencyModelPipeline"]
_import_structure["dance_diffusion"] = ["DanceDiffusionPipeline"]
_import_structure["ddim"] = ["DDIMPipeline"]
Expand Down Expand Up @@ -329,7 +329,7 @@
"StableDiffusionXLInpaintPipeline",
"StableDiffusionXLInstructPix2PixPipeline",
"StableDiffusionXLPipeline",
"StableDiffusionXLModularPipeline",
"StableDiffusionXLModularLoader",
"StableDiffusionXLAutoPipeline",
]
)
Expand Down Expand Up @@ -468,7 +468,7 @@
from .deprecated import KarrasVePipeline, LDMPipeline, PNDMPipeline, RePaintPipeline, ScoreSdeVePipeline
from .dit import DiTPipeline
from .latent_diffusion import LDMSuperResolutionPipeline
from .modular_pipeline import ModularPipeline
from .modular_pipeline import ModularLoader
from .pipeline_utils import (
AudioPipelineOutput,
DiffusionPipeline,
Expand Down Expand Up @@ -693,7 +693,7 @@
StableDiffusionXLImg2ImgPipeline,
StableDiffusionXLInpaintPipeline,
StableDiffusionXLInstructPix2PixPipeline,
StableDiffusionXLModularPipeline,
StableDiffusionXLModularLoader,
StableDiffusionXLPipeline,
StableDiffusionXLAutoPipeline,
)
Expand Down
Loading