Discussion about this post

User's avatar
Gaurav Seth's avatar

This is interesting. I worked on a flux region spatial control pipeline. I am trying to apply Lora to region-specific flux attention; however, the current system applies to the entire attention. I will study this in more detail. The regional solution I devised uses BBOX and Masking and feathering at the attention level, and we override the flux attention. Since this is now built into Comfy, I can try and adapt the custom pipeline to apply Lora to specific regions in Flux. Technically it should work using the technique showcased here.

Expand full comment
Selena's avatar

So what's the difference between Create Hook LoRA v.s. Create Hook Model as LoRA?

Expand full comment
20 more comments...

No posts