{"id":24210,"date":"2024-12-02T10:34:51","date_gmt":"2024-12-02T02:34:51","guid":{"rendered":"https:\/\/www.1ai.net\/?p=24210"},"modified":"2024-12-02T10:40:14","modified_gmt":"2024-12-02T02:40:14","slug":"flux%e5%ae%98%e6%96%b9%e7%89%88controlnet%e6%9d%a5%e4%ba%86%ef%bc%8cflux%e5%ae%98%e6%96%b9%e9%87%8d%e7%bb%98%e3%80%81%e6%89%a9%e5%9b%be%e3%80%81%e9%a3%8e%e6%a0%bc%e5%8f%82%e8%80%83","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/24210.html","title":{"rendered":"FLUX \"official ControlNet\" is here, Flux official redrawing, expansion, style reference common drawing features comparable to (or even exceed) closed-source tools!"},"content":{"rendered":"<p>The already strong Flux has announced a batch of official tools covering common drawing features, making it comparable to (or even surpassing) closed-source tools.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24211\" title=\"67cc09dbj00snuh78001td000t300num\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/67cc09dbj00snuh78001td000t300num.jpg\" alt=\"67cc09dbj00snuh78001td000t300num\" width=\"1047\" height=\"858\" \/><\/p>\n<p>First of all you need to be already in the<a href=\"https:\/\/www.1ai.net\/en\/tag\/comfyui\" title=\"_Other Organiser\" target=\"_blank\" >ComfyUI<\/a>The latest version of Flux is installed in the Flux Manager, see here for how to install it:<a href=\"https:\/\/www.1ai.net\/en\/24258.html\/\">FLUX Testing and Installation<\/a><\/p>\n<p>The following itemizes the methods used in ComfyUI and the download paths for the models\/workflows.<\/p>\n<p><strong>I. Flux repainting (Fill Inpainting)<\/strong><\/p>\n<p>The model flux1-fill-dev.safetensors needs to be downloaded:<\/p>\n<p>https:\/\/huggingface.co\/black-forest-labs\/<a href=\"https:\/\/www.1ai.net\/en\/tag\/flux\" title=\"_OTHER ORGANISER\" target=\"_blank\" >FLUX<\/a>.1-Fill-dev\/tree\/main<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24212\" title=\"3d06e3c0j00snuh770020d000u000jfm\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/3d06e3c0j00snuh770020d000u000jfm.jpg\" alt=\"3d06e3c0j00snuh770020d000u000jfm\" width=\"1080\" height=\"699\" \/><\/p>\n<p>Place the downloaded models in the ComfyUI\/models\/diffusion_models\/ folder.<\/p>\n<p>Download Flux Redraw Workflow:<\/p>\n<p>https:\/\/education.civitai.com\/wp-content\/uploads\/2024\/08\/Flux-Fill-Basic-Workflow-Inpaint.zip<\/p>\n<p>Once unzipped, drag the file with the extension json to the ComfyUI interface to get the following workflow:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24213\" title=\"3679cef6j00snuh78000yd000u000c3m\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/3679cef6j00snuh78000yd000u000c3m.jpg\" alt=\"3679cef6j00snuh78000yd000u000c3m\" width=\"1080\" height=\"435\" \/><\/p>\n<p>Use this chart for testing:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24214\" title=\"75ca775cj00snuh78001fd000ow00w0m\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/75ca775cj00snuh78001fd000ow00w0m.jpg\" alt=\"75ca775cj00snuh78001fd000ow00w0m\" width=\"896\" height=\"1152\" \/><\/p>\n<p>In ComfyUI's Load Image window, right-click on the image and select \"Open in MaskEditor\", then paint over the part you want to modify:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24215\" title=\"ed4194f3j00snuh770016d000fe00kfm\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/ed4194f3j00snuh770016d000fe00kfm.jpg\" alt=\"ed4194f3j00snuh770016d000fe00kfm\" width=\"554\" height=\"735\" \/><\/p>\n<p>Click \"Save to node\" to save the file:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24216\" title=\"c9c3ab00j00snuh78000ud000u000g0m\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/c9c3ab00j00snuh78000ud000u000g0m.jpg\" alt=\"c9c3ab00j00snuh78000ud000u000g0m\" width=\"1080\" height=\"576\" \/><\/p>\n<p>After that, fill in the keywords, change the character to a blonde swimsuit girl and start generating:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24217\" title=\"ac9d93cdj00snuh78001md000u000n6m\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/ac9d93cdj00snuh78001md000u000n6m.jpg\" alt=\"ac9d93cdj00snuh78001md000u000n6m\" width=\"1080\" height=\"834\" \/><\/p>\n<p>Then there's the example of redrawing the big knife this girl is holding as a sledgehammer:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24218\" title=\"60706573j00snuh780021d000u000ofm\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/60706573j00snuh780021d000u000ofm.jpg\" alt=\"60706573j00snuh780021d000u000ofm\" width=\"1080\" height=\"879\" \/><\/p>\n<p>Or add a spaceship in the sky:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24219\" title=\"f9a8e7d9j00snuh780025d000u000o7m\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/f9a8e7d9j00snuh780025d000u000o7m.jpg\" alt=\"f9a8e7d9j00snuh780025d000u000o7m\" width=\"1080\" height=\"871\" \/><\/p>\n<p><strong>II. Flux Expansion (Fill Outpainting)<\/strong><\/p>\n<p>The model used is the same as above, also flux1-fill-dev.safetensors. the workflow is downloaded from here:<br \/>\nhttps:\/\/education.civitai.com\/wp-content\/uploads\/2024\/08\/Flux-Fill-Basic-Workflow-Outpaint.zip<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24220\" title=\"fb4a14dbj00snuh780011d000u000eim\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/fb4a14dbj00snuh780011d000u000eim.jpg\" alt=\"fb4a14dbj00snuh780011d000u000eim\" width=\"1080\" height=\"522\" \/><\/p>\n<p>The operation is similar to repainting, the only thing you need to pay attention to is the \"Pad Image for Outpainting\" window, here you can control the range of expansion, for example, the image below is expanded by 400 pixels on the left side and 400 pixels on the right side:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24221\" title=\"e050b62aj00snuh77000bd000bf0073m\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/e050b62aj00snuh77000bd000bf0073m.jpg\" alt=\"e050b62aj00snuh77000bd000bf0073m\" width=\"411\" height=\"255\" \/><\/p>\n<p>The official enlargement tool works quite well, see a few test results below:<\/p>\n<p>Extend the beach in the background<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24222\" title=\"3efcd61bj00snuh780010d000u000d2m\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/3efcd61bj00snuh780010d000u000d2m.jpg\" alt=\"3efcd61bj00snuh780010d000u000d2m\" width=\"1080\" height=\"470\" \/><\/p>\n<p>Expanded car interiors are largely logical<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24223\" title=\"7e91cfdaj00snuh78001xd000u000dzm\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/7e91cfdaj00snuh78001xd000u000dzm.jpg\" alt=\"7e91cfdaj00snuh78001xd000u000dzm\" width=\"1080\" height=\"503\" \/><\/p>\n<p>The secondary expansion is also well represented<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24224\" title=\"d8abfd44j00snuh78002pd000u000dpm\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/d8abfd44j00snuh78002pd000u000dpm.jpg\" alt=\"d8abfd44j00snuh78002pd000u000dpm\" width=\"1080\" height=\"493\" \/><\/p>\n<p>Live-action movie stills, with the cue word \"rear motorcycle.\"<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24225\" title=\"9c3ef46ej00snuh780027d000u000hym\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/9c3ef46ej00snuh780027d000u000hym.jpg\" alt=\"9c3ef46ej00snuh780027d000u000hym\" width=\"1080\" height=\"646\" \/><\/p>\n<p>The cue word \"man in a suit on the bed\" was added, making it hard to tell if it was real or not.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24226\" title=\"36ef1da4j00snuh77001jd000u000clm\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/36ef1da4j00snuh77001jd000u000clm.jpg\" alt=\"36ef1da4j00snuh77001jd000u000clm\" width=\"1080\" height=\"453\" \/><\/p>\n<p><strong>III. Flux style reference (Redux)<\/strong><\/p>\n<p>Download sigclip_vision_patch14_384.safetensors model:<br \/>\nhttps:\/\/huggingface.co\/Comfy-Org\/sigclip_vision_384\/blob\/main\/sigclip_vision_patch14_384.safetensors<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24227\" title=\"af2cb1fej00snuh770012d000u000cjm\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/af2cb1fej00snuh770012d000u000cjm.jpg\" alt=\"af2cb1fej00snuh770012d000u000cjm\" width=\"1080\" height=\"451\" \/><\/p>\n<p>Place the model in the ComfyUI\/models\/clip_vision\/ folder.<\/p>\n<p>Download the flux1-redux-dev.safetensors model:<br \/>\nhttps:\/\/huggingface.co\/black-forest-labs\/FLUX.1-Redux-dev\/tree\/main<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24228\" title=\"3b5c8cd5j00snuh78001qd000u000jgm\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/3b5c8cd5j00snuh78001qd000u000jgm.jpg\" alt=\"3b5c8cd5j00snuh78001qd000u000jgm\" width=\"1080\" height=\"700\" \/><\/p>\n<p>Place the model in the ComfyUI\/models\/style_models\/ folder.<\/p>\n<p>Download the Flux style reference workflow:<br \/>\nhttps:\/\/education.civitai.com\/wp-content\/uploads\/2024\/08\/Flux-Redux-Basic-Workflow.zip<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24229\" title=\"a04e2afdj00snuh78002bd000u000oum\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/a04e2afdj00snuh78002bd000u000oum.jpg\" alt=\"a04e2afdj00snuh78002bd000u000oum\" width=\"1080\" height=\"894\" \/><\/p>\n<p>The main function of the style reference is to generate similar variants based on the current image, such as the example below:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24230\" title=\"70da922dj00snuh78001yd000u000emm\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/70da922dj00snuh78001yd000u000emm.jpg\" alt=\"70da922dj00snuh78001yd000u000emm\" width=\"1080\" height=\"526\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24231\" title=\"5169fef3j00snuh78002hd000u000gbm\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/5169fef3j00snuh78002hd000u000gbm.jpg\" alt=\"5169fef3j00snuh78002hd000u000gbm\" width=\"1080\" height=\"587\" \/><\/p>\n<p>Additionally, the style reference can introduce multiple images at the same time.<\/p>\n<p>Multi-chart workflow download page:<br \/>\nhttps:\/\/openart.ai\/workflows\/salmonrk\/multi-flux-redux&#8212;mix-2-image-by-flux-redux\/1tCNHnqfolXUUJxIjXcW<\/p>\n<p>Multiple images can produce some interesting effects, such as having the girl carry a large knife:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24232\" title=\"abec0148j00snuh780029d000u000oem\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/abec0148j00snuh780029d000u000oem.jpg\" alt=\"abec0148j00snuh780029d000u000oem\" width=\"1080\" height=\"878\" \/><\/p>\n<p>Let the characteristics of the two characters create a fusion:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24233\" title=\"9885d4fdj00snuh780022d000u000o7m\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/9885d4fdj00snuh780022d000u000o7m.jpg\" alt=\"9885d4fdj00snuh780022d000u000o7m\" width=\"1080\" height=\"871\" \/><\/p>\n<p>Real people become secondary and are placed in an anime background:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24234\" title=\"34c5bb2ej00snuh78002id000u000n7m\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/34c5bb2ej00snuh78002id000u000n7m.jpg\" alt=\"34c5bb2ej00snuh78002id000u000n7m\" width=\"1080\" height=\"835\" \/><\/p>\n<p><strong>IV. Flux ControlNet<\/strong><\/p>\n<p>ControlNet is<a href=\"https:\/\/www.1ai.net\/en\/tag\/ai%e7%bb%98%e7%94%bb\" title=\"[SEES ARTICLES WITH [AI PAINTING] LABELS]\" target=\"_blank\" >AI Painting<\/a>Indispensable models, this time Flux launched its own version, including Canny (edge detection) and Depth (depth control).<\/p>\n<p>Canny Download Address:<br \/>\nhttps:\/\/huggingface.co\/black-forest-labs\/FLUX.1-Canny-dev\/tree\/main<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24235\" title=\"595dea9ej00snuh78001rd000u000jim\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/595dea9ej00snuh78001rd000u000jim.jpg\" alt=\"595dea9ej00snuh78001rd000u000jim\" width=\"1080\" height=\"702\" \/><\/p>\n<p>Canny LoRA Download Address:<br \/>\nhttps:\/\/huggingface.co\/black-forest-labs\/FLUX.1-Canny-dev-lora\/tree\/main<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24236\" title=\"2145b6fdj00snuh77001qd000u000hym\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/2145b6fdj00snuh77001qd000u000hym.jpg\" alt=\"2145b6fdj00snuh77001qd000u000hym\" width=\"1080\" height=\"646\" \/><\/p>\n<p>Depth Download Address:<br \/>\nhttps:\/\/huggingface.co\/black-forest-labs\/FLUX.1-Depth-dev\/tree\/main<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24237\" title=\"b7625101j00snuh77001ud000u000j7m\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/b7625101j00snuh77001ud000u000j7m.jpg\" alt=\"b7625101j00snuh77001ud000u000j7m\" width=\"1080\" height=\"691\" \/><\/p>\n<p>Depth LoRA Download Address:<br \/>\nhttps:\/\/huggingface.co\/black-forest-labs\/FLUX.1-Depth-dev-lora\/tree\/main<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24238\" title=\"7c1ff7c4j00snuh78001rd000u000i5m\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/7c1ff7c4j00snuh78001rd000u000i5m.jpg\" alt=\"7c1ff7c4j00snuh78001rd000u000i5m\" width=\"1080\" height=\"653\" \/><\/p>\n<p>Note that the LoRA version is extracted from the full version, which is smaller and more efficient, and the effect needs to be compared and experienced by yourself.<\/p>\n<p>Canny Workflow:<br \/>\nhttps:\/\/education.civitai.com\/wp-content\/uploads\/2024\/08\/Flux-Canny-Basic-Workflow.zip<\/p>\n<p>Depth workflow:<br \/>\nhttps:\/\/education.civitai.com\/wp-content\/uploads\/2024\/08\/Flux-Depth-Basic-Workflow.zip<\/p>\n<p>Simply look at the effect, Canny can better retain the overall structure of the original picture and make changes:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24239\" title=\"b70e6e44j00snuh78001bd000u000cnm\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/b70e6e44j00snuh78001bd000u000cnm.jpg\" alt=\"b70e6e44j00snuh78001bd000u000cnm\" width=\"1080\" height=\"455\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24240\" title=\"36967815j00snuh78001qd000u000jam\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/36967815j00snuh78001qd000u000jam.jpg\" alt=\"36967815j00snuh78001qd000u000jam\" width=\"1080\" height=\"694\" \/><\/p>\n<p>Depth is better suited for controlling the effect of depth of field in an image:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24241\" title=\"83a97577j00snuh780019d000u000cmm\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/83a97577j00snuh780019d000u000cmm.jpg\" alt=\"83a97577j00snuh780019d000u000cmm\" width=\"1080\" height=\"454\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-24242\" title=\"8fa53952j00snuh780022d000t800ism\" src=\"https:\/\/www.1ai.net\/wp-content\/uploads\/2024\/12\/8fa53952j00snuh780022d000t800ism.jpg\" alt=\"8fa53952j00snuh780022d000t800ism\" width=\"1052\" height=\"676\" \/><\/p>\n<p>Overall, the official Flux kits are outstanding and must not be missed if you are an AIGC enthusiast!<\/p>\n<p>The article covers the URL:<\/p>\n<p>Official Flux Tools website:<br \/>\nhttps:\/\/blackforestlabs.ai\/#get-flux<\/p>\n<p>ComfyUI code page:<br \/>\nhttps:\/\/github.com\/comfyanonymous\/ComfyUI<\/p>","protected":false},"excerpt":{"rendered":"<p>The already strong Flux has announced a batch of official tools covering common drawing features, making it comparable to (or even surpassing) closed source tools. First you need to have the latest version of Flux installed in ComfyUI, see here: FLUX Testing and Installation Below is an itemized list of methods used in ComfyUI and the download paths for the models\/workflows. I. Flux repainting (Fill Inpainting) You need to download the model flux1-fill-dev.safetensors: https:\/\/huggingface.co\/black-forest-labs\/FLUX.1-Fill-dev\/tree\/main will download the<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[149,144],"tags":[491,2328,1989,3853],"collection":[],"class_list":{"0":"post-24210","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"hentry","6":"category-jiaocheng","7":"category-baike","8":"tag-ai","10":"tag-comfyui","11":"tag-flux"},"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/24210","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=24210"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/24210\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=24210"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=24210"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=24210"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=24210"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}