{"id":22065,"date":"2024-10-27T09:09:40","date_gmt":"2024-10-27T01:09:40","guid":{"rendered":"https:\/\/www.1ai.net\/?p=22065"},"modified":"2024-10-26T19:13:45","modified_gmt":"2024-10-26T11:13:45","slug":"comfyui%e6%95%99%e7%a8%8b%ef%bc%8cflux%e6%a8%a1%e5%9e%8b%e5%ae%89%e8%a3%85%e9%83%a8%e7%bd%b2%e5%8f%8a%e4%bd%bf%e7%94%a8%e6%95%99%e7%a8%8b","status":"publish","type":"post","link":"https:\/\/www.1ai.net\/en\/22065.html","title":{"rendered":"Comfyui Tutorials, Flux Model Installation Deployment and Usage Tutorials"},"content":{"rendered":"

Midjourney and Stable Diffusion are both popular AI image generation tools that generate high-quality images based on text descriptions. Both are text-to-image generation models based on deep learning techniques, but they are each based on different large models.<\/p>\n

But a recently introduced model that is more powerful than the first two, generates more realistic images, and is more in tune with the real world in terms of detail, is theFLUX<\/a>!<\/p>\n

What is Flux?<\/strong><\/p>\n

Flux AI is one of the newest text-generated image models from Black Forest Labs, a team of original members who left Stable Diffusion to create a new big model for AI mapping.Flux AI models are known for their superior visual quality, precise cue word following, diverse styles, and complex scene generation capabilities. Flux AI models are known for their superior visual quality, precise cue word adherence, diverse styles and ability to generate complex scenes. It comes in three versions: FLUX.1 [pro], FLUX.1 [dev] and FLUX.1 [schnell], which are designed for different scenarios and needs.<\/p>\n

FLUX.1 Pro<\/strong><\/p>\n

is a closed-source model designed for commercial use, offering state-of-the-art image generation performance.<\/p>\n

FLUX.1 Dev<\/strong><\/p>\n

is an open source bootstrap distillation model for non-commercial applications.<\/p>\n

FLUX.1 Schnell<\/strong><\/p>\n

It is a fast version designed for local development and personal use.<\/p>\n

Flux AI models utilize an innovative hybrid architecture that combines multimodal processing capabilities with the Transformer technology for parallel diffusion mechanisms and scale to up to 12 billion parameters. These models employ flow matching techniques in the methodology used to train the generated models, which is not only versatile but also conceptually simple and particularly suitable for a wide range of scenarios, including diffusion processes.<\/p>\n

Official website: https:\/\/blackforestlabs.ai\/<\/p>\n

\"05a023baj00slymxu000id000u000exm\"<\/p>\n

Here is a comparison of the Flux, Midjourney and Stable Diffusion models:<\/p>\n

image quality<\/strong><\/p>\n

Flux: does not require the involvement of other plug-ins, and by itself excels at generating high-resolution, detail-rich images, especially in complex scenes and human anatomy.<\/p>\n

Midjourney: Known for its artistic style and high quality output, Midjourney has a particular strength in artistry and stylistic diversity.<\/p>\n

Stable Diffusion: Generates realistic images for projects that require realistic output.<\/p>\n

Speed and efficiency<\/strong><\/p>\n

Flux: Provides fast image generation, especially for schnell variants, for processes that require rapid prototyping and iterative design. In most cases there is no need to download additional style models to output images in a variety of styles.<\/p>\n

Midjourney: no explicit mention of speed, but often business models may run on cloud servers and there may be a waiting list.<\/p>\n

Stable Diffusion: Slower generation, but provides more control in the image optimization process.<\/p>\n

Handling complex scenarios<\/strong><\/p>\n

Flux: excels in handling complex compositions, thanks to its advanced architecture. Especially for text, flux can output images with text, as long as the cue word is accurate enough to directly output the design of poster-level images.<\/p>\n

Midjourney: Capable of handling complex scenes, but in some cases more iterations may be needed to achieve the desired result.<\/p>\n

Stable Diffusion: There may be some limitations in handling complex scenes.<\/p>\n

Human Anatomy Rendering<\/strong><\/p>\n

Flux: Excellent at rendering human anatomy, especially hand details, which are more fully reproduced.<\/p>\n

Midjourney: Not specifically mentioned, but usually produces artistic images of people that are difficult to specify an accurate depiction of.<\/p>\n

Stable Diffusion: May have difficulty accurately depicting human features. Requires additional plug-ins or post-processing to barely correct or largely achieve the effect.<\/p>\n

Flexibility and integration<\/strong><\/p>\n

Flux: offers several variants for different usage scenarios and needs, including open source and specialized models.<\/p>\n

Midjourney: Being a commercial tool, there may be some limitations in terms of customization.<\/p>\n

Stable Diffusion: open-source model, community-driven, offering a wealth of customization and integration options.<\/p>\n

Open Source and Business Models<\/strong><\/p>\n

Flux: Provides open source models to encourage community involvement and innovation.<\/p>\n

Midjourney: for commercial models, providing professional image generation services.<\/p>\n

Stable Diffusion: open source model with active community support and continuous improvement.<\/p>\n

application-specific<\/strong><\/p>\n

FluxI: Ideal for projects that require high detail and accurate representation of complex scenes.<\/p>\n

Midjourney: Suitable for artistic creation and design, especially in areas requiring artistic style and creative expression.<\/p>\n

Stable Diffusion: For realistic output where control of the final image is critical.<\/p>\n

To summarize flux:<\/strong><\/p>\n

(1) More detail and better effect on the screen<\/p>\n

(2) Image text support is more prominent and complete, and the output is more accurate.<\/p>\n

(3) The character's hands are complete and realistic, and basically impossible to get wrong<\/p>\n

(4) The model contains many styles, supports a variety of styles, and does not rely on additional models to assist in supplementation.<\/p>\n

(5) Negative prompts can be ignored and positive prompts alone can be accurately output.<\/p>\n

Through the above comparison, flux is stronger because its training parameters are larger than the first two, stable diffusion 3 is the highest 8B training parameters, about 8 billion, while the beginning of flux 1 is 12B training parameters, a full 12 billion, several times more! The size of a single model is 23G in size, so you can imagine that Flux is powerful is very powerful.<\/p>\n

Difference between Flux models: There are three main models as follows<\/strong><\/p>\n

\"636c9cc3j00slymxu0012d000lp009qm\"<\/p>\n

\"abf138acj00slymxu0016d000ld009lm\"<\/p>\n

\"0f905702j00slymxu000vd000ls009nm\"<\/p>\n

\"b2ad7944j00slymxu0016d000pv00a3m\"<\/p>\n

*Note: If using GGUF and NF4, additional plug-ins need to be installed:<\/p>\n

GGUF node: https:\/\/github.com\/city96\/ComfyUI<\/a>-GGUF<\/p>\n

\"da4395c8j00slymxu0025d000u000dtm\"<\/p>\n

NF4 node: https:\/\/github.com\/comfyanonymous\/ComfyUI_bitsandbytes_NF4<\/p>\n

\"4745b26ej00slymxu001ad000u000fdm\"<\/p>\n

How to deploy and install flux?<\/strong><\/p>\n

1. Make sure your comfyui is the latest version. (This article uses Mr. Akiba's launcher)<\/p>\n

Click on the version of the launcher, see the kernel and extensions at the top, and click on the one-click update button in the upper right corner to update to the latest. Since flux was released before August, make sure your comfyui is updated to the latest version after August 1st.<\/p>\n

\"88c3cf3bj00slymxu0029d000u000irm\"<\/p>\n

2. Go to the Hamburg homepage on the official website https:\/\/huggingface.com\/black-forest-labs\/flux.1-dev<\/p>\n

\"a36cac9fj00slymxu001dd000u000h8m\"<\/p>\n

Download ae.safetensors (i.e. vae), flux1-dev.safetensors (i.e. unet)<\/p>\n

\"40c0dc4fj00slymxu000jd000ow008mm\"<\/p>\n

3. Download the clip file, go to comfyui's github homepage and find flux: https:\/\/github.com\/comfyanonymous\/ComfyUI_examples\/tree\/master\/flux<\/p>\n

\"7a0f086dj00slymxu001hd000u000evm\"<\/p>\n

Enter from here and see the files clip_l.safetensors, t5xxl_fp16.safetensors, t5xxl_fp8_e4m3fn.safetensors download.<\/p>\n

\"3b56ea42j00slymxu001cd000u000cym\"<\/p>\n

\"cd93bcc4j00slymxu000pd000u000a2m\"<\/p>\n

4. Placement of documents:<\/p>\n

\"3ebd0994j00slymxu0016d000o50082m\"<\/p>\n

5. Other resources, including controlnet and lora, are available on the xlab-ai homepage at https:\/\/huggingface.co\/XLabs-AI.<\/p>\n

\"eb72866dj00slymxu001fd000u000kmm\"<\/p>\n

\"9de0d889j00slymxu000wd000su0060m\"<\/p>\n

*If you want to use the controlnet of the flux model or the iPadapter of the flux model, you need to download and install the XLabs-Ai plugin in comfyui. Open the node manager in comfyui manager, then search for the plugin and install it, then restart comfyui.<\/p>\n

\"340e0dafj00slymxu000ed000u00051m\"<\/p>\n

6. System memory settings<\/p>\n

Note that the model used to run takes up more memory, it is recommended to turn on the system's virtual memory: System Settings-Advanced-Performance Settings-Advanced-Virtual Memory-Check the box for Automatic Management.<\/p>\n

\"81c95426j00slymxu0018d000u000e8m\"<\/p>\n

How quickly can I use it?<\/strong><\/p>\n

The official workflow of the related use is given, just drag and drop the official github case picture to comfyui. It's worthwhile to see the pictures named to correspond to the usage.<\/p>\n

\"29c1b6d7j00slymxu000kd000fe004sm\"<\/p>\n

Official Case Workflow<\/p>\n

If you use the flux_dev_example workflow as an example, drag and drop the image into the comfyui<\/p>\n

\"62249964j00slymxu0025d000tt00kfm\"<\/p>\n

Get the following workflow:<\/p>\n

\"431525b6j00slymxu0013d000u000fvm\"<\/p>\n

Dragging in flux_schnell_example gives the following:<\/p>\n

\"5b523e17j00slymxu001wd000tw00lum\"<\/p>\n

Divide the structure:<\/p>\n

\"8a40c41dj00slymxu001rd000u000ibm\"<\/p>\n

The flux_schnell_example is the simplest, 4 steps to a graph.<\/p>\n

Starting simple, try using the following prompt words inside the flux_schnell_example workflow:<\/p>\n

A girl in school uniform, holding chalk and writing happy words on a blackboard, real photography, school classroom, half-length composition, cinematic lighting, rich details, Japanese low saturation<\/p>\n

A girl wearing a school uniform, holdingchalk to write happy words on the blackboard, real photography, schoolclassroom, half body composition, movie Lighting, rich details, Japanese lowsaturation<\/p>\n

Getting out of the picture:<\/p>\n

\"0ca8e28fj00slymxu001yd000sg00sgm\"<\/p>\n

(1) Accurate experience of words on the blackboard<\/p>\n

(2) Figures with normal hand structure<\/p>\n

(3) The texture effect conforms to the true style of the cue word<\/p>\n

(4) High efficiency in producing pictures, no sense of waiting, and matching the cue words.<\/p>\n

Then we inserted a lora loader between the models and downloaded a lora model of Black Myth Goku from the internet and loaded it in (lora from liblib.art platform by AI Game Classroom Bear)<\/p>\n

\"5d183a44j00slymxu0011d000s200asm\"<\/p>\n

The model starts with fp8 schnell, using the descriptors provided by the author of the lora, and then launches the queue, seeing that the author's computer has 32G of RAM and can go on 85% to 98%, and the graphics card is an NVIDIA 2080.<\/p>\n

\"36c24938j00slymxu0013d000mp00aqm\"<\/p>\n

Enter the prompt word:<\/p>\n

Goku, in the drawing room, painting, sketching, brushes, writing, working hard, (large text \"doesn't want to work\")<\/p>\n

Wukong, in the painting studio, paiting, skewing, using a paperbrush, working, working hard<\/p>\n

Get the image:<\/p>\n

\"e003f21aj00slymxu0036d000sg00sgm\"<\/p>\n

Simple description, no need for negative cue words, great character hands, text, etc. after adding lora.<\/p>\n

Overall flux in addition to the big models need strong configuration of the computer, smaller models in fact, the effect is not much wrong, for ordinary media applications, program ideas, etc. enough to use.<\/p>\n

In addition to simply adding lora, etc., if you are familiar with comfyui, adding nodes that zoom in to increase detail, or even using advanced applications such as controlnet can produce more and better results.<\/p>\n

 <\/p>\n

The models and workflows mentioned in this paper select addresses:<\/p>\n

Link: https:\/\/pan.baidu.com\/s\/1LSO-JUa26fdL7_dpT5jnRQ
\nExtract code: PKV7<\/p>","protected":false},"excerpt":{"rendered":"

Midjourney and Stable Diffusion are both popular AI image generation tools that generate high-quality images based on text descriptions. Both are text-to-image generation models based on deep learning techniques, but they are each based on a different larger model. But a model that has recently been introduced that is more powerful than the first two, generates more realistic images, and is more in tune with the real world in terms of detail is FLUX! What is Flux? Flux AI is a newest text-toimage generation model introduced by Black Forest Labs, a team that was created by the original team that left from Stable Diffusion to create a new big model for AI mapping.The Flux AI model is known for its<\/p>","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[149,144],"tags":[1989,4749,3853],"collection":[],"class_list":{"0":"post-22065","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"hentry","6":"category-jiaocheng","7":"category-baike","8":"tag-comfyui","10":"tag-flux"},"acf":[],"_links":{"self":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/22065","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/comments?post=22065"}],"version-history":[{"count":0,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/posts\/22065\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/media?parent=22065"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/categories?post=22065"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/tags?post=22065"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.1ai.net\/en\/wp-json\/wp\/v2\/collection?post=22065"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}