ComfyUI-Inspire-Pack

This repository offers various extension nodes for ComfyUI. Nodes here have different characteristics compared to those in the ComfyUI Impact Pack. The Impact Pack has become too large now...

Notice:

• V1.18: To use the 'OSS' Scheduler, please update to ComfyUI version 0.3.28 or later (April 13th or newer) and Impact Pack version V8.11 or higher.
• V1.9.1 To avoid confusion with the NOISE type in core, the type name has been changed to NOISE_IMAGE.
• V0.73 The Variation Seed feature is added to Regional Prompt nodes, and it is only compatible with versions Impact Pack V5.10 and above.
• V0.69 incompatible with the outdated ComfyUI IPAdapter Plus. (A version dated March 24th or later is required.)
• V0.64 add sigma_factor to RegionalPrompt... nodes required Impact Pack V4.76 or later.
• V0.62 support faceid in Regional IPAdapter
• V0.48 optimized wildcard node. This update requires Impact Pack V4.39.2 or later.
• V0.13.2 isn't compatible with old ControlNet Auxiliary Preprocessor. If you will use MediaPipeFaceMeshDetectorProvider update to latest version(Sep. 17th).
• WARN: If you use version 0.12 to 0.12.2 without a GlobalSeed node, your workflow's seed may have been erased. Please update immediately.

Nodes

Lora Block Weight - This is a node that provides functionality related to Lora block weight.

• This provides similar functionality to sd-webui-lora-block-weight
• LoRA Loader (Block Weight): When loading Lora, the block weight vector is applied.
  • In the block vector, you can use numbers, R, A, a, B, and b.
  • R is determined sequentially based on a random seed, while A and B represent the values of the A and B parameters, respectively. a and b are half of the values of A and B, respectively.
• XY Input: LoRA Block Weight: This is a node in the Efficiency Nodes' XY Plot that allows you to use Lora block weight.
  • You must ensure that X and Y connections are made, and dependencies should be connected to the XY Plot.
  • Note: To use this feature, update Efficient Nodes to a version released after September 3rd.
• Make LoRA Block Weight: Instead of directly applying the LoRA Block Weight to the MODEL, it is generated in a separate LBW_MODEL form
• Apply LoRA Block Weight: Apply LBW_MODEL to MODEL and CLIP
• Save LoRA Block Weight: Save LBW_MODEL as a .lbw.safetensors file
• Load LoRA Block Weight: Load LBW_MODEL from .lbw.safetensors file

SEGS Supports nodes - This is a node that supports ApplyControlNet (SEGS) from the Impact Pack.

• OpenPose Preprocessor Provider (SEGS): OpenPose preprocessor is applied for the purpose of using OpenPose ControlNet in SEGS.
  • You need to install ControlNet Auxiliary Preprocessors to use this.
• Canny Preprocessor Provider (SEGS): Canny preprocessor is applied for the purpose of using Canny ControlNet in SEGS.
• DW Preprocessor Provider (SEGS), MiDaS Depth Map Preprocessor Provider (SEGS), LeReS Depth Map Preprocessor Provider (SEGS), MediaPipe FaceMesh Preprocessor Provider (SEGS), HED Preprocessor Provider (SEGS), Fake Scribble Preprocessor (SEGS), AnimeLineArt Preprocessor Provider (SEGS), Manga2Anime LineArt Preprocessor Provider (SEGS), LineArt Preprocessor Provider (SEGS), Color Preprocessor Provider (SEGS), Inpaint Preprocessor Provider (SEGS), Tile Preprocessor Provider (SEGS), MeshGraphormer Depth Map Preprocessor Provider (SEGS)
• MediaPipeFaceMeshDetectorProvider: This node provides BBOX_DETECTOR and SEGM_DETECTOR that can be used in Impact Pack's Detector using the MediaPipe-FaceMesh Preprocessor of ControlNet Auxiliary Preprocessors.

A1111 Compatibility support - These nodes assists in replicating the creation of A1111 in ComfyUI exactly.

• KSampler (Inspire): ComfyUI uses the CPU for generating random noise, while A1111 uses the GPU. One of the three factors that significantly impact reproducing A1111's results in ComfyUI can be addressed using KSampler (Inspire).
  • Other point #1 : Please make sure you haven't forgotten to include 'embedding:' in the embedding used in the prompt, like 'embedding:easynegative.'
  • Other point #2 : ComfyUI and A1111 have different interpretations of weighting. To align them, you need to use BlenderNeko/Advanced CLIP Text Encode.
• KSamplerAdvanced (Inspire): Inspire Pack version of KSampler (Advanced).
• RandomNoise (inspire): Inspire Pack version of RandomNoise.
• Common Parameters
  • batch_seed_mode determines how seeds are applied to batch latents:
    • comfy: This method applies the noise to batch latents all at once. This is advantageous to prevent duplicate images from being generated due to seed duplication when creating images.
    • incremental: Similar to the A1111 case, this method incrementally increases the seed and applies noise sequentially for each batch. This approach is beneficial for straightforward reproduction using only the seed.
    • variation_strength: In each batch, the variation strength starts from the set variation_strength and increases by xxx.
  • variation_seed and variation_strength - Initial noise generated by the seed is transformed to the shape of variation_seed by variation_strength. If variation_strength is 0, it only relies on the influence of the seed, and if variation_strength is 1.0, it is solely influenced by variation_seed.
    • These parameters are used when you want to maintain the composition of an image generated by the seed but wish to introduce slight changes.

Sampler nodes

• KSampler Progress (Inspire) - In KSampler, the sampling process generates latent batches. By using Video Combine node from ComfyUI-VideoHelperSuite, you can create a video from the progress.
• Scheduled CFGGuider (Inspire) - This is a CFGGuider that adjusts the schedule from from_cfg to to_cfg using linear, log, and exp methods.
• Scheduled PerpNeg CFGGuider (Inspire) - This is a PerpNeg CFGGuider that adjusts the schedule from from_cfg to to_cfg using linear, log, and exp methods.

Prompt Support - These are nodes for supporting prompt processing.

• Load Prompts From Dir (Inspire): It sequentially reads prompts files from the specified directory. The output it returns is ZIPPED_PROMPT.

  • Specify the directories located under ComfyUI-Inspire-Pack/prompts/

  • One prompts file can have multiple prompts separated by ---.

  • e.g. prompts/example

  • NOTE: This node provides advanced option via Show advanced

    • load_cap, start_index

  • Load Prompts From File (Inspire): It sequentially reads prompts from the specified file. The output it returns is ZIPPED_PROMPT.

  • Specify the file located under ComfyUI-Inspire-Pack/prompts/

  • e.g. prompts/example/prompt2.txt

  • NOTE: This node provides advanced option via Show advanced

    • load_cap, start_index

• Load Single Prompt From File (Inspire): Loads a single prompt from a file containing multiple prompts by using an index.

• The prompts file directory can be specified as inspire_prompts in extra_model_paths.yaml

• Unzip Prompt (Inspire): Separate ZIPPED_PROMPT into positive, negative, and name components.

  • positive and negative represent text prompts, while name represents the name of the prompt. When loaded from a file using Load Prompts From File (Inspire), the name corresponds to the file name.

• Zip Prompt (Inspire): Create ZIPPED_PROMPT from positive, negative, and name_opt.

  • If name_opt is omitted, it will be considered as an empty name.

• Prompt Extractor (Inspire): This node reads prompt information from the image's metadata. Since it retrieves all the text, you need to directly specify the prompts to be used for positive and negative as indicated in the info.

• Global Seed (Inspire): This is a node that controls the global seed without a separate connection line. It only controls when the widget's name is 'seed' or 'noise_seed'. Additionally, if 'control_before_generate' is checked, it controls the seed before executing the prompt.

  • Seeds that have been converted into inputs are excluded from the target. If you want to control the seed separately, convert it into an input and control it separately.

• Global Sampler (Inspire): This node is similar to GlobalSeed and can simultaneously set the sampler_name and scheduler for all nodes in the workflow.

  • It applies only to nodes that have both sampler_name and scheduler, and it won't be effective if GlobalSampler is muted.
  • If some of the sampler_name and scheduler have been converted to input and connected to Primitive node, it will not apply only to the converted widget. The widget that has not been converted to input will still be affected.

• Bind [ImageList, PromptList] (Inspire): Bind Image list and zipped prompt list to export image, positive, negative, and prompt_label in a list format. If there are more prompts than images, the excess prompts are ignored, and if there are not enough, the remainder is filled with default input based on the images.

• Wildcard Encode (Inspire): The combination node of ImpactWildcardEncode and BlenderNeko's CLIP Text Encode (Advanced).

  • To use this node, you need both the Impact Pack and the [Advanced CLIP Text Encode]((https://github.com/BlenderNeko/Com