ComfyMind: Toward General-Purpose Generation via Tree-Based Planning and
  Reactive Feedback
With the rapid advancement of generative models, general-purpose generation
has gained increasing attention as a promising approach to unify diverse tasks
across modalities within a single system. Despite this progress, existing
open-source frameworks often remain fragile and struggle to support complex
real-world applications due to the lack of structured workflow planning and
execution-level feedback. To address these limitations, we present ComfyMind, a
collaborative AI system designed to enable robust and scalable general-purpose
generation, built on the ComfyUI platform. ComfyMind introduces two core
innovations: Semantic Workflow Interface (SWI) that abstracts low-level node
graphs into callable functional modules described in natural language, enabling
high-level composition and reducing structural errors; Search Tree Planning
mechanism with localized feedback execution, which models generation as a
hierarchical decision process and allows adaptive correction at each stage.
Together, these components improve the stability and flexibility of complex
generative workflows. We evaluate ComfyMind on three public benchmarks:
ComfyBench, GenEval, and Reason-Edit, which span generation, editing, and
reasoning tasks. Results show that ComfyMind consistently outperforms existing
open-source baselines and achieves performance comparable to GPT-Image-1.
ComfyMind paves a promising path for the development of open-source
general-purpose generative AI systems. Project page:
https://github.com/LitaoGuo/ComfyMind
6836ab69f5ad887c90517254
Litao Guo
admin_assigned
2025-05-28T12:43:50.189Z
6476025bfd4c874fa84b6a28
/avatars/b5ca2039731fec9d8e95d6d15b7719f5.svg
litao Guo
user
Riversideli
6836ab69f5ad887c90517255
Xinli Xu
admin_assigned
2025-05-28T12:43:41.201Z
64b4ab62eec33e27dcd733b5
/avatars/0a9bf220c9a5efe7279f9b287b087d36.svg
Xinli XU
user
Xxlbigbrother
6836ab69f5ad887c90517256
Luozhou Wang
admin_assigned
2025-05-28T12:43:35.119Z
6340333a733f9eef46913dc8
https://cdn-avatars.huggingface.co/v1/production/uploads/6340333a733f9eef46913dc8/BwhKgkqbuuxWsJv2s_JEH.png
luozhou wang
user
wileewang
6836ab69f5ad887c90517257
Jiantao Lin
admin_assigned
2025-05-28T12:43:28.714Z
6332e2689bf698ce68a22e8c
/avatars/c1922acfda2e6d2fe7b03194a404eb10.svg
JIANTAO LIN
user
LTT
6836ab69f5ad887c90517258
Jinsong Zhou
6836ab69f5ad887c90517259
Zixin Zhang
6836ab69f5ad887c9051725a
Bolan Su
6836ab69f5ad887c9051725b
Ying-Cong Chen
admin_assigned
2025-05-28T12:42:54.177Z
655cba1d87b67834000590e8
/avatars/3bd43b7c9351f65b8f38f4c8237a0146.svg
Yingcong Chen
user
yingcongchen
ComfyMind: Toward General-Purpose Generation via Tree-Based Planning and
  Reactive Feedback
With the rapid advancement of generative models, general-purpose generation
has gained increasing attention as a promising approach to unify diverse tasks
across modalities within a single system. Despite this progress, existing
open-source frameworks often remain fragile and struggle to support complex
real-world applications due to the lack of structured workflow planning and
execution-level feedback. To address these limitations, we present ComfyMind, a
collaborative AI system designed to enable robust and scalable general-purpose
generation, built on the ComfyUI platform. ComfyMind introduces two core
innovations: Semantic Workflow Interface (SWI) that abstracts low-level node
graphs into callable functional modules described in natural language, enabling
high-level composition and reducing structural errors; Search Tree Planning
mechanism with localized feedback execution, which models generation as a
hierarchical decision process and allows adaptive correction at each stage.
Together, these components improve the stability and flexibility of complex
generative workflows. We evaluate ComfyMind on three public benchmarks:
ComfyBench, GenEval, and Reason-Edit, which span generation, editing, and
reasoning tasks. Results show that ComfyMind consistently outperforms existing
open-source baselines and achieves performance comparable to GPT-Image-1.
ComfyMind paves a promising path for the development of open-source
general-purpose generative AI systems. Project page:
https://github.com/LitaoGuo/ComfyMind
ComfyMind, a collaborative AI system built on ComfyUI, enhances generative workflows with a Semantic Workflow Interface and Search Tree Planning mechanism, outperforming existing open-source systems across generation, editing, and reasoning tasks.
Semantic Workflow Interface Search Tree Planning mechanism generative models general-purpose generation generative workflows