PocketFlow

<div align="center"> <img src="https://github.com/The-Pocket/.github/raw/main/assets/title.png" alt="Pocket Flow – 100-line minimalist LLM framework" width="600"/> </div> <!-- For translation, replace English with [English](https://github.com/The-Pocket/PocketFlow/blob/main/README.md), and remove the link for the target language. -->

English | 中文 | Español | 日本語 | Deutsch | Русский | Português | Français | 한국어

<a href="https://discord.gg/hUHHE9Sa6T"> <img src="https://img.shields.io/discord/1346833819172601907?logo=discord&style=flat"> </a>

Pocket Flow is a 100-line minimalist LLM framework

• Lightweight: Just 100 lines. Zero bloat, zero dependencies, zero vendor lock-in.

• Expressive: Everything you love—(Multi-)Agents, Workflow, RAG, and more.

• Agentic Coding: Let AI Agents (e.g., Cursor AI) build Agents—10x productivity boost!

Get started with Pocket Flow:

• To install, pip install pocketflowor just copy the source code (only 100 lines).
• To learn more, check out the video tutorial and documentation
• 🎉 Join our Discord to connect with other developers building with Pocket Flow!
• 🎉 Pocket Flow now has Typescript, Java, C++, Go, Rust and PHP versions!

Why Pocket Flow?

Current LLM frameworks are bloated... You only need 100 lines for LLM Framework!

<div align="center"> <img src="https://github.com/The-Pocket/.github/raw/main/assets/meme.jpg" width="400"/>

| | Abstraction | App-Specific Wrappers | Vendor-Specific Wrappers | Lines | Size | |----------------|:-----------------------------: |:-----------------------------------------------------------:|:------------------------------------------------------------:|:---------------:|:----------------------------:| | LangChain | Agent, Chain | Many <br>^{_{(e.g., QA, Summarization)}} | Many <br>^{_{(e.g., OpenAI, Pinecone, etc.)}} | 405K | +166MB | | CrewAI | Agent, Chain | Many <br>^{_{(e.g., FileReadTool, SerperDevTool)}} | Many <br>^{_{(e.g., OpenAI, Anthropic, Pinecone, etc.)}} | 18K | +173MB | | SmolAgent | Agent | Some <br>^{_{(e.g., CodeAgent, VisitWebTool)}} | Some <br>^{_{(e.g., DuckDuckGo, Hugging Face, etc.)}} | 8K | +198MB | | LangGraph | Agent, Graph | Some <br>^{_{(e.g., Semantic Search)}} | Some <br>^{_{(e.g., PostgresStore, SqliteSaver, etc.)}} | 37K | +51MB | | AutoGen | Agent | Some <br>^{_{(e.g., Tool Agent, Chat Agent)}} | Many ^{_{[Optional]<br> (e.g., OpenAI, Pinecone, etc.)}} | 7K <br>^_(core-only) | +26MB <br>^_(core-only) | | PocketFlow | Graph | None | None | 100 | +56KB |

</div>

How does Pocket Flow work?

The 100 lines capture the core abstraction of LLM frameworks: Graph! <br>

<div align="center"> <img src="https://github.com/The-Pocket/.github/raw/main/assets/abstraction.png" width="900"/> </div> <br>

From there, it's easy to implement popular design patterns like (Multi-)Agents, Workflow, RAG, etc. <br>

<div align="center"> <img src="https://github.com/The-Pocket/.github/raw/main/assets/design.png" width="900"/> </div> <br> ✨ Below are basic tutorials: <div align="center">

| Name | Difficulty | Description |
| :-------------: | :-------------: | :--------------------- |
| Chat | ☆☆☆ ^Dummy | A basic chat bot with conversation history | | Structured Output | ☆☆☆ ^Dummy | Extracting structured data from resumes by prompting | | Workflow | ☆☆☆ ^Dummy | A writing workflow that outlines, writes content, and applies styling | | Agent | ☆☆☆ ^Dummy | A research agent that can search the web and answer questions | | RAG | ☆☆☆ ^Dummy | A simple Retrieval-augmented Generation process | | Batch | ☆☆☆ ^Dummy | A batch processor that translates markdown into multiple languages | | Streaming | ☆☆☆ ^Dummy | A real-time LLM streaming demo with user interrupt capability | | Chat Guardrail | ☆☆☆ ^Dummy | A travel advisor chatbot that only processes travel-related queries | | Majority Vote | ☆☆☆ ^Dummy | Improve reasoning accuracy by aggregating multiple solution attempts | | Map-Reduce | ☆☆☆ ^Dummy | Batch resume qualification using map-reduce pattern | | CLI HITL | ☆☆☆ ^Dummy | A command-line joke generator with human-in-the-loop feedback | | Multi-Agent | ★☆☆ ^Beginner | A Taboo word game for async communication between 2 agents | | Supervisor | ★☆☆ ^Beginner | Research agent is getting unreliable... Let's build a supervision process| | Parallel | ★☆☆ ^Beginner | A parallel execution demo that shows 3x speedup | | Parallel Flow | ★☆☆ ^Beginner | A parallel image processing showing 8x speedup | | Thinking | ★☆☆ ^Beginner | Solve complex reasoning problems through Chain-of-Thought | | Memory | ★☆☆ ^Beginner | A chat bot with short-term and long-term memory | | Text2SQL | ★☆☆ ^Beginner | Convert natural language to SQL queries with an auto-debug loop | | Code Generator | ★☆☆ ^Beginner | Generate test cases, implement solutions, and iteratively improve code | | MCP | ★☆☆ ^Beginner