<h1 align="center"> <b>UFO³</b> <img src="assets/logo3.png" alt="UFO logo" width="70" style="vertical-align: -30px;"> : Weaving the Digital Agent Galaxy </h1> <p align="center"> <em>From Single Device Agent to Multi-Device Galaxy</em> </p> <p align="center"> <strong>📖 Language / 语言:</strong> <a href="README.md"><strong>English</strong></a> | <a href="README_ZH.md">中文</a> </p> <div align="center"> <a href="https://trendshift.io/repositories/7874" target="_blank"><img src="https://trendshift.io/api/badge/repositories/7874" alt="microsoft%2FUFO | Trendshift" style="width: 250px; height: 55px;" width="250" height="55"/></a> <br/>

</div> <p align="center"> <strong>📚 Quick Links:</strong> <a href="./galaxy/README.md">🌌 UFO³ README</a> • <a href="./ufo/README.md">🖥️ UFO² README</a> • <a href="https://microsoft.github.io/UFO/">📖 Full Documentation</a> </p>

🎯 Choose Your Path

<img src="assets/logo3.png" alt="Galaxy logo" width="40" style="vertical-align: -10px;"> UFO³ Multi-Device Agent Galaxy

<sub>✨ NEW & RECOMMENDED</sub>

Perfect for:

🔗 Cross-device collaboration workflows
📊 Complex multi-step automation
🎯 DAG-based task orchestration
🌍 Heterogeneous platform integration

Key Features:

Constellation: Task decomposition into executable DAGs
Dynamic DAG editing for adaptive workflow evolution
Asynchronous execution with parallel task coordination
Unified AIP protocol for secure agent communication

📖 Galaxy Documentation →
📖 Galaxy Quick Start → ⭐ Online Docs

</td> <td width="50%" valign="top">

<img src="assets/ufo_blue.png" alt="UFO² logo" width="30" style="vertical-align: -5px;"> UFO² Desktop AgentOS

<sub>STABLE & BATTLE-TESTED</sub>

Perfect for:

💻 Single Windows automation
⚡ Quick task execution
🎓 Learning agent basics
🛠️ Simple workflows

Key Features:

Deep Windows OS integration
Hybrid GUI + API actions
Proven reliability
Easy setup
Can serve as Galaxy device agent

📖 UFO² Documentation →

</td> </tr> </table>

🎬 See UFO³ Galaxy in Action

Watch how UFO³ Galaxy orchestrates complex workflows across multiple devices:

<div align="center"> <a href="https://www.youtube.com/watch?v=NGrVWGcJL8o"> <img src="assets/poster_with_play.png" alt="UFO³ Galaxy Demo" width="90%"> </a> <p><em>🎥 Click to watch: Cross-device task orchestration with UFO³ Galaxy</em></p> </div>

🌟 What's New in UFO³?

Evolution Timeline

%%{init: {'theme':'base', 'themeVariables': { 'primaryColor':'#E8F4F8','primaryTextColor':'#1A1A1A','primaryBorderColor':'#7CB9E8','lineColor':'#A8D5E2','secondaryColor':'#B8E6F0','tertiaryColor':'#D4F1F4','fontSize':'16px','fontFamily':'Segoe UI, Arial, sans-serif'}}}%%
graph LR
    A["<b>🎈 UFO</b><br/><span style='font-size:14px'>February 2024</span><br/><span style='font-size:13px; color:#666'><i>GUI Agent for Windows</i></span>"] 
    B["<b>🖥️ UFO²</b><br/><span style='font-size:14px'>April 2025</span><br/><span style='font-size:13px; color:#666'><i>Desktop AgentOS</i></span>"]
    C["<b>🌌 UFO³ Galaxy</b><br/><span style='font-size:14px'>November 2025</span><br/><span style='font-size:13px; color:#666'><i>Multi-Device Orchestration</i></span>"]
    
    A -->|Evolve| B
    B -->|Scale| C
    
    style A fill:#E8F4F8,stroke:#7CB9E8,stroke-width:2.5px,color:#1A1A1A,rx:15,ry:15
    style B fill:#C5E8F5,stroke:#5BA8D0,stroke-width:2.5px,color:#1A1A1A,rx:15,ry:15
    style C fill:#A4DBF0,stroke:#3D96BE,stroke-width:2.5px,color:#1A1A1A,rx:15,ry:15

🚀 UFO³ = Galaxy (Multi-Device Orchestration) + UFO² (Device Agent)

UFO³ introduces Galaxy, a revolutionary multi-device orchestration framework that coordinates intelligent agents across heterogeneous platforms. Built on five tightly integrated design principles:

🌟 Declarative Decomposition into Dynamic DAG - Requests decomposed into structured DAG with TaskStars and dependencies for automated scheduling and runtime rewriting
🔄 Continuous Result-Driven Graph Evolution - Living constellation that adapts to execution feedback through controlled rewrites and dynamic adjustments
⚡ Heterogeneous, Asynchronous & Safe Orchestration - Capability-based device matching with async execution, safe locking, and formally verified correctness
🔌 Unified Agent Interaction Protocol (AIP) - WebSocket-based secure coordination layer with fault tolerance and automatic reconnection
🛠️ Template-Driven MCP-Empowered Device Agents - Lightweight toolkit for rapid agent development with MCP integration for tool augmentation

| Aspect | UFO² | UFO³ Galaxy | |--------|------|-------------| | Architecture | Single Windows Agent | Multi-Device Orchestration | | Task Model | Sequential ReAct Loop | DAG-based Constellation Workflows | | Scope | Single device, multi-app | Multi-device, cross-platform | | Coordination | HostAgent + AppAgents | ConstellationAgent + TaskOrchestrator | | Device Support | Windows Desktop | Windows, Linux, Android (more coming) | | Task Planning | Application-level | Device-level with dependencies | | Execution | Sequential | Parallel DAG execution | | Device Agent Role | Standalone | Can serve as Galaxy device agent | | Complexity | Simple to Moderate | Simple to Very Complex | | Learning Curve | Low | Moderate | | Cross-Device Collaboration | ❌ Not Supported | ✅ Core Feature | | Setup Difficulty | ✅ Easy | ⚠️ Moderate | | Status | ✅ LTS (Long-Term Support) | ⚡ Active Development |

🎓 Migration Path

For UFO² Users:

✅ Keep using UFO² – Fully supported, actively maintained
🔄 Gradual adoption – Galaxy can use UFO² as Windows device agent
📈 Scale up – Move to Galaxy when you need multi-device capabilities
📚 Learning resources – Migration Guide

✨ Capabilities at a Glance

🌌 Galaxy Framework – What's Different?

🌟 Constellation Planning

User Request
     ↓
ConstellationAgent
     ↓
  [Task DAG]
   /   |   \
Task1 Task2 Task3
(Win) (Linux)(Mac)

Benefits:

Cross-device dependency tracking
Parallel execution optimization
Cross-device dataflow management

</td> <td width="33%" valign="top">

🎯 Device Assignment

Selection Criteria
  • Platform
  • Resource
  • Task requirements
  • Performance history
        ↓
  Auto-Assignment
        ↓
  Optimal Devices

Smart Matching:

Capability-based selection
Real-time resource monitoring
Dynamic reallocation

</td> <td width="33%" valign="top">

📊 Orchestration

Task1 → Running  ✅
Task2 → Pending  ⏸️
Task3 → Running  🔄
        ↓
   Completion
        ↓
   Final Report

Orchestration:

Real-time status updates
Automatic error recovery
Progress tracking with feedback

</td> </tr> </table>

🪟 UFO² Desktop AgentOS – Core Strengths

UFO² serves dual roles: standalone Windows automation and Galaxy device agent for Windows platforms.

| Feature | Description | Documentation | |---------|-------------|---------------| | Deep OS Integration | Windows UIA, Win32, WinCOM native control | Learn More | | Hybrid Actions | GUI clicks + API calls for optimal performance | Learn More | | Speculative Multi-Action | Batch predictions → 51% fewer LLM calls | Learn More | | Visual + UIA Detection | Hybrid control detection for robustness | Learn More | | Knowledge Substrate | RAG with docs, demos, execution traces | Learn More | | Device Agent Role | Can serve as Windows executor in Galaxy orchestration | Learn More |

</div>

As Galaxy Device Agent:

Receives tasks from ConstellationAgent via Galaxy orchestration layer
Executes Windows-specific operations using proven UFO² capabilities
Reports status and results back to TaskOrchestrator
Participates in cross-device workflows seamlessly

🚀 Quick Start Guide

Choose your path and follow the detailed setup guide:

🌌 Galaxy Quick Start

For cross-device orchestration

# 1. Install
pip install -r requirements.txt

#

UFO

Install / Use

README