AI Desktop Automation Assistant

🧠 Introduction

Welcome to AI Desktop Automation Assistantt, an AI-powered desktop application inspired by the legendary J.A.R.V.I.S. from the Marvel Cinematic Universe. Designed to function as an intelligent, proactive, and highly interactive digital assistant, JARVIS enhances productivity, monitors system performance, and provides an intuitive user experience through voice, text, and visual inputs.

Built using modern technologies like PyQt5, OpenCV, and advanced AI models, JARVIS delivers a highly extensible, production-ready solution for both personal and professional use.

---

🚀 Features

🗣️ Hands-Free Voice Control

• Activate JARVIS using the wake word “Jarvis” for seamless voice interaction.

📸 Multimodal Interaction

• Process voice commands, analyze live camera feeds, and interpret screenshots for dynamic assistance.

🖥️ Real-Time System Monitoring

• Get detailed insights on CPU, memory, battery, disk usage, network status, and user activity.

💡 Proactive Intelligence

• Receive automated suggestions based on real-time system status (e.g., low battery alerts, network troubleshooting prompts).

😎 Witty & Engaging Personality

• Enjoy JARVIS’s trademark humor, personality, and contextual responses, powered by customizable AI models.

📂 Persistent Memory System

• Retain and recall past interactions using a persistent memory framework (mem0).

🔌 Modular & Extensible Architecture

• Expand capabilities by integrating third-party APIs (weather, news, software management, scheduling, etc.).

🖥️ Cross-Platform Compatibility (Upcoming)

• Currently optimized for Windows 10/11.
• Future support planned for Linux and macOS.

---

🛠️ Installation Guide

📌 Prerequisites

• Operating System: Windows 10/11 (Linux/macOS support coming soon)
• Python Version: 3.12 or higher
• Hardware Requirements: Microphone, webcam (optional for camera analysis) , GPU (Optional for running in LLM in locally)
• Dependencies: Listed in requirements.txt

⚙️ Installation (Windows)

1. Clone the Repository

   git clone https://github.com/DawoodTouseef/AI-Desktop-Automation-Assistant.git
   cd AI-Desktop-Automation-Assistant
   

2. Create and Activate a Virtual Environment

   python -m venv venv
   .\venv\Scripts\activate
   

3. Install Requirements

   pip install -r requirements.txt
   

4. Run the Application

   .\run_jarvis.bat
   

5. Run GPT ALL STAR

   .\run_jarvis.bat --coder
   

6. Run Open Interpreter

   .\run_jarvis.bat --interpreter
   

7. Settings for GPT ALL STAR or Open Interpreter

   .\run_jarvis.bat -settings
   

🚀 Setup & Usage

1️⃣ Launching JARVIS

• Run the application.
• JARVIS greets you: "Hello, I am JARVIS."
• The Consciousness Module begins monitoring system state, camera, and screenshots.

2️⃣ Interacting with JARVIS

• 🎙️ Voice Commands: Say "Jarvis", followed by a command. (e.g., “How’s the system doing?”)
• 📸 Visual Processing: JARVIS analyzes camera feeds (every 60s) and screenshots (every 120s), responding accordingly.
• 🔔 Proactive Alerts: Automated updates like “Battery critically low, sir.”

3️⃣ Example Commands

• “Jarvis, what’s on my screen?” → Analyzes the latest screenshot.
• “Jarvis, check the system.” → Reports CPU, memory, battery, and network status.
• “Jarvis, what’s in the room?” → Processes the camera feed.

4️⃣ Closing the Application

• Click the close button, and JARVIS will gracefully shut down all background processes.

---

📌 Roadmap

🔹 Expand compatibility to Linux/macOS.
🔹 Integrate real-time news APIs.
🔹 Enhance text-to-speech (TTS) with a JARVIS-like voice model.
🔹 Implement a visual heads-up display (HUD) for system diagnostics.
🔹 Optimize performance for low-resource systems.
🔹 Introduce AI-powered task automation and workflow enhancements.

---

🤝 Contributing

We welcome contributions to make JARVIS even more powerful! If you'd like to contribute:

1. Fork the repository
2. Create a feature branch → git checkout -b feature/your-feature
3. Commit your changes → git commit -m "Add your feature"
4. Push to your branch → git push origin feature/your-feature
5. Submit a Pull Request

Follow our contribution guidelines and submit issues for bugs or feature requests!

---

📜 License

This project is licensed under the Apache License 2.0.
See the LICENSE file for details.

🎖️ Acknowledgments

• Inspired by JARVIS from Marvel’s Iron Man, brought to life by Paul Bettany’s iconic voice.
• Built with love using PyQt5, OpenCV, and the Python ecosystem.
• Special thanks to the open-source community and tools like mem0, pvporcupine, crewai, and many more.

---

📩 Contact

For questions, feedback, or collaboration, reach out to Dawood Thouseef.

---