TemporalPromptEngine

Temporal Prompt Engine: Local, Open-Source, Intuitive, Cinematic Prompt Engine + Video and Audio Generation Suite for Nvidia GPUs

##NOW FEATURING custom 12b HunYuanVideo script with Incorporated MMAudio for 80gb cards.

<a href="https://ibb.co/PrRwywr"><img src="https://i.ibb.co/PrRwywr/Screenshot-1050.png" alt="Screenshot-1050" border="0"></a> <a href="https://ibb.co/xgsmcbh"><img src="https://i.ibb.co/xgsmcbh/Screenshot-1049.png" alt="Screenshot-1049" border="0"></a> <a href="https://ibb.co/xGxNTcV"><img src="https://i.ibb.co/xGxNTcV/Screenshot-1048.png" alt="Screenshot-1048" border="0"></a> <a href="https://ibb.co/k8Rx5wk"><img src="https://i.ibb.co/k8Rx5wk/Screenshot-1060.png" alt="Screenshot-1060" border="0"></a> <a href="https://ibb.co/ZGtzSL6"><img src="https://i.ibb.co/ZGtzSL6/Screenshot-1061.png" alt="Screenshot-1061" border="0"></a> <a href="https://ibb.co/ynzxCBj"><img src="https://i.ibb.co/ynzxCBj/Screenshot-1062.png" alt="Screenshot-1062" border="0"></a> <a href="https://ibb.co/1vg5Lqp"><img src="https://i.ibb.co/1vg5Lqp/Screenshot-1063.png" alt="Screenshot-1063" border="0"></a> <a href="https://ibb.co/MBDNgpH"><img src="https://i.ibb.co/MBDNgpH/Screenshot-1064.png" alt="Screenshot-1064" border="0"></a>

##MASSIVE UPDATE TO INSTRUCTIONS BELOW COMING VERY SOON (12/11/2024)

I am looking for a volunteer assistant if you're interested reach out at Sol@TemporalLab.com - This is going to a webapp version VERY soon.

Table of Contents

1. Introduction
2. Features Overview
3. Installation
   • Prerequisites
4. Quick Start Guide
5. API Key Setup
6. Story Mode: Unleash Epic Narratives
7. Inspirational Use Cases
8. Harnessing the Power of ComfyUI
9. Local Video Generation Using CogVideo
10. Join the Temporal Labs Journey
11. Donations and Support
12. Additional Services Offered
13. Attribution and Courtesy Request
14. Contact
15. Acknowledgments

---

<a name="1-introduction"></a>

Introduction

Welcome to the Temporal Prompt Engine a comprehensive framework for building out batch variations or story sequences for video prompt generators. This idea was original started as a comfyUI workflow for CogVideoX but has since evolved into a modular framework that has proven to scale with new foundational models and pipelines.

<a name="2-features-overview"></a>

Features Overview

• Cinematic Video Prompts: Tailor every aspect of your scene—from camera type and lens to lighting and framing.
• Temporal Awareness: Pick a decade and the camera options will represent that time, adding depth and context to your scenes.
• Dynamic Variables: Adjust settings like lighting, camera movement, lighting, time of day and more through easy to use drop-down options.
• Special Modes:
  • Story Mode: Seamlessly blend prompts across frames to create cohesive narratives, enabling you to craft epic stories or intimate tales.
  • Holiday Mode: Generate seasonal content tailored to holidays, perfect for festive branding and marketing.
  • Chaos Mode: Add unpredictability with Chaos Mode.
• Interconnected Settings: Experience how choices like selecting an ancient art style influence other variables like color palette and texture, creating a cohesive and authentic output.
• Cross-Platform Compatibility: Available for Windows & Linux

---

<a name="3-installation"></a>

Installation

Setting up the Temporal Prompt Engine is simple and hassle-free, allowing you to focus on creation rather than configuration. This section provides installation steps for Windows users.

<a name="System Preparation"></a>

System Preparation

YouTube Setup Guide Part 1:

• Operating System: Windows 10 or later
• Python: Version 3.10.9
  • Download Python Installer:
    • Visit the Python Downloads page.
    • Download the Python 3.10.9 installer for Windows.
  • Install Python:
    • Run the Installer:
      • Double-click the downloaded EXE installer file.
      • Important:
        • If you already have Python installed:
          • Be cautious when adding Python to PATH, as it may overwrite your existing Python version in the system PATH.
          • To avoid conflicts, you can install Python 3.10.9 without adding it to the PATH. Instead, use the Python Launcher for Windows (py) to specify the version when running commands.
        • If you don't have Python installed:
          • Check the box "Add Python to PATH" at the bottom of the installer window.
      • Click "Install Now".
  • Verify Installation:
    • Open a new Command Prompt.
    • Run:

      py -3.10 --version
      

    • You should see Python 3.10.9.

##If you want the Video Generation capabilities to work you will also need a local Python 3.12.4 Installed as well. If this is in place the setup.py will handle everything. ##If you only want to use the prompt engine and sound effects generator then you are fine with only 3.10.9 even if the setup.py complains a little.

• Operating System: Windows 10 or later

• Python: Version 3.12.4

  • Download Python Installer:
    • Visit the Python Downloads page.
    • Download the Python 3.12.4 installer for Windows.
  • Install Python:
    • Run the Installer:
      • Double-click the downloaded EXE installer file.
      • Important:
        • If you already have Python installed:
          • Be cautious when adding Python to PATH, as it may overwrite your existing Python version in the system PATH.
          • To avoid conflicts, you can install Python 3.10.9 without adding it to the PATH. Instead, use the Python Launcher for Windows (py) to specify the version when running commands.
        • If you don't have Python installed:
          • Check the box "Add Python to PATH" at the bottom of the installer window.
      • Click "Install Now".
  • Verify Installation:
    • Open a new Command Prompt.
    • Run:

      py -3.12 --version
      

    • You should see Python 3.12.4.
    • Operating System: Windows 10 or later
    • Py -3.12 is used by important video generation environment back-end processes.

• Git: Installed and configured

  • Install Git:
    • Download Git from Git for Windows.
    • Run the installer with default settings.
  • Verify Installation:
    • Open a new Command Prompt.
    • Run:

      git --version
      

    • You should see the installed Git version.

• NVIDIA GPU: CUDA-enabled NVIDIA GPU for optimal performance

  • Ensure you have an NVIDIA GPU with the latest drivers.

• CUDA Toolkit: Version 11.8 compatible with your GPU and installed

  • Install CUDA Toolkit:
    • Download the CUDA Toolkit from CUDA Toolkit Download.
    • Run the installer and follow the on-screen instructions.
  • Verify Installation:
    • Open a new Command Prompt and run:

      nvcc --version
      

    • You should see the CUDA compilation tools version information.

• FFmpeg: Installed and added to system PATH

  • Step 1: Click here to download the zip file of the latest version.
  • Step 2: Unzip this file by using any file archiver such as Winrar or 7z.
  • Step 3: Rename the extracted folder to ffmpeg and move it into the root of C: drive.
  • setx /m PATH "C:\ffmpeg\bin;%PATH%"
  • Verify Installation:
    • Open a new Command Prompt and run:

      ffmpeg -version
      

    • You should see FFmpeg version information.

• Ollama: Download from Ollama Setup and follow the on-screen instructions to install.

##[Setup Video Guide Part 2)[https://youtu.be/_8TXLNwA9ak?si=EO73EDqXafBLqA_O]

You are READY to begin the automated setup process:

Clone the Repo

git clone https://github.com/TemporalLabsLLC-SOL/TemporalPromptEngine.git

Manually Download the Repository:

• Visit the TemporalPromptGenerator GitHub Repository.
• Click on the "Code" button and select "Download ZIP".
• Extract the downloaded ZIP file to your desired location (e.g., C:\TemporalPromptEngine).

EASY-ONE-CLICK-INSTALLER

Open the Extracted Archive (or cloned repo) and click RUN-FIRST-PRE-FLIGHT-CHECK.bat

• Follow the on-screen prompts. The script will automatically set up the python environment(s), install necessary packages, and configure settings.

The application will launch, guiding you through the initial setup. DURING THIS SETUP, either after you close the app OR denying to open the open during setup, you will have the option to add a work-around shortcut to your desktop. It currently does not have an icon. That will load the env and scripts reliably going forward.

OR

Manually Run the Setup Script:

• Open Command Prompt and navigate to the extracted TemporalPromptEngine directory:

  cd C:\TemporalPromptEngine-main
  

• Navigate to the WINDOWS folder: