Bynce: AI Pose Picker for BynceDance

<img width="300px" alt="demo_pose" src="./logo.jpg" />

Bynce is a Web-based tool that poses MMD models from video input in real-time. Welcome feature requests and PRs!

Tech Stack

• 3D key points detection: Mediapipe
• 3D scene: Babylon.js
• MMD model viewer: babylon-mmd
• Web framework: Vite+React
• Models are from aplaybox.

Features

• [x] Pose detection
• [x] Face detection
• [x] Hand detection (experimental)
• [x] Rust-WASM based pose-to-quaternion solver
• [x] 360-degree background selection
• [x] Video, image upload
• [x] Webcam input
• [x] Model selection
• [x] Ollama support (electron version)
• [x] VMD import/export (to export a valid VMD file, you must record at least one motion)
• [x] MMD editor: bone, material, mesh edit

Hint

• Let your browser use dedicated GPU for better performance.

Project Setup

npm install

Compile and Hot-Reload for Development

npm run dev

Type-Check, Compile and Minify for Production

npm run build

Lint with ESLint

npm run lint