UI2CODE
A tidied repo for UI2CODE, a reverse engineering system convert UI design to code automatically and precisely.
Install / Use
/learn @MulongXie/UI2CODEREADME
UI2CODE - A Computer Vision Based Reverse Engineering of Graphical User Interface
This project is still ongoing, while the UI element detection part is useable and can be download in this repo of UIED. Besides, I implemented a web app of GUI element detection based on our algorithm, you are welcome to have a try http://www.uied.online.
What is it?
UI2CODE is a system converting the GUI image into cooresponding front-end code that achieves the same visual effect and expected functionality of the input GUI.
It comprises two major parts:
- UI components detection: localize and classify all UI elements on the given image
- Graphical components detection
- Text recognition through EAST
- Code generation
- Repititive component recognition
- DOM tree construction
- HTML + CSS generation
Related Skills
clearshot
Structured screenshot analysis for UI implementation and critique. Analyzes every UI screenshot with a 5×5 spatial grid, full element inventory, and design system extraction — facts and taste together, every time. Escalates to full implementation blueprint when building. Trigger on any digital interface image file (png, jpg, gif, webp — websites, apps, dashboards, mockups, wireframes) or commands like 'analyse this screenshot,' 'rebuild this,' 'match this design,' 'clone this.' Skip for non-UI images (photos, memes, charts) unless the user explicitly wants to build a UI from them. Does NOT trigger on HTML source code, CSS, SVGs, or any code pasted as text.
openpencil
2.1kThe world's first open-source AI-native vector design tool and the first to feature concurrent Agent Teams. Design-as-Code. Turn prompts into UI directly on the live canvas. A modern alternative to Pencil.
ui-ux-pro-max-skill
60.4kAn AI SKILL that provide design intelligence for building professional UI/UX multiple platforms
ui-ux-pro-max-skill
60.4kAn AI SKILL that provide design intelligence for building professional UI/UX multiple platforms
