Simplify.AI
A full stack machine learning app that takes in lecture recordings as inputs and outputs their summaries.
Install / Use
/learn @ernestwong1027/Simplify.AIREADME
What is Simplify.AI?
A free, open-source web app that takes in lecture recordings as inputs and outputs their summaries. Simply drag and drop your audio file or find it from your computer, and your summary will generate in less than two minutes.
<img width="600" alt="Screen Shot 2022-04-03 at 3 27 03 AM" src="https://user-images.githubusercontent.com/71997372/161416586-55d81691-6ca3-4080-ac30-ffbd9d266594.png">How we built it
Our pipeline is in \model class sets. We built it using natural language processing models, specifically the Silero speech-to-text model and the Pegasus abstractive summarization model, and added additional scripts to add punctionuation, enhance audio quality, and finetune our summarization model.
What we learned
- Abstractive summarization (Attention is all you need!)
- The differences between Automatic Speech Recognition and Speech To Text models
- Creating machine learning pipelines and transforming them into products
Notes
- Currently, the actual conversion only works locally because we are looking to find an affordable hosting service
What's next
- Explore pricing plans + enterprise usage
- Adding a sentiment analysis feature to rate lecture quality in terms of engagement, tone, and impact
- Allowing users to create accounts to access previous lecture summaries in one place
- Building a dataset with inputted audio files, potentially separating it by professor
Related Skills
proje
Interactive vocabulary learning platform with smart flashcards and spaced repetition for effective language acquisition.
YC-Killer
2.7kA library of enterprise-grade AI agents designed to democratize artificial intelligence and provide free, open-source alternatives to overvalued Y Combinator startups. If you are excited about democratizing AI access & AI agents, please star ⭐️ this repository and use the link in the readme to join our open source AI research team.
research_rules
Research & Verification Rules Quote Verification Protocol Primary Task "Make sure that the quote is relevant to the chapter and so you we want to make sure that we want to have it identifie
groundhog
398Groundhog's primary purpose is to teach people how Cursor and all these other coding agents work under the hood. If you understand how these coding assistants work from first principles, then you can drive these tools harder (or perhaps make your own!).
