Substrate
An Open-source Framework for Human Understanding, Meaning, and Progress.
Install / Use
/learn @danielmiessler/SubstrateREADME
Substrate
Infrastructure for Human Knowledge & Progress
<p align="center"> <a href="#-what-is-substrate">What Is It</a> • <a href="#-data--evidence">Data</a> • <a href="#-quick-start">Quick Start</a> • <a href="#-documentation">Docs</a> • <a href="#-contribute">Contribute</a> • <a href="#-roadmap">Roadmap</a> </p> </div>🎯 What Is Substrate?
<div align="center"> <a href="https://www.youtube.com/watch?v=ky7ejowc_qY"> <img src="https://img.youtube.com/vi/ky7ejowc_qY/0.jpg" alt="Substrate Introduction" width="600"> </a>→ Watch Introduction Video • → Read Blog Post
</div>A Shared Foundation for Human Progress
Think of substrate as the base layer—the common ground where we can all work together to understand problems and drive solutions forward. Instead of fragmented discussions and reinventing the wheel, Substrate gives us one place to:
- Document problems → What's actually broken, with evidence
- Track solutions → What works, what doesn't, with results
- Connect progress → Link people, organizations, and projects actually moving things forward
- Build on each other → Arguments and ideas that build on shared evidence
- Measure outcomes → Did it work? What actually changed?
The Purpose: Accelerate Human Progress
We can't solve problems we don't understand. We can't build on solutions we can't find. Substrate provides:
- 🎯 Shared understanding → One place to understand what's wrong and what works
- 🚀 Faster progress → Build on existing knowledge instead of starting over
- 📊 Evidence-based action → Ground decisions in authoritative data, not opinions
- 🔗 Connected knowledge → See how problems, solutions, people, and data interconnect
- 🌍 Collective intelligence → Human insight + AI analysis working together toward progress
An open-source framework connecting 17+ knowledge components:
graph TB
subgraph "🌍 The Substrate"
A[🧩 Problems]
B[💡 Solutions]
C[📊 Data Sources]
D[🗣️ Arguments]
E[📋 Claims]
F[👥 People]
G[🏢 Organizations]
H[🚀 Projects]
I[📈 Plans]
J[🎯 Values]
K[💭 Ideas]
end
L[👤 Human Contributors] --> A
L --> B
L --> D
M[🤖 AI Analysis] --> A
M --> B
M --> D
A -.connects to.-> B
B -.connects to.-> C
D -.connects to.-> C
E -.connects to.-> C
F -.connects to.-> G
G -.connects to.-> H
H -.connects to.-> B
A --> N[🔍 Shared Understanding]
B --> N
C --> N
D --> N
<table>
<tr>
<td width="50%">
🏗️ Structured Components
- Problems - Documented challenges with evidence
- Solutions - Proven approaches with results
- Arguments - Reasoning chains with quality scores
- Claims - Assertions linked to evidence
- Plans - Actionable strategies with metrics
- Ideas - Frameworks and concepts
- People & Organizations - Who's working on what
- Projects - Active initiatives with outcomes
📊 Authoritative Data
- 13 Data Sources across 100+ years
- Library science methodology (8 dimensions)
- Government agencies + verified databases
- TypeScript automation with Bun runtime
- Full documentation for every dataset
- Free APIs with excellent access
- Human wellbeing indicators beyond GDP
- Real-time to annual update frequencies
🚀 What's New
<details> <summary><strong>📅 Latest Updates (Click to expand)</strong></summary>[!TIP] October 2025 - Massive Data Expansion!
We just added 8 authoritative data sources measuring human wellbeing beyond traditional economic metrics. Now track financial stress, health crises, social connection, worker agency, and environmental health.
🔥 October 27, 2025 - Human Wellbeing Infrastructure
5 NEW US Wellbeing Data Sources:
| Added | Source | What It Measures | |-------|--------|------------------| | 🆕 | DS-00004 FRED Economic Wellbeing | Debt stress, unemployment, inequality | | 🆕 | DS-00005 CDC WONDER Mortality | Overdoses, suicides, deaths of despair | | 🆕 | DS-00006 Census ACS Social | Living alone, commute times, isolation | | 🆕 | DS-00007 BLS JOLTS Labor | Worker "permission to quit" index | | 🆕 | DS-00008 EPA Air Quality | PM2.5, ozone, environmental health |
Why This Matters:
"If we measure only GDP and unemployment, we will miss the slow-motion collapse of human thriving happening in plain sight."
These sources capture:
- 💰 Leading indicators - Financial stress predicts recessions
- 🎭 Behavioral truth - Actions reveal what surveys miss
- 🏗️ Structural determinants - Air quality you can't "self-care" out of
- 🚨 Crisis detection - County-level suffering visibility
- 🆓 Worker agency - Quit rate = economic freedom measure
October 25, 2025 - Core Data Updates
- ✅ Pulitzer Prize, GDP, inflation data refreshed
- ✅ Knowledge Worker Salaries validation completed
October 16-18, 2025 - Infrastructure
- 🏗️ Library science methodology (8-dimension evaluation)
- ⚡ TypeScript automation with auto-discovery
- 📊 Central logging and health monitoring
- 📚 Complete documentation suite
<details> <summary><strong>📜 Previous Updates (Click to expand)</strong></summary>
September 2024 - Community Growth
- ✅ Claims, Arguments, and Values frameworks
- ✅ 6+ community contributors
- ✅ 10+ merged pull requests
- ✅ TELOS integration
August 2024 - Framework Expansion
- ✅ Extended component types (Plans, Ideas, Models)
- ✅ Improved documentation structure
- ✅ Enhanced contribution guidelines
July 2024 - Foundation
- ✅ Single-repo structure with 17+ object types
- ✅ Core framework and documentation
- ✅ Public launch with initial datasets
- ✅ Community contribution framework
</details>
📊 Data & Evidence
[!NOTE] All data sources include complete library science cataloging with 8-dimension evaluation: Authority, Currency, Objectivity, Accuracy, Methodology, Coverage, Reliability, and Provenance.
[!IMPORTANT] We know data can be controversial. That's exactly why we:
- 📊 Collect from multiple sources - Cross-reference data from different authoritative providers
- 🔍 Provide complete transparency - Every source fully documented with provenance, methodology, and limitations
- 📝 Full logging - All data pulls logged with timestamps, source versions, and processing steps
- 🔓 Open source everything - TypeScript update scripts show exactly how data is fetched and transformed
You can verify, audit, and challenge our data. That's the point.
Core Datasets (Data/)
| Dataset | Time Span | Data Points | Source | Status | |---------|-----------|-------------|--------|--------| | 🇺🇸 US GDP | 1929-2025 | 96 years + 314 quarters | FRED/BEA | ✅ Active | | 💵 US Inflation | 1947-2025 | 945 months | FRED/BLS | ✅ Active | | 🦠 Bay Area COVID Wastewater | 2022-2025 | 161 weeks | CDPH | ✅ Active | | 🏆 Pulitzer Prize Winners | 1918-2024 | 249 winners | Wikidata | ✅ Active | | 💼 Knowledge Worker Salaries | Global | Multi-region | Research | ✅ Active |
Wellbeing Data Sources (Data-Sources/) 🆕
<details>
<summary><strong>🌍 Global Health & Development (Click to expand)</strong></summary>
| ID | Name | Coverage | Indicators | Update | |----|------|----------|------------|--------| | DS-00001 | WHO Global Health Observatory | 194 countries | 2,000+ health indicators | Quarterly | | DS-00002 | UN SDG Indicators | 193 countries | 231 SDG targets | Biannual | | DS-00003 | World Bank Open Data | Global | Development metrics | Varies |
</details> <details open> <summary><strong>🇺🇸 US Human Wellbeing (October 2025)</strong></summary> <table> <tr> <th width="15%">Source</th> <th width="35%">Key Indicators</th> <th width="30%">Why It Matters</th> <th width="20%">Update Freq</th> </tr> <tr> <td><strong>DS-00004</strong><br/><a href="./Data-Sources/DS-00004—FRED_Economic_Wellbeing/">FRED Economic</a></td> <td> • Debt service ratio<br/> • Credit card delinquency<br/> • Financial stress index<br/> • Underemployment (U-6)<br/> • Consumer sentiment<br/> • GINI inequality </td> <td>💰 <strong>Economic Security Foundation</strong><br/>Debt >12% = stress, >14% = crisis. Leading indicator of recession.</td> <td>Weekly to Annual</td> </tr> <tr> <td><strong>DS-00005</strong><br/><a href="./Data-Sources/DS-00005—CDC_WONDER_Mortality/">CDC WONDER</a></td> <td> • Drug overdose deaths<br/> • Opioid-specific deaths<br/> • Suicide rates<br/> • All-cause mortality </td> <td>🚨 <strong>Crisis Detection</strong><br/>Deaths of desRelated Skills
node-connect
341.8kDiagnose OpenClaw node connection and pairing failures for Android, iOS, and macOS companion apps
frontend-design
84.6kCreate distinctive, production-grade frontend interfaces with high design quality. Use this skill when the user asks to build web components, pages, or applications. Generates creative, polished code that avoids generic AI aesthetics.
openai-whisper-api
341.8kTranscribe audio via OpenAI Audio Transcriptions API (Whisper).
commit-push-pr
84.6kCommit, push, and open a PR
