LinkedIn Lead Scraper - Automated Profile Discovery & Lead Generation Tool

A powerful LinkedIn scraper and lead discovery tool that automatically finds and extracts similar LinkedIn profiles using tree-based exploration. This LinkedIn automation tool helps you discover hundreds or thousands of qualified leads by exploring professional networks - perfect for LinkedIn prospecting, sales, and recruitment.

---

<video className="center" src="https://github-production-user-asset-6210df.s3.amazonaws.com/193476718/511409806-b3433ec1-c898-439f-9502-6420d7d7d8ea.mp4?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20251107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20251107T160344Z&X-Amz-Expires=300&X-Amz-Signature=c0b70e3e34f47c72f4dc0372210ed9894e6f87f842bc311d062b213bba521316&X-Amz-SignedHeaders=host"></video>

What Does This LinkedIn Lead Scraper Do?

This LinkedIn profile finder and lead generation tool automates the process of discovering potential leads by:

1. Profile Discovery: Starting with LinkedIn usernames you provide
2. Network Exploration: Finding similar profiles for each profile using LinkedIn's recommendation algorithm
3. Deep Scraping: Recursively discovering similar profiles of similar profiles (tree-based discovery)
4. Smart Deduplication: Automatically removing duplicate profiles across the discovery tree
5. Data Export: Exporting all discovered LinkedIn profiles to CSV or JSON format

Real-World Example: Start with 5 target profiles → Automatically discover 100-50,000+ similar leads in minutes!

LinkedIn Scraper Features

✅ Tree-Based LinkedIn Discovery - Explores professional networks depth-first ✅ Automated Lead Generation - No manual LinkedIn searching required ✅ Profile Data Extraction - Scrapes names, headlines, profile URLs, and more ✅ Real-Time Counter - See leads discovered as they're found ✅ Concurrent Processing - Fast parallel profile scraping ✅ Smart Deduplication - Prevents duplicate profile extraction ✅ Tree View Visualization - See the complete discovery tree structure ✅ Export to CSV/JSON/Tree - Easy integration with CRM and sales tools

---

Quick Start - LinkedIn Lead Scraper Setup (3 Simple Steps)

Step 1: Get Your LinkdAPI Key

1. Visit linkdapi.com - the best LinkedIn API for profile data
2. Sign up for a free account
3. Copy your API key from the dashboard

Step 2: Install LinkedIn Scraper

# Clone or download the project
cd linkedin-leads-discover

# Install Python dependencies
pip install -r requirements.txt

# OR use Python 3
pip3 install -r requirements.txt

Step 3: Configure Your LinkedIn API Key

Open config.ini in any text editor and add your LinkdAPI key:

[LINKDAPI]
api_key = YOUR_API_KEY_HERE

Step 4: Run the LinkedIn Lead Discovery Tool

python main.py
# OR
python3 main.py

---

How to Use This LinkedIn Profile Scraper

Starting the LinkedIn Lead Discovery Tool

Run python main.py and you'll see an interactive menu:

Choose action:
❯ Start discovery from usernames
  Start discovery from file
  View discovered profiles
  View tree
  Export profiles
  Exit

Option 1: LinkedIn Scraper from Usernames

1. Select "Start discovery from usernames"
2. Enter LinkedIn usernames separated by commas:

   billgates, satyanadella, reidhoffman
   

3. Choose discovery depth (recommended: 3)
4. Watch the LinkedIn lead scraper work in real-time!

How to find LinkedIn usernames:

• From linkedin.com/in/billgates → use billgates
• From linkedin.com/in/satya-nadella-3145136 → use satya-nadella-3145136
• The username is everything after /in/ in the LinkedIn profile URL

Option 2: Bulk LinkedIn Scraping from File

1. Create a text file with LinkedIn usernames (one per line):

   billgates
   satyanadella
   jeffweiner08
   reidhoffman
   

2. Select "Start discovery from file"
3. Enter the file path (default: usernames.txt)
4. Choose discovery depth
5. Let the LinkedIn profile scraper extract leads automatically!

Option 3: View Discovery Tree

After running a discovery, select "View tree" to see the complete hierarchical structure of all discovered profiles:

LinkedIn Discovery Tree (3595 total profiles)
├── satyanadella │  (20 discovered)
│   ├── Aravind Srinivas │ Cofounder, President & CEO, Perplexity (19 discovered)
│   │   ├── Chungin Lee │ CEO @ Cluely, The AI notetaker that help... (16 discovered)
│   │   │   ├── Kevin  Lu │ Co-Founder @ Orchids (YC W25) | Prev @ P...
│   │   │   ├── Sajjaad Farzad │ Founding Engineer @ Cluely | Perusing Ba...
│   │   │   ├── Neel Shanmugam │ Co-Founder & COO @ Cluely | Z-Fellow | C...
│   │   │   ├── Fardeen Khimani 😇 │ CEO @ Rounds.so | Georgia Tech PhD Dropo...
│   │   │   ├── jonathan liu │ building Cupidly.io | boostrapping my wa...
│   │   │   └── ... and 11 more profiles
│   │   ├── Michael Yan │ Founder & CEO @ Simplify | Looking for a... (11 discovered)
│   │   │   ├── Sherry X. │ Partnerships & Strategy @ Simplify
│   │   │   ├── G Le │ Co-Founder @BuyAI | CS + Math @UIC | 1871
│   │   │   ├── Ethan Horoschak │ Founder @ Simplify | Hiring Senior SWEs!
│   │   │   ├── Nader Khalil │ Director @ NVIDIA | CEO & Co-founder at ...
│   │   │   ├── Mathis Grosjean │ Co-founder & CEO @ zealy.io
│   │   │   └── ... and 6 more profiles
│   │   ├── Arnav Gudibande │ Research Engineer @ Perplexity AI (11 discovered)
│   │   │   ├── Patrick Liu │ AI @ Perplexity | BS/MS CS @ Stanford
│   │   │   ├── Larry Yang │ ‎Software Engineer
│   │   │   ├── William Wong │ Research Engineer at DeepMind
│   │   │   ├── Alexis Weill │ Data Science at Perplexity
│   │   │   ├── Clare Southern │ Perplexity AI
│   │   │   └── ... and 6 more profiles
│   │   └── ... and 14 more profiles
│   ├── N. Chandrasekaran │ Chairman, Tata Sons, Author of Bridgital... (9 discovered)
│   │   ├── Kunal Shah │ Founder : CRED, curious.  (1 discovered)
│   │   │   └── Nithin Kamath │ Founder & CEO at Zerodha & Rainmatter. L...
│   │   ├── Arundhati Bhattacharya │ President & CEO at Salesforce, South Asia (9 discovered)
│   │   │   ├── Arun Kumar Parameswaran │ Executive Vice President & Managing Dire...
│   │   │   ├── Niraj Ambani │ Group President - Supply Chain at Relian...
│   │   │   └── ... and 4 more profiles
│   │   └── ... and 4 more profiles
│   ├── Andrew Ng │ Founder of DeepLearning.AI; Managing Gen... (15 discovered)
│   │   ├── Lilian Weng │ AI Researcher, Co-founder @ Thinking Mac... (14 discovered)
│   │   │   ├── Rowan Zellers │ thinking machines, ex-openai
│   │   │   ├── Jonathan Lachman │ Founding Head of Operations at Thinking ...
│   │   │   └── ... and 9 more profiles
│   │   └── ... and 10 more profiles
│   └── ... and 15 more profiles
└── jeffweiner08 │  (19 discovered)
    ├── Laszlo Bock │ 2x start-up founder & CEO --​> 2 exits |... (19 discovered)
    │   ├── Kevin Oakes │ Founder & Chief Strategy Officer of the ... (6 discovered)
    │   │   ├── Betsy Rodriguez, PhD │ Retired Chief HR Officer
    │   │   ├── Alexis Fink │ AI Activation | Future of Work | Leaders...
    │   │   └── ... and 1 more profiles
    │   ├── Jon Ingham │ Director of the Strategic HR Academy. Ex... (12 discovered)
    │   │   ├── Albert Loyola │ Human-AI Workforce Advisor | Workforce S...
    │   │   ├── William Tincup │ I say what others don't, can't, or won't.
    │   │   └── ... and 7 more profiles
    │   └── ... and 14 more profiles
    └── ... and 15 more profiles

The tree view shows:

• Visual hierarchy of how profiles were discovered
• Connection paths from seed profiles to discovered leads
• Discovery count for each profile (how many profiles they led to)
• Profile details including name and headline
• Collapsed view for large branches (e.g., "... and 11 more profiles")

Understanding Discovery Depth - LinkedIn Lead Mining

Depth controls how deep the LinkedIn network exploration goes:

• Depth 1: Only your seed/starting profiles
• Depth 2: Starting profiles + their LinkedIn similar profiles (~20 per profile)
• Depth 3: Depth 2 + similar profiles of those (~400+ total profiles)
• Depth 5: Discovers thousands of LinkedIn leads
• Depth 10: Can discover tens of thousands of profiles!

LinkedIn Lead Generation Growth Example (5 starting profiles):

• Depth 1: 5 profiles
• Depth 2: ~105 profiles (5 + ~20 similar per profile)
• Depth 3: ~2,105 profiles (exponential growth)
• Depth 5: Can reach 40,000+ LinkedIn profiles!

Note: Higher depth = more profiles discovered = more API credits used

---

LinkedIn Scraper Features & Capabilities

🌳 Tree-Based LinkedIn Network Discovery

Intelligently explores LinkedIn's "People Also Viewed" algorithm to discover similar profiles at each level of your professional network

♻️ Smart Deduplication - No Duplicate Leads

Automatically detects and skips duplicate LinkedIn profiles using URN tracking (same person found through multiple paths)

⚡ Fast & Concurrent LinkedIn Scraping

Processes multiple LinkedIn profiles simultaneously using async/await for maximum speed and efficiency

🎯 Intelligent Retry Logic

Automatically retries failed LinkedIn API requests with exponential backoff for rate limits

📊 Real-Time Lead Counter

Watch your LinkedIn leads counter increment in real-time as profiles are discovered (not just after each depth completes)

💾 Flexible Data Export

• CSV Export: Perfect for Excel, Google Sheets, CRM import, and data analysis
• JSON Export: Complete structured data for developers and automation
• Tree Export: Visual hierarchy showing discovery paths and relationships

🎨 Beautiful CLI Interface

Clean command-line int