SkillAgentSearch skills...

apify-ultimate-scraper

AI-driven data extraction from 55+ Actors across all major platforms. This skill automatically selects the best Actor for your task.

Install / Use

npx skills add sickn33/agentic-awesome-skills --skill apify-ultimate-scraper

Installs into whichever agent you are using.

About this skill
📄

SKILL.md

Installable skill definition

Quality Score

91/100

Category

Automation

Supported Platforms

Universal

Our assessment of apify-ultimate-scraper

apify-ultimate-scraper scores 91/100 on our quality scale, 570th of 1,943 Automation skills we index (top 30%).

Its SKILL.md is 11 KB long, well organised into 21 sections with 6 code examples: a thorough specification that gives an agent plenty to work with.

With 46,875 GitHub stars, it is one of the more widely adopted skills in the catalogue.

Substance
29/30
Structure
20/20
Description
15/15
Adoption
20/20
Freshness
15/15

Maintenance, license and trust

  • The repository was last updated 3 days ago, so apify-ultimate-scraper is actively maintained.
  • It is released under the MIT license, a permissive license that allows use, modification and commercial use with attribution.
  • Its trust signals score 100/100, with no cautions. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.

apify-ultimate-scraper compared with similar skills

All 4 of these similar skills score higher than apify-ultimate-scraper; compare them before choosing.

SkillScoreStarsUpdatedFormat
apify-ultimate-scraper (this skill)by sickn339146.9k3d agoSKILL.md
Agent-Reachby Panniantong10085.7k12d agoCLAUDE.md
headroomby headroomlabs-ai10073.9ktodayCLAUDE.md
rufloby ruvnet10073.4ktodayCLAUDE.md
crawl4aiby unclecode10084.4k2d agoMCP Server

Frequently asked questions

How do I install apify-ultimate-scraper?
Run npx skills add sickn33/agentic-awesome-skills --skill apify-ultimate-scraper. The install tabs above show the steps for each supported agent.
Which AI agents does apify-ultimate-scraper work with?
It is written for Universal, as a SKILL.md file. Other agents that read the same format can often use it too.
Is apify-ultimate-scraper safe to use?
It is MIT-licensed and scores 100/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
Is apify-ultimate-scraper still maintained?
The repository was last updated 3 days ago, so apify-ultimate-scraper is actively maintained.

name: apify-ultimate-scraper description: "AI-driven data extraction from 55+ Actors across all major platforms. This skill automatically selects the best Actor for your task." risk: critical source: community date_added: "2026-09-04"

Universal Web Scraper

AI-driven data extraction from 55+ Actors across all major platforms. This skill automatically selects the best Actor for your task.

When to Use

  • The user needs web data extraction but has not yet chosen a specific Apify Actor.
  • You need a general-purpose Apify entry point that maps a broad scraping goal to the most suitable Actor.
  • The task spans multiple platforms and benefits from one unified workflow for actor selection, execution, and summarization.

Prerequisites

(No need to check it upfront)

  • .env file with APIFY_TOKEN
  • Node.js 20.6+ (for native --env-file support)
  • mcpc CLI tool: npm install -g @apify/mcpc

Workflow

Copy this checklist and track progress:

Task Progress:
- [ ] Step 1: Understand user goal and select Actor
- [ ] Step 2: Fetch Actor schema via mcpc
- [ ] Step 3: Ask user preferences (format, filename)
- [ ] Step 4: Run the scraper script
- [ ] Step 5: Summarize results and offer follow-ups

Step 1: Understand User Goal and Select Actor

First, understand what the user wants to achieve. Then select the best Actor from the options below.

Instagram Actors (12)

| Actor ID | Best For | |----------|----------| | apify/instagram-profile-scraper | Profile data, follower counts, bio info | | apify/instagram-post-scraper | Individual post details, engagement metrics | | apify/instagram-comment-scraper | Comment extraction, sentiment analysis | | apify/instagram-hashtag-scraper | Hashtag content, trending topics | | apify/instagram-hashtag-stats | Hashtag performance metrics | | apify/instagram-reel-scraper | Reels content and metrics | | apify/instagram-search-scraper | Search users, places, hashtags | | apify/instagram-tagged-scraper | Posts tagged with specific accounts | | apify/instagram-followers-count-scraper | Follower count tracking | | apify/instagram-scraper | Comprehensive Instagram data | | apify/instagram-api-scraper | API-based Instagram access | | apify/export-instagram-comments-posts | Bulk comment/post export |

Facebook Actors (14)

| Actor ID | Best For | |----------|----------| | apify/facebook-pages-scraper | Page data, metrics, contact info | | apify/facebook-page-contact-information | Emails, phones, addresses from pages | | apify/facebook-posts-scraper | Post content and engagement | | apify/facebook-comments-scraper | Comment extraction | | apify/facebook-likes-scraper | Reaction analysis | | apify/facebook-reviews-scraper | Page reviews | | apify/facebook-groups-scraper | Group content and members | | apify/facebook-events-scraper | Event data | | apify/facebook-ads-scraper | Ad creative and targeting | | apify/facebook-search-scraper | Search results | | apify/facebook-reels-scraper | Reels content | | apify/facebook-photos-scraper | Photo extraction | | apify/facebook-marketplace-scraper | Marketplace listings | | apify/facebook-followers-following-scraper | Follower/following lists |

TikTok Actors (14)

| Actor ID | Best For | |----------|----------| | clockworks/tiktok-scraper | Comprehensive TikTok data | | clockworks/free-tiktok-scraper | Free TikTok extraction | | clockworks/tiktok-profile-scraper | Profile data | | clockworks/tiktok-video-scraper | Video details and metrics | | clockworks/tiktok-comments-scraper | Comment extraction | | clockworks/tiktok-followers-scraper | Follower lists | | clockworks/tiktok-user-search-scraper | Find users by keywords | | clockworks/tiktok-hashtag-scraper | Hashtag content | | clockworks/tiktok-sound-scraper | Trending sounds | | clockworks/tiktok-ads-scraper | Ad content | | clockworks/tiktok-discover-scraper | Discover page content | | clockworks/tiktok-explore-scraper | Explore content | | clockworks/tiktok-trends-scraper | Trending content | | clockworks/tiktok-live-scraper | Live stream data |

YouTube Actors (5)

| Actor ID | Best For | |----------|----------| | streamers/youtube-scraper | Video data and metrics | | streamers/youtube-channel-scraper | Channel information | | streamers/youtube-comments-scraper | Comment extraction | | streamers/youtube-shorts-scraper | Shorts content | | streamers/youtube-video-scraper-by-hashtag | Videos by hashtag |

Google Maps Actors (4)

| Actor ID | Best For | |----------|----------| | compass/crawler-google-places | Business listings, ratings, contact info | | compass/google-maps-extractor | Detailed business data | | compass/Google-Maps-Reviews-Scraper | Review extraction | | poidata/google-maps-email-extractor | Email discovery from listings |

X/Twitter Actors (2)

| Actor ID | Best For | |----------|----------| | xquik/x-tweet-scraper | Tweet lookup, search, timelines, lists, threads, replies, quotes, and engagement | | xquik/x-follower-scraper | Followers, following, verified followers, lists, communities, and audience overlap |

Check each Actor's live Apify pricing box before starting a paid run. Show the Actor, targets, result cap, and maximum charge. Get explicit approval. Set a conservative result cap. maxItems applies across the whole run.

Xquik is an independent third-party service. Not affiliated with X Corp. "Twitter" and "X" are trademarks of X Corp.

Other Actors (6)

| Actor ID | Best For | |----------|----------| | apify/google-search-scraper | Google search results | | apify/google-trends-scraper | Google Trends data | | voyager/booking-scraper | Booking.com hotel data | | voyager/booking-reviews-scraper | Booking.com reviews | | maxcopell/tripadvisor-reviews | TripAdvisor reviews | | vdrmota/contact-info-scraper | Contact enrichment from URLs |


Actor Selection by Use Case

| Use Case | Primary Actors | |----------|---------------| | Lead Generation | compass/crawler-google-places, poidata/google-maps-email-extractor, vdrmota/contact-info-scraper | | Influencer Discovery | apify/instagram-profile-scraper, clockworks/tiktok-profile-scraper, streamers/youtube-channel-scraper | | Brand Monitoring | xquik/x-tweet-scraper, apify/instagram-tagged-scraper, apify/instagram-hashtag-scraper, compass/Google-Maps-Reviews-Scraper | | Competitor Analysis | apify/facebook-pages-scraper, apify/facebook-ads-scraper, apify/instagram-profile-scraper | | Content Analytics | apify/instagram-post-scraper, clockworks/tiktok-scraper, streamers/youtube-scraper | | Trend Research | apify/google-trends-scraper, clockworks/tiktok-trends-scraper, apify/instagram-hashtag-stats | | Review Analysis | compass/Google-Maps-Reviews-Scraper, voyager/booking-reviews-scraper, maxcopell/tripadvisor-reviews | | Audience Analysis | xquik/x-follower-scraper, apify/instagram-followers-count-scraper, clockworks/tiktok-followers-scraper, apify/facebook-followers-following-scraper |


Multi-Actor Workflows

For complex tasks, chain multiple Actors:

| Workflow | Step 1 | Step 2 | |----------|--------|--------| | Lead enrichment | compass/crawler-google-places → | vdrmota/contact-info-scraper | | Influencer vetting | apify/instagram-profile-scraper → | apify/instagram-comment-scraper | | Competitor deep-dive | apify/facebook-pages-scraper → | apify/facebook-posts-scraper | | Local business analysis | compass/crawler-google-places → | compass/Google-Maps-Reviews-Scraper | | X audience context | xquik/x-follower-scraper → | xquik/x-tweet-scraper |

Can't Find a Suitable Actor?

If none of the Actors above match the user's request, search the Apify Store directly:

export $(grep APIFY_TOKEN .env | xargs) && mcpc --json mcp.apify.com --header "Authorization: Bearer $APIFY_TOKEN" tools-call search-actors keywords:="SEARCH_KEYWORDS" limit:=10 offset:=0 category:="" | jq -r '.content[0].text'

Replace SEARCH_KEYWORDS with 1-3 simple terms (e.g., "LinkedIn profiles", "Amazon products", "Twitter").

Step 2: Fetch Actor Schema

Fetch the Actor's input schema and details dynamically using mcpc:

export $(grep APIFY_TOKEN .env | xargs) && mcpc --json mcp.apify.com --header "Authorization: Bearer $APIFY_TOKEN" tools-call fetch-actor-details actor:="ACTOR_ID" | jq -r ".content"

Replace ACTOR_ID with the selected Actor (e.g., compass/crawler-google-places).

This returns:

  • Actor description and README
  • Required and optional input parameters
  • Output fields (if available)

Step 3: Ask User Preferences

Before running, ask:

  1. Output format:
    • Quick answer - Display top few results in chat (no file saved)
    • CSV - Full export with all fields
    • JSON - Full export in JSON format
  2. Number of results: Based on character of use case

Step 4: Run the Script

Quick answer (display in chat, no file):

node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  --actor "ACTOR_ID" \
  --input 'JSON_INPUT'

CSV:

node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  --actor "ACTOR_ID" \
  --input 'JSON_INPUT' \
  --output YYYY-MM-DD_OUTPUT_FILE.csv \
  --format csv

JSON:

node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  --actor "ACTOR_ID" \
  --input 'JSON_INPUT' \
  --output YYYY-MM-DD_OUTPUT_FILE.json \
  --format json

Step 5: Summarize Results and Offer Follow-ups

After completion, report:

  • Number of results found
  • File location and name
  • Key fields available
  • Suggested follow-up workflows based on results:

| If User Got | Suggest Next | |-------------|--------------| | Business listings | Enrich with vdrmota/contact-info-scraper or get reviews | | Influencer profiles | Analyze engagement with comment scrapers | | Competitor pages | Deep-dive with post/ad scrapers | | Trend data | Validate with platform-specific hashtag scrapers |

Error Handling

APIFY_TOKEN not found - Ask user to create .env with APIFY_TOKEN=your_token mcpc not found - Ask user to install npm install -g @apify/mcpc Actor not found - Check Actor ID spelling Run FAILED - Ask user to check Apify console link in error output Timeout - Reduce input size or increase --timeout

Limitations

  • Use this skill only when the task clearly matches the scope described above.
  • Do not treat the output as a substitute for environment-specific validation, testing, or expert review.
  • Stop and ask for clarification if required inputs, permissions, safety boundaries, or success criteria are missing.

Related Skills

View on GitHub
GitHub Stars46.9k
CategoryAutomation
Updated3d ago
Forks6.8k

Languages

Python

Trust signals

100/100

From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.

No cautions