Summary This source did not publish a separate summary. Review SKILL.md before using the skill.
Universal Web Scraper
AI-driven data extraction from 55+ Actors across all major platforms. This skill automatically selects the best Actor for your task.
When to Use
The user needs web data extraction but has not yet chosen a specific Apify Actor.
You need a general-purpose Apify entry point that maps a broad scraping goal to the most suitable Actor.
The task spans multiple platforms and benefits from one unified workflow for actor selection, execution, and summarization.
Prerequisites
(No need to check it upfront)
.env file with APIFY_TOKENNode.js 20.6+ (for native --env-file support)
mcpc CLI tool: npm install -g @apify/mcpc
Workflow
Copy this checklist and track progress:
Task Progress:
- [ ] Step 1: Understand user goal and select Actor
- [ ] Step 2: Fetch Actor schema via mcpc
- [ ] Step 3: Ask user preferences (format, filename)
- [ ] Step 4: Run the scraper script
- [ ] Step 5: Summarize results and offer follow-ups
Step 1: Understand User Goal and Select Actor
First, understand what the user wants to achieve. Then select the best Actor from the options below.
Instagram Actors (12)
Actor ID Best For apify/instagram-profile-scraperProfile data, follower counts, bio info apify/instagram-post-scraperIndividual post details, engagement metrics apify/instagram-comment-scraperComment extraction, sentiment analysis apify/instagram-hashtag-scraperHashtag content, trending topics apify/instagram-hashtag-statsHashtag performance metrics apify/instagram-reel-scraperReels content and metrics
apify/instagram-search-scraperSearch users, places, hashtags
apify/instagram-tagged-scraperPosts tagged with specific accounts
apify/instagram-followers-count-scraperFollower count tracking
apify/instagram-scraperComprehensive Instagram data
apify/instagram-api-scraperAPI-based Instagram access
apify/export-instagram-comments-postsBulk comment/post export
Facebook Actors (14) Actor ID Best For apify/facebook-pages-scraperPage data, metrics, contact info apify/facebook-page-contact-informationEmails, phones, addresses from pages apify/facebook-posts-scraperPost content and engagement apify/facebook-comments-scraperComment extraction apify/facebook-likes-scraperReaction analysis apify/facebook-reviews-scraperPage reviews apify/facebook-groups-scraperGroup content and members apify/facebook-events-scraperEvent data apify/facebook-ads-scraperAd creative and targeting apify/facebook-search-scraperSearch results apify/facebook-reels-scraperReels content apify/facebook-photos-scraperPhoto extraction apify/facebook-marketplace-scraperMarketplace listings apify/facebook-followers-following-scraperFollower/following lists
TikTok Actors (14) Actor ID Best For clockworks/tiktok-scraperComprehensive TikTok data clockworks/free-tiktok-scraperFree TikTok extraction clockworks/tiktok-profile-scraperProfile data clockworks/tiktok-video-scraperVideo details and metrics clockworks/tiktok-comments-scraperComment extraction clockworks/tiktok-followers-scraperFollower lists clockworks/tiktok-user-search-scraperFind users by keywords clockworks/tiktok-hashtag-scraperHashtag content clockworks/tiktok-sound-scraperTrending sounds clockworks/tiktok-ads-scraperAd content clockworks/tiktok-discover-scraperDiscover page content clockworks/tiktok-explore-scraperExplore content clockworks/tiktok-trends-scraperTrending content clockworks/tiktok-live-scraperLive stream data
YouTube Actors (5) Actor ID Best For streamers/youtube-scraperVideo data and metrics streamers/youtube-channel-scraperChannel information streamers/youtube-comments-scraperComment extraction streamers/youtube-shorts-scraperShorts content streamers/youtube-video-scraper-by-hashtagVideos by hashtag
Google Maps Actors (4) Actor ID Best For compass/crawler-google-placesBusiness listings, ratings, contact info compass/google-maps-extractorDetailed business data compass/Google-Maps-Reviews-ScraperReview extraction poidata/google-maps-email-extractorEmail discovery from listings
Other Actors (6) Actor ID Best For apify/google-search-scraperGoogle search results apify/google-trends-scraperGoogle Trends data voyager/booking-scraperBooking.com hotel data voyager/booking-reviews-scraperBooking.com reviews maxcopell/tripadvisor-reviewsTripAdvisor reviews vdrmota/contact-info-scraperContact enrichment from URLs
Actor Selection by Use Case Use Case Primary Actors Lead Generation compass/crawler-google-places, poidata/google-maps-email-extractor, vdrmota/contact-info-scraperInfluencer Discovery apify/instagram-profile-scraper, clockworks/tiktok-profile-scraper, streamers/youtube-channel-scraperBrand Monitoring apify/instagram-tagged-scraper, apify/instagram-hashtag-scraper, compass/Google-Maps-Reviews-ScraperCompetitor Analysis apify/facebook-pages-scraper, apify/facebook-ads-scraper, apify/instagram-profile-scraperContent Analytics apify/instagram-post-scraper, clockworks/tiktok-scraper, streamers/youtube-scraperTrend Research apify/google-trends-scraper, clockworks/tiktok-trends-scraper, apify/instagram-hashtag-statsReview Analysis compass/Google-Maps-Reviews-Scraper, voyager/booking-reviews-scraper, maxcopell/tripadvisor-reviewsAudience Analysis apify/instagram-followers-count-scraper, clockworks/tiktok-followers-scraper, apify/facebook-followers-following-scraper
Multi-Actor Workflows For complex tasks, chain multiple Actors:
Workflow Step 1 Step 2 Lead enrichment compass/crawler-google-places →vdrmota/contact-info-scraperInfluencer vetting apify/instagram-profile-scraper →apify/instagram-comment-scraperCompetitor deep-dive apify/facebook-pages-scraper →apify/facebook-posts-scraperLocal business analysis compass/crawler-google-places →compass/Google-Maps-Reviews-Scraper
Can't Find a Suitable Actor? If none of the Actors above match the user's request, search the Apify Store directly:
export $(grep APIFY_TOKEN .env | xargs) && mcpc --json mcp.apify.com --header "Authorization: Bearer $APIFY_TOKEN" tools-call search-actors keywords:="SEARCH_KEYWORDS" limit:=10 offset:=0 category:="" | jq -r '.content[0].text'
Replace SEARCH_KEYWORDS with 1-3 simple terms (e.g., "LinkedIn profiles", "Amazon products", "Twitter").
Step 2: Fetch Actor Schema Fetch the Actor's input schema and details dynamically using mcpc:
export $(grep APIFY_TOKEN .env | xargs) && mcpc --json mcp.apify.com --header "Authorization: Bearer $APIFY_TOKEN" tools-call fetch-actor-details actor:="ACTOR_ID" | jq -r ".content"
Replace ACTOR_ID with the selected Actor (e.g., compass/crawler-google-places).
Actor description and README
Required and optional input parameters
Output fields (if available)
Step 3: Ask User Preferences
Output format :
Quick answer - Display top few results in chat (no file saved)CSV - Full export with all fieldsJSON - Full export in JSON format
Number of results : Based on character of use case
Step 4: Run the Script Quick answer (display in chat, no file):
node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
--actor "ACTOR_ID" \
--input 'JSON_INPUT'
node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
--actor "ACTOR_ID" \
--input 'JSON_INPUT' \
--output YYYY-MM-DD_OUTPUT_FILE.csv \
--format csv
node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
--actor "ACTOR_ID" \
--input 'JSON_INPUT' \
--output YYYY-MM-DD_OUTPUT_FILE.json \
--format json
Step 5: Summarize Results and Offer Follow-ups After completion, report:
Number of results found
File location and name
Key fields available
Suggested follow-up workflows based on results: If User Got Suggest Next Business listings Enrich with vdrmota/contact-info-scraper or get reviews Influencer profiles Analyze engagement with comment scrapers Competitor pages Deep-dive with post/ad scrapers Trend data Validate with platform-specific hashtag scrapers
Error Handling APIFY_TOKEN not found - Ask user to create .env with APIFY_TOKEN=your_token
mcpc not found - Ask user to install npm install -g @apify/mcpc
Actor not found - Check Actor ID spelling
Run FAILED - Ask user to check Apify console link in error output
Timeout - Reduce input size or increase --timeout
Limitations
Use this skill only when the task clearly matches the scope described above.
Do not treat the output as a substitute for environment-specific validation, testing, or expert review.
Stop and ask for clarification if required inputs, permissions, safety boundaries, or success criteria are missing.
