🔴 Reddit Scraper - Posts, Comments & Subreddit Data
"Posts, Comments & Subreddit Intelligence" by John Rippy | johnrippy.link🏆 2025 Zapier Automation Hero of the Year — Project Phoenix: A 95-step AI sales pipeline cutting development time by 50%. Read more →
---
Scrape Reddit posts, comments, and subreddit data. Search across Reddit, extract discussions, track trending topics, and monitor specific communities.
Features
✅ Subreddit Scraping - Extract posts from any public subreddit
✅ Reddit Search - Search across all of Reddit for specific topics
✅ Comment Extraction - Get full comment threads with author data
✅ Flexible Sorting - Hot, New, Top, Rising with time filters
✅ Upvote Filtering - Only get posts above a threshold
✅ Demo Mode - Test with sample data before real scraping
✅ Webhook Support - Send results to Zapier, Make, n8n
✅ Residential Proxies - Reliable scraping with Apify proxies
Use Cases
📊 Market Research - Find what people are saying about your industry
💡 Content Ideas - Discover trending topics and questions
🔍 Competitor Analysis - Monitor discussions about competitors
📈 Trend Tracking - Follow emerging topics in your niche
💬 Sentiment Analysis - Understand community opinions
🎯 Lead Generation - Find people asking for recommendations
How It Works
┌─────────────────────────────────────────────────┐
│ Reddit Scraper │
├─────────────────────────────────────────────────┤
│ │
│ Subreddits ─────┐ │
│ ├──► Fetch Posts ──► Filter │
│ Search Query ───┘ │ │ │
│ ▼ ▼ │
│ Parse Post Data │
│ │ │
│ ▼ │
│ ┌──────────────────┐ │
│ │ Extract Comments │ (optional)│
│ └──────────────────┘ │
│ │ │
│ ▼ │
│ Dataset + Webhook │
│ │
└─────────────────────────────────────────────────┘
Input Schema
Output Schema
Each post in the dataset includes:
Comment Schema
Example Inputs
Scrape Subreddits (Hot Posts)
{
"subreddits": ["SEO", "marketing", "smallbusiness"],
"sortBy": "hot",
"maxPosts": 25
}
Search Reddit
{
"searchQuery": "best CRM for small business",
"sortBy": "top",
"timeFilter": "month",
"maxPosts": 50
}
With Comments
{
"subreddits": ["LocalSEO"],
"sortBy": "top",
"timeFilter": "week",
"maxPosts": 10,
"includeComments": true,
"maxCommentsPerPost": 20
}
High-Quality Posts Only
{
"subreddits": ["entrepreneur", "startups"],
"sortBy": "top",
"timeFilter": "month",
"maxPosts": 25,
"minUpvotes": 100
}
Quick Test
{
"demoMode": true
}
With Webhook
{
"subreddits": ["webdev"],
"maxPosts": 20,
"webhookUrl": "https://hooks.zapier.com/hooks/catch/123456/abcdef/"
}
Example Output
Post Without Comments
{
"id": "1abc123",
"title": "What SEO tools do you use daily?",
"author": "seomarketer99",
"subreddit": "SEO",
"url": "https://reddit.com/r/SEO/comments/1abc123",
"permalink": "/r/SEO/comments/1abc123/what_seo_tools_do_you_use_daily/",
"selftext": "I'm looking to streamline my workflow. Currently using Ahrefs and Screaming Frog...",
"score": 142,
"upvoteRatio": 0.94,
"numComments": 87,
"createdUtc": "2024-12-20T14:30:00Z",
"isNsfw": false,
"isSpoiler": false,
"flair": "Discussion",
"scrapedAt": "2024-12-24T10:00:00Z"
}
Post With Comments
{
"id": "1abc123",
"title": "What SEO tools do you use daily?",
"author": "seomarketer99",
"subreddit": "SEO",
"score": 142,
"numComments": 87,
"comments": [
{
"id": "c1",
"author": "agencyowner",
"body": "Ahrefs is non-negotiable. Also love Surfer SEO for content optimization.",
"score": 45,
"createdUtc": "2024-12-20T15:00:00Z",
"depth": 0
},
{
"id": "c2",
"author": "freelancerseo",
"body": "Have you tried Semrush? I switched from Ahrefs and prefer it now.",
"score": 23,
"createdUtc": "2024-12-20T15:30:00Z",
"depth": 1
}
],
"scrapedAt": "2024-12-24T10:00:00Z"
}
Pricing
Pay-per-event model:
Example costs:- 100 posts without comments = $0.50
- 100 posts with comments = $0.50 + $1.00 = $1.50
- 5 searches = $0.10
Popular Subreddits by Category
Business & Marketing
SEO,marketing,smallbusiness,entrepreneur,startupssocialmedia,PPC,content_marketing,digital_marketing
Tech & Development
webdev,javascript,programming,web_design,SaaS
Local Business
LocalSEO,realestate,restaurantowners,HomeImprovement
E-commerce
ecommerce,dropship,FulfillmentByAmazon,Etsy
Best Practices
1. Start with demo mode - Test before using real scraping
2. Use specific subreddits - More targeted = better results
3. Time filters for top - "week" or "month" for quality content
4. Be mindful of rate limits - Don't scrape too aggressively
5. Comments add value - Enable for discussion threads
6. Filter by upvotes - Quality over quantity
Integrations
Zapier/Make/n8n
Add your webhook URL to receive data when scraping completes:
{
"webhookUrl": "https://hooks.zapier.com/hooks/catch/..."
}
Content Pipeline
Combine with SEO News Aggregator for comprehensive content research.
Sentiment Analysis
Export data to AI tools for sentiment scoring and topic analysis.
---
Built by John Rippy | johnrippy.link🏆 2025 Zapier Automation Hero of the Year — Project Phoenix: A 95-step AI sales pipeline cutting development time by 50%. Read more →
