Firecrawl Site Mapper

Discover all URLs on a website using Firecrawl's Map endpoint. Perfect for competitor analysis, site audits, and content gap discovery.

Features

Fast URL Discovery - Quickly map entire websites using Firecrawl's Map API
Search-Based Filtering - Find specific pages by topic or keyword (e.g., "pricing", "api", "blog")
Sitemap Integration - Include URLs from XML sitemaps
Geo-Targeting - Crawl from specific countries for localized content
Multi-Language Support - Specify preferred languages for discovery
Demo Mode - Test without an API key using sample data

Use Cases

Competitor Analysis - Find all pricing, features, and blog pages on competitor sites
Site Audits - Discover all pages on a website for SEO audits
Content Gap Analysis - Map competitor content to identify opportunities
Migration Planning - Get a complete URL inventory before site redesigns
Link Building - Find relevant pages for outreach campaigns

Input

Field	Type	Description	Default
url	string	Website URL to map	Required
search	string	Filter results by keyword/topic	-
limit	number	Maximum URLs to discover	100
includeSitemap	boolean	Include URLs from sitemap	true
country	string	Country code for geo-targeting	-
firecrawlApiKey	string	Your Firecrawl API key	-
demoMode	boolean	Run with sample data	false

Output

{
  "success": true,
  "url": "https://example.com",
  "search": "pricing",
  "totalUrls": 5,
  "urls": [
    {
      "url": "https://example.com/pricing",
      "title": "Pricing Plans",
      "description": "View our flexible pricing options"
    }
  ],
  "mappedAt": "2024-01-15T10:30:00Z"
}

Pricing

Event	Description	Price
Site Mapped	Charged when a site is mapped	$0.01
URLs Discovered (per 10)	Charged per 10 URLs discovered	$0.001

Examples

Map All Pricing Pages

{
  "url": "https://competitor.com",
  "search": "pricing",
  "limit": 50
}

Complete Site Discovery

{
  "url": "https://example.com",
  "limit": 1000,
  "includeSitemap": true
}

Related Actors

Firecrawl Website Crawler - Full website crawling with content extraction
Firecrawl Competitive Intelligence - Competitor pricing and features analysis

Built by John Rippy

Keywords

firecrawl, site mapper, url discovery, sitemap, competitor analysis, site audit, seo tools, content gap, url finder, web crawler