Scrape a web page or image from any URL using the ScraperAPI services, bypassing anti-bot protections.
Use this tool to retrieve the content of a web page or download an image from a given URL. It handles CAPTCHAs, IP blocks, and rate limits automatically via ScraperAPI's proxy infrastructure.
When to use:
- Extracting text content from web pages (articles, product listings, search results, etc.)
- Downloading images from URLs (returns the image directly if the URL points to an image file)
- Scraping geo-restricted content by specifying a country code
- Retrieving structured data (CSV/JSON) from supported websites with autoparse enabled
When NOT to use:
- For URLs that require authentication or login (ScraperAPI cannot access authenticated sessions)
- For non-HTTP resources (e.g., FTP, local files)
- When you already have the content and don't need to fetch it again (this tool is rate-limited)
Args:
params (Scrape): Validated input parameters containing:
- url (AnyUrl): The full URL to scrape (e.g. 'https://example.com/page')
- render (bool): Enable JavaScript rendering for dynamic pages (default: false)
- country_code (Optional[str]): ISO 3166-1 alpha-2 code for geo-targeted scraping (e.g. 'us', 'gb')
- premium (bool): Use premium proxies for difficult sites (default: false)
- ultra_premium (bool): Use ultra-premium proxies for heavily protected sites (default: false)
- device_type (Optional[DeviceType]): 'mobile' or 'desktop' User-Agent emulation
- output_format (OutputFormat): Response format — 'markdown' (default), 'text', 'csv', or 'json'
- autoparse (bool): Enable structured data extraction for supported sites (default: false)
Returns:
For web pages: str containing the page content in the requested output_format.
- 'markdown': Clean, readable markdown extracted from the page HTML
- 'text': Plain text without any formatting
- 'csv': Comma-separated values (requires autoparse=true on supported sites)
- 'json': JSON string (requires autoparse=true on supported sites)
For image URLs: Image object with binary image data (JPEG, PNG, GIF, WebP, BMP, TIFF, or SVG).
Images larger than ~700KB are rejected.
Raises:
ToolError: If the API key is not configured, rate limit is exceeded, or the scrape operation fails.
Retrieve parsed Google Search (SERP) results for a query.
Returns the organic results, ads, related searches, knowledge panels, and
pagination for a Google web search — already parsed into structured JSON —
without you having to scrape and parse the SERP HTML yourself.
When to use:
- Programmatic SERP data: rankings, titles, links, snippets for a keyword
- SEO/rank tracking, competitive research, or answer-engine grounding
- Time- or date-bounded searches (recent news-like results, date ranges)
When NOT to use:
- Fetching the content of a specific known URL (use the 'scrape' tool)
- Google News, Jobs, Shopping, or Maps — use the dedicated tool for each
Args:
params (GoogleSearchParams): query (required) plus optional
localization (country_code, gl, hl, uule), pagination (num, start),
date filters (date_range_start/end, time_period), tld, output_format,
include_html, and tbs.
Returns:
str: JSON (default) or CSV containing the structured search results.
Raises:
ToolError: If the API key is missing, the rate limit is exceeded, or
the request fails.
Retrieve parsed Google News results for a query.
Returns structured news articles (title, source, link, timestamp, snippet)
for a query from Google News.
When to use:
- Monitoring news coverage or headlines for a topic, brand, or entity
- Time-bounded news scans (last hour/day/week or a custom date range)
When NOT to use:
- General web results (use 'google_search')
- Reading the full text of a specific article (use 'scrape' on its URL)
Args:
params (GoogleNewsParams): query (required) plus optional localization,
pagination, date filters (date_range_start/end, time_period), tld,
and output_format.
Returns:
str: JSON (default) or CSV containing the structured news results.
Raises:
ToolError: If the API key is missing, the rate limit is exceeded, or
the request fails.
Retrieve parsed Google Jobs listings for a query.
Returns structured job postings (title, company, location, posting age,
source) from the Google Jobs widget for a query.
When to use:
- Aggregating job listings for a role, company, or location
- Labor-market or hiring research
When NOT to use:
- General web or news results (use 'google_search' / 'google_news')
Args:
params (GoogleJobsParams): query (required) plus optional localization
(country_code, gl, hl, uule), pagination (num, start), tld, and
output_format.
Returns:
str: JSON (default) or CSV containing the structured job listings.
Raises:
ToolError: If the API key is missing, the rate limit is exceeded, or
the request fails.
Retrieve parsed Google Shopping product results for a query.
Returns structured shopping listings (product title, price, merchant,
rating, link) from Google Shopping for a query.
When to use:
- Price comparison and product discovery across merchants
- Market/pricing research for a product keyword
When NOT to use:
- A specific marketplace's own data — use the Amazon/Walmart/eBay SDE tools
- General web results (use 'google_search')
Args:
params (GoogleShoppingParams): query (required) plus optional
localization, pagination, tld, output_format, and include_html.
Returns:
str: JSON (default) or CSV containing the structured shopping results.
Raises:
ToolError: If the API key is missing, the rate limit is exceeded, or
the request fails.
Retrieve parsed Google Maps place/business results for a query.
Returns structured local business/place results (name, address, rating,
reviews count, category, coordinates) from Google Maps for a query,
optionally centered on a latitude/longitude and zoom level.
When to use:
- Local business discovery ('coffee shops in Austin')
- Building local listings datasets; location-based competitive research
When NOT to use:
- Non-local web results (use 'google_search')
- Driving directions or routing (not provided by this endpoint)
Args:
params (GoogleMapsSearchParams): query, latitude, and longitude are
required; optional zoom, country_code, tld, output_format, and
include_html.
Returns:
str: JSON (default) or CSV containing the structured maps results.
Raises:
ToolError: If the API key is missing, the rate limit is exceeded, or
the request fails.
Retrieve parsed details for a single Amazon product by ASIN.
Returns structured product data — name, brand, pricing, images, feature
bullets, product information, review summary, category, coupon flags — for
one Amazon listing, already parsed from the product page.
When to use:
- You have a specific ASIN and want its full structured details
- Product monitoring, catalog enrichment, price/spec extraction
When NOT to use:
- You only have a search term, not an ASIN (use 'amazon_search' first)
- You need the list of sellers/offers for the product (use 'amazon_offers')
Args:
params (AmazonProductParams): asin (required) plus optional tld,
country_code, language, output_format, and include_html.
Returns:
str: JSON (default) or CSV containing the structured product data.
Raises:
ToolError: If the API key is missing, the rate limit is exceeded, or
the request fails.
Retrieve parsed Amazon search results for a query.
Returns structured search results — product name, price, rating, review
count, URL, image, Prime/best-seller/sponsored flags — plus pagination,
for a keyword search on Amazon.
When to use:
- Discovering products and their ASINs for a search term
- Price/market research and catalog building across a category
When NOT to use:
- You already have an ASIN (use 'amazon_product' / 'amazon_offers')
Args:
params (AmazonSearchParams): query (required) plus optional page,
sort_by, department, ref, tld, country_code, language, and
output_format.
Returns:
str: JSON (default) or CSV containing the structured search results.
Raises:
ToolError: If the API key is missing, the rate limit is exceeded, or
the request fails.
Retrieve the parsed list of seller offers for an Amazon product.
Returns structured offer listings for one ASIN — listing/shipping price,
condition, seller name and rating, Prime/FBA flags, and delivery info —
across the sellers offering that product.
When to use:
- Comparing sellers, prices, and conditions (new/used) for a known ASIN
- Buy-box / third-party seller and repricing analysis
When NOT to use:
- You want the product's own details (use 'amazon_product')
- You only have a search term (use 'amazon_search' to get the ASIN first)
Args:
params (AmazonOffersParams): asin (required) plus optional condition
filters (condition, f_new, f_used_like_new, f_used_very_good,
f_used_good, f_used_acceptable), tld, country_code, language, and
output_format.
Returns:
str: JSON (default) or CSV containing the structured offers.
Raises:
ToolError: If the API key is missing, the rate limit is exceeded, or
the request fails.
Retrieve parsed Walmart product search results for a query.
Returns structured search results — product name, price, rating, review
count, product ID, URL, image — plus pagination, for a keyword search on
Walmart.
When to use:
- Discovering products and their Walmart product IDs for a search term
- Price/market research and catalog building across a category
When NOT to use:
- You already have a product ID (use 'walmart_product' / 'walmart_review')
Args:
params (WalmartSearchParams): query (required) plus optional page,
tld, country_code, and output_format.
Returns:
str: JSON (default) or CSV containing the structured search results.
Raises:
ToolError: If the API key is missing, the rate limit is exceeded, or
the request fails.
Retrieve parsed details for a single Walmart product by product ID.
Returns structured product data — name, brand, pricing, availability,
specifications, images, and review summary — for one Walmart listing.
When to use:
- You have a Walmart product ID and want its full structured details
- Product monitoring, catalog enrichment, price/spec extraction
When NOT to use:
- You only have a search term (use 'walmart_search' first)
- You want the product's reviews (use 'walmart_review')
Args:
params (WalmartProductParams): product_id (required) plus optional
tld, country_code, and output_format.
Returns:
str: JSON (default) or CSV containing the structured product data.
Raises:
ToolError: If the API key is missing, the rate limit is exceeded, or
the request fails.
Browse parsed products within a Walmart category by category ID.
Returns a structured list of products in a Walmart category, with
pagination.
When to use:
- Exploring products within a specific Walmart department/category
- Building category-level catalogs or monitoring a category
When NOT to use:
- Free-text product discovery (use 'walmart_search')
Args:
params (WalmartCategoryParams): category (required) plus optional
page, tld, country_code, and output_format.
Returns:
str: JSON (default) or CSV containing the category product list.
Raises:
ToolError: If the API key is missing, the rate limit is exceeded, or
the request fails.
+16 more tools listed on main page