Web Page Scraper

POST/api/v1/tools/web-scrape3 credits per callscrapescraperextracthtmlparsecrawlcontent

Downloads a page through the SSRF-guarded client and returns its structure: title, meta description, canonical, language, Open Graph tags, every heading, deduplicated links marked internal/external and nofollow, images with alt text, and the readable text with a word count. An optional simple selector (tag name, .class or #id) returns just the text of matching elements.

receipt_long

Why 3 credits?

Downloads and parses a whole page, which is several times the work of a metadata-only fetch.

Any HTTP client works. Replace the key with one from your dashboard.

bash

curl -X POST https://toolkitbackend-j69m.onrender.com/api/v1/tools/web-scrape \
  -H "Authorization: Bearer tb_live_<your_api_key>" \
  -H "Content-Type: application/json" \
  -d '{
  "url": "https://example.com",
  "selector": ".product-title",
  "includeText": true
}'

Input

Field	Type	Required	Default	Description
`url`	string	required	-	Absolute http(s) address of the page.
`selector`	string	optional	-	Optional simple selector: a tag name, .class or #id. Full CSS is not supported.
`includeText`	boolean	optional	true	Include the page's readable text. Turn off for a smaller response.

Output

Field	Type	Description
`finalUrl`	string	Address after redirects.
`statusCode`	integer	HTTP status returned.
`title`	string	Document title.
`metaDescription`	string	Meta description, when present.
`canonical`	string	Canonical URL, when declared.
`headings`	array	Every heading with its level.
`links`	array	Deduplicated links with text, internal flag and nofollow flag.
`images`	array	Image URLs with alt text and declared dimensions.
`openGraph`	object	og: tags as key/value pairs.
`selectorMatches`	array	Text of nodes matching the selector, when one was given.
`text`	string	Readable page text, truncated.
`wordCount`	integer	Words in the readable text.

Try it

Sends a real POST /api/v1/tools/web-scrape from your browser and charges 3 credits to your account.