Ask AI About
Any Website or Page with One API

Retrieve structured data from a single page or an entire website, along with high-quality screenshots.

One API to Get it All

Simply specify what you need to extract from a webpage or an entire website, and receive structured data instantly.

POST https://api.crawly.dev/crawl

{
	"url": "https://justcms.co",
	"scan": "full",
	"prompt": "Your a professinal marketing specialist. Your task is to create marketing materials. Make best possible variants.",
	"data": [
		{
			"key": "name",
			"description": "Short name of a website, 5-20 symbols max",
			"type": "string"
		},
		{
			"key": "pitchlines",
			"description": "Pichlines for the project, should reflect the main point of the project. Minimum 5 variants, each maximum 80 chars",
			"type": "array"
		},
		{
			"key": "features",
			"description": "5 more important features of this project.",
			"type": "array"
		},
		{
			"key": "description",
			"description": "Brief description of the project. Up to 500 characters long.",
			"type": "string"
		}
	]
}
{
	"url": "https://justcms.co",
	"screenshot": "https://cdn.crawly.dev/screenshots/2025-03/m0S1mpKaTO4VloYhnVvOB.png",
	"data": {
		"name": "JustCMS",
		"pitchlines": [
			"Create content faster with AI assistance",
			"Revolutionize your content workflow",
			"AI-driven content management for busy people",
			"Generate high-quality articles in minutes",
			"Streamline your content creation journey"
		],
		"features": [
			"AI-powered content generation",
			"Fast and scalable architecture",
			"REST API for easy integration",
			"Customizable AI style settings",
			"Image generation and suggestions"
		],
		"description": "JustCMS is an AI-driven headless content management system that streamlines content creation and management. It offers fast, scalable, and secure solutions tailored for developers and content creators, allowing users to generate high-quality articles, manage projects effortlessly, and create visually engaging content quickly."
	}
}

Supports Any Type You Need

Specify the data types you need to extract from a webpage or an entire website, and receive structured data instantly.

number

Numeric values for quantities, counts, measurements, etc.

"type": "number"

string

Text content like descriptions, names, or paragraphs.

"type": "string"

list

Collections of items like features, benefits, or points.

"type": "list"

boolean

True/false values for flags, options, or conditions.

"type": "boolean"

Full Scan 🔍 for Deeper Website Insights

Crawly supports both page-level extraction and full-site scanning to provide comprehensive context about a website. It intelligently gathers all links from the initial page, analyzes the most relevant ones, and explores them for deeper insights. If you need a complete picture of a website, the full scan is the perfect solution.

📸 Full-Size, High-Quality Screenshots

Crawly captures full-page, high-resolution screenshots that you can use anywhere. Simply grab the link from the API response to download and use the screenshot as needed.

💰 Affordable & Pay-As-You-Go

Get 100 requests for just $3 – no subscriptions, no commitments. Use Crawly only when you need it and pay only for what you use. Simple as that.

Copyright © 2025 Crawly.dev. All rights reserved.