DocumentationAPI Reference
    Get API keyOpenAPI specPython SDKJavaScript SDK
    API StatusGitHubDiscord

    Extract API

    The Extract API fetches a URL and returns the page as structured data: title, text, metadata. Your agent reads content, not HTML.

    text
    GET https://api.desearch.ai/web/crawl
    bash
    curl --request GET 'https://api.desearch.ai/web/crawl?url=https://example.com/article' \ --header "Authorization: $DESEARCH_API_KEY"

    Each call fetches the current version of the page, not a cached snapshot, which makes it suitable for monitoring pages that change.

    ParameterTypeNotes
    urlstringThe page to fetch. Required.
    formatstringOutput format for the extracted content.
    jsboolRender JavaScript before extracting.
    waitintMilliseconds to wait after load before extracting.

    Response fields and errors are in the API Reference. How our crawler identifies itself and respects robots.txt is documented at desearch.ai/crawler.