Setup & Installation
What This Skill Does
Enumerates the request ids currently held in Crawlbase Cloud Storage through scroll-based pagination, up to 1000 rids per call. Each token has its own silo, so normal and JS-token storage are listed separately. Scroll sessions continue via a scroll_id token and expire after about 15 seconds of inactivity.
It turns Cloud Storage from a write-only bucket into something an agent can inventory and drive bulk operations against, without keeping its own index of rids.
When to use it
- Seeing everything currently stored under a Crawlbase token
- Finding rids you no longer remember before a storage-get call
- Iterating over stored items page by page for batch processing
- Enumerating the JS-token silo separately from the normal one
More from Crawlbase
The MCP server behind these skills (npm @crawlbase/mcp). Connects AI agents and LLMs to real-time web data with JavaScript rendering, automatic proxy rotation, and anti-bot protection. Works with Claude, Cursor, and Windsurf.
LangChain document loader, tool, and retriever backed by the Crawlbase Crawling API. Returns clean Markdown documents ready for chunking (pip install langchain-crawlbase).
Native Crawlbase node for n8n. Adds Crawling API credentials and options like JS rendering, geo-targeting, screenshots, and storage to your workflows without hand-wiring HTTP Request nodes.