scrapy_cloud_get_collection_records
Read records of a Scrapy Cloud collection, each with its '_key' and '_ts' write time in milliseconds. Select by exact keys, by key prefix (indexed, fast) or by write-time window; otherwise reads from the start and also reports the record count ('total', or 'total_at_least' for a very large collection). Long strings are truncated to 'max_chars'. Output passes through the conversation, so beyond a small sample use the storage REST API instead.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| key | No | Only these record keys. | |
| type | No | Collection type: 's' store (default), 'cs' cached store (records expire after a month), 'vs' versioned store, 'vcs' versioned cached store. | s |
| count | No | Maximum number of records to return. | |
| endts | No | Only records written before this UNIX timestamp, in milliseconds. | |
| prefix | No | Only records whose key starts with this prefix; uses an index, prefer it over scanning. | |
| startts | No | Only records written at or after this UNIX timestamp, in milliseconds. | |
| max_chars | No | Truncate string values longer than this; 0 disables truncation. | |
| collection | Yes | Collection name, as listed by scrapy_cloud_list_collections. | |
| project_id | Yes | Scrapy Cloud project id (the numeric id in the dashboard URL). |