Add requests
POST/v2/request-queues/:queueId/requests/batch
Adds requests to the queue in batch. The maximum requests in batch is limit
to 25. The response contains an array of unprocessed and processed requests.
If any add operation fails because the request queue rate limit is exceeded
or an internal failure occurs,
the failed request is returned in the unprocessedRequests response
parameter.
You can resend these requests to add. It is recommended to use exponential
backoff algorithm for these retries.
If a request with the same uniqueKey was already present in the queue,
then it returns an ID of the existing request.
Request
Path Parameters
Queue ID or username~queue-name.
WkzbQMuFYuamGv3YFQuery Parameters
A unique identifier of the client accessing the request queue. It must
be a string between 1 and 32 characters long. This identifier is used to
determine whether the queue was accessed by multiple clients. If
clientKey is not provided,
the system considers this API call to come from a new client. For
details, see the hadMultipleClients field returned by the Get
head operation.
client-abcDetermines if request should be added to the head of the queue or to the
end. Default value is false (end of queue).
falseBody arrayrequired
- uniqueKey UniqueKey (string)
A unique key used for request de-duplication. Requests with the same unique key are considered identical.
Example:GET|60d83e70|e3b0c442|https://apify.com - url string<uri>
The URL of the request.
Example:https://apify.com - method HttpMethod (string)
Possible values: [
Example:GET,HEAD,POST,PUT,DELETE,CONNECT,OPTIONS,TRACE,PATCH]GET - retryCount RetryCount (integer)
The number of times this request has been retried.
Example:0 - loadedUrl string,null<uri> nullable
The final URL that was loaded, after redirects (if any).
Example:https://apify.com/jobs - payload object | null nullable
The request payload, typically used with POST or PUT requests.
Example:null - headers object | null nullable
HTTP headers sent with the request.
Example:null userData object
Custom user data attached to the request. Can contain arbitrary fields.
- label string | null nullable
Optional label for categorizing the request.
Example:DETAIL - image string,null<uri> nullable
Optional image URL associated with the request.
Example:https://picserver1.eu - property name* any
Custom user data attached to the request. Can contain arbitrary fields.
- label string | null nullable
- noRetry boolean | null nullable
Indicates whether the request should not be retried if processing fails.
Example:false - errorMessages string[] nullable
Error messages recorded from failed processing attempts.
Example:null - handledAt string,null<date-time> nullable
The timestamp when the request was marked as handled, if applicable.
Example:2019-06-16T10:23:31.607Z
Status 201
Response Headers
{
"data": {
"processedRequests": [
{
"requestId": "YiKoxjkaS9gjGTqhF",
"uniqueKey": "http://example.com",
"wasAlreadyPresent": true,
"wasAlreadyHandled": false
}
],
"unprocessedRequests": [
{
"uniqueKey": "http://example.com/2",
"url": "http://example.com/2",
"method": "GET"
}
]
}
}
Schema
data object required
Result of a batch add operation containing successfully processed and failed requests.
processedRequests object[] required
Requests that were successfully added to the request queue.
- requestId RequestId (string) required
A unique identifier assigned to the request.
Example:sbJ7klsdf7ujN9l - uniqueKey UniqueKey (string) required
A unique key used for request de-duplication. Requests with the same unique key are considered identical.
Example:GET|60d83e70|e3b0c442|https://apify.com - wasAlreadyPresent WasAlreadyPresent (boolean) required
Indicates whether a request with the same unique key already existed in the request queue. If true, no new request was created.
Example:false - wasAlreadyHandled WasAlreadyHandled (boolean) required
Indicates whether a request with the same unique key has already been processed by the request queue.
Example:false
- requestId RequestId (string) required
unprocessedRequests object[] required
Requests that failed to be added and can be retried.
- id RequestId (string)
A unique identifier assigned to the request.
Example:sbJ7klsdf7ujN9l - uniqueKey UniqueKey (string) required
A unique key used for request de-duplication. Requests with the same unique key are considered identical.
Example:GET|60d83e70|e3b0c442|https://apify.com - url string<uri> required
The URL of the request.
Example:https://apify.com - method HttpMethod (string)
Possible values: [
Example:GET,HEAD,POST,PUT,DELETE,CONNECT,OPTIONS,TRACE,PATCH]GET
- id RequestId (string)
Status 400
Bad request - invalid input parameters or request body.
{
"error": {
"type": "invalid-input",
"message": "Invalid input: The request body contains invalid data."
}
}
Schema
error object required
- type string requiredExample:
run-failed - message string requiredExample:
Actor run did not succeed (run ID: 55uatRrZib4xbZs, status: FAILED)
- type string requiredExample:
Status 401
Unauthorized - authentication required or invalid token.
{
"error": {
"type": "token-not-valid",
"message": "Authentication token is not valid."
}
}
Schema
error object required
- type string requiredExample:
run-failed - message string requiredExample:
Actor run did not succeed (run ID: 55uatRrZib4xbZs, status: FAILED)
- type string requiredExample:
Status 403
Forbidden - insufficient permissions to perform this action.
{
"error": {
"type": "permission-denied",
"message": "You do not have permission to perform this action."
}
}
Schema
error object required
- type string requiredExample:
run-failed - message string requiredExample:
Actor run did not succeed (run ID: 55uatRrZib4xbZs, status: FAILED)
- type string requiredExample:
Status 404
Not found - the requested resource was not found.
{
"error": {
"type": "record-not-found",
"message": "Request Queue was not found"
}
}
Schema
error object
- type string
Possible values: [
record-not-found] - message stringExample:
Request Queue was not found
- type string
Status 405
Method not allowed.
{
"error": {
"type": "method-not-allowed",
"message": "This API end-point can only be accessed using the following HTTP methods: OPTIONS,GET"
}
}
Schema
error object required
- type string requiredExample:
run-failed - message string requiredExample:
Actor run did not succeed (run ID: 55uatRrZib4xbZs, status: FAILED)
- type string requiredExample:
Status 413
Payload too large - the request body exceeds the size limit.
{
"error": {
"type": "request-too-large",
"message": "The POST payload is too large (limit: 9437184 bytes, actual length: 10485760 bytes)."
}
}
Schema
error object required
- type string requiredExample:
run-failed - message string requiredExample:
Actor run did not succeed (run ID: 55uatRrZib4xbZs, status: FAILED)
- type string requiredExample:
Status 415
Unsupported media type - the Content-Encoding of the request is not supported.
{
"error": {
"type": "unsupported-content-encoding",
"message": "Content-Encoding \"bla\" is not supported."
}
}
Schema
error object required
- type string requiredExample:
run-failed - message string requiredExample:
Actor run did not succeed (run ID: 55uatRrZib4xbZs, status: FAILED)
- type string requiredExample:
Status 429
Too many requests - rate limit exceeded.
{
"error": {
"type": "rate-limit-exceeded",
"message": "You have exceeded the rate limit. Please try again later."
}
}
Schema
error object required
- type string requiredExample:
run-failed - message string requiredExample:
Actor run did not succeed (run ID: 55uatRrZib4xbZs, status: FAILED)
- type string requiredExample: