Crawl URLs

Crawls the specified URLs, extracts records from them, and adds them to the index. If a crawl is currently running (the crawler’s reindexing property is true), the records are added to a temporary index.

Authorizations

Authorization

string

headerrequired

Basic authentication header of the form Basic <encoded-value>, where <encoded-value> is the base64-encoded string username:password.

Path Parameters

id

string

required

Crawler ID.

Body

application/json

urls

string[]

required

URLs to crawl.

save

boolean

Whether the specified URLs should be added to the extraURLs property of the crawler configuration. If unspecified, the URLs are added to the extraUrls field only if they haven't been indexed during the last reindex.

Response

200 - application/json

taskId

string

required

Universally unique identifier (UUID) of the task.