2024/10/01 - Agents for Amazon Bedrock - 1 new 3 updated api methods
Changes This release adds support to stop an ongoing ingestion job using the StopIngestionJob API in Agents for Amazon Bedrock.
Stops a currently running data ingestion job. You can send a StartIngestionJob request again to ingest the rest of your data when you are ready.
See also: AWS API Documentation
Request Syntax
client.stop_ingestion_job( dataSourceId='string', ingestionJobId='string', knowledgeBaseId='string' )
string
[REQUIRED]
The unique identifier of the data source for the data ingestion job you want to stop.
string
[REQUIRED]
The unique identifier of the data ingestion job you want to stop.
string
[REQUIRED]
The unique identifier of the knowledge base for the data ingestion job you want to stop.
dict
Response Syntax
{ 'ingestionJob': { 'dataSourceId': 'string', 'description': 'string', 'failureReasons': [ 'string', ], 'ingestionJobId': 'string', 'knowledgeBaseId': 'string', 'startedAt': datetime(2015, 1, 1), 'statistics': { 'numberOfDocumentsDeleted': 123, 'numberOfDocumentsFailed': 123, 'numberOfDocumentsScanned': 123, 'numberOfMetadataDocumentsModified': 123, 'numberOfMetadataDocumentsScanned': 123, 'numberOfModifiedDocumentsIndexed': 123, 'numberOfNewDocumentsIndexed': 123 }, 'status': 'STARTING'|'IN_PROGRESS'|'COMPLETE'|'FAILED'|'STOPPING'|'STOPPED', 'updatedAt': datetime(2015, 1, 1) } }
Response Structure
(dict) --
ingestionJob (dict) --
Contains information about the stopped data ingestion job.
dataSourceId (string) --
The unique identifier of the data source for the data ingestion job.
description (string) --
The description of the data ingestion job.
failureReasons (list) --
A list of reasons that the data ingestion job failed.
(string) --
ingestionJobId (string) --
The unique identifier of the data ingestion job.
knowledgeBaseId (string) --
The unique identifier of the knowledge for the data ingestion job.
startedAt (datetime) --
The time the data ingestion job started.
If you stop a data ingestion job, the startedAt time is the time the job was started before the job was stopped.
statistics (dict) --
Contains statistics about the data ingestion job.
numberOfDocumentsDeleted (integer) --
The number of source documents that were deleted.
numberOfDocumentsFailed (integer) --
The number of source documents that failed to be ingested.
numberOfDocumentsScanned (integer) --
The total number of source documents that were scanned. Includes new, updated, and unchanged documents.
numberOfMetadataDocumentsModified (integer) --
The number of metadata files that were updated or deleted.
numberOfMetadataDocumentsScanned (integer) --
The total number of metadata files that were scanned. Includes new, updated, and unchanged files.
numberOfModifiedDocumentsIndexed (integer) --
The number of modified source documents in the data source that were successfully indexed.
numberOfNewDocumentsIndexed (integer) --
The number of new source documents in the data source that were successfully indexed.
status (string) --
The status of the data ingestion job.
updatedAt (datetime) --
The time the data ingestion job was last updated.
If you stop a data ingestion job, the updatedAt time is the time the job was stopped.
{'ingestionJob': {'status': {'STOPPED', 'STOPPING'}}}
Gets information about a data ingestion job. Data sources are ingested into your knowledge base so that Large Lanaguage Models (LLMs) can use your data.
See also: AWS API Documentation
Request Syntax
client.get_ingestion_job( dataSourceId='string', ingestionJobId='string', knowledgeBaseId='string' )
string
[REQUIRED]
The unique identifier of the data source for the data ingestion job you want to get information on.
string
[REQUIRED]
The unique identifier of the data ingestion job you want to get information on.
string
[REQUIRED]
The unique identifier of the knowledge base for the data ingestion job you want to get information on.
dict
Response Syntax
{ 'ingestionJob': { 'dataSourceId': 'string', 'description': 'string', 'failureReasons': [ 'string', ], 'ingestionJobId': 'string', 'knowledgeBaseId': 'string', 'startedAt': datetime(2015, 1, 1), 'statistics': { 'numberOfDocumentsDeleted': 123, 'numberOfDocumentsFailed': 123, 'numberOfDocumentsScanned': 123, 'numberOfMetadataDocumentsModified': 123, 'numberOfMetadataDocumentsScanned': 123, 'numberOfModifiedDocumentsIndexed': 123, 'numberOfNewDocumentsIndexed': 123 }, 'status': 'STARTING'|'IN_PROGRESS'|'COMPLETE'|'FAILED'|'STOPPING'|'STOPPED', 'updatedAt': datetime(2015, 1, 1) } }
Response Structure
(dict) --
ingestionJob (dict) --
Contains details about the data ingestion job.
dataSourceId (string) --
The unique identifier of the data source for the data ingestion job.
description (string) --
The description of the data ingestion job.
failureReasons (list) --
A list of reasons that the data ingestion job failed.
(string) --
ingestionJobId (string) --
The unique identifier of the data ingestion job.
knowledgeBaseId (string) --
The unique identifier of the knowledge for the data ingestion job.
startedAt (datetime) --
The time the data ingestion job started.
If you stop a data ingestion job, the startedAt time is the time the job was started before the job was stopped.
statistics (dict) --
Contains statistics about the data ingestion job.
numberOfDocumentsDeleted (integer) --
The number of source documents that were deleted.
numberOfDocumentsFailed (integer) --
The number of source documents that failed to be ingested.
numberOfDocumentsScanned (integer) --
The total number of source documents that were scanned. Includes new, updated, and unchanged documents.
numberOfMetadataDocumentsModified (integer) --
The number of metadata files that were updated or deleted.
numberOfMetadataDocumentsScanned (integer) --
The total number of metadata files that were scanned. Includes new, updated, and unchanged files.
numberOfModifiedDocumentsIndexed (integer) --
The number of modified source documents in the data source that were successfully indexed.
numberOfNewDocumentsIndexed (integer) --
The number of new source documents in the data source that were successfully indexed.
status (string) --
The status of the data ingestion job.
updatedAt (datetime) --
The time the data ingestion job was last updated.
If you stop a data ingestion job, the updatedAt time is the time the job was stopped.
{'ingestionJobSummaries': {'status': {'STOPPED', 'STOPPING'}}}
Lists the data ingestion jobs for a data source. The list also includes information about each job.
See also: AWS API Documentation
Request Syntax
client.list_ingestion_jobs( dataSourceId='string', filters=[ { 'attribute': 'STATUS', 'operator': 'EQ', 'values': [ 'string', ] }, ], knowledgeBaseId='string', maxResults=123, nextToken='string', sortBy={ 'attribute': 'STATUS'|'STARTED_AT', 'order': 'ASCENDING'|'DESCENDING' } )
string
[REQUIRED]
The unique identifier of the data source for the list of data ingestion jobs.
list
Contains information about the filters for filtering the data.
(dict) --
The definition of a filter to filter the data.
attribute (string) -- [REQUIRED]
The name of field or attribute to apply the filter.
operator (string) -- [REQUIRED]
The operation to apply to the field or attribute.
values (list) -- [REQUIRED]
A list of values that belong to the field or attribute.
(string) --
string
[REQUIRED]
The unique identifier of the knowledge base for the list of data ingestion jobs.
integer
The maximum number of results to return in the response. If the total number of results is greater than this value, use the token returned in the response in the nextToken field when making another request to return the next batch of results.
string
If the total number of results is greater than the maxResults value provided in the request, enter the token returned in the nextToken field in the response in this field to return the next batch of results.
dict
Contains details about how to sort the data.
attribute (string) -- [REQUIRED]
The name of field or attribute to apply sorting of data.
order (string) -- [REQUIRED]
The order for sorting the data.
dict
Response Syntax
{ 'ingestionJobSummaries': [ { 'dataSourceId': 'string', 'description': 'string', 'ingestionJobId': 'string', 'knowledgeBaseId': 'string', 'startedAt': datetime(2015, 1, 1), 'statistics': { 'numberOfDocumentsDeleted': 123, 'numberOfDocumentsFailed': 123, 'numberOfDocumentsScanned': 123, 'numberOfMetadataDocumentsModified': 123, 'numberOfMetadataDocumentsScanned': 123, 'numberOfModifiedDocumentsIndexed': 123, 'numberOfNewDocumentsIndexed': 123 }, 'status': 'STARTING'|'IN_PROGRESS'|'COMPLETE'|'FAILED'|'STOPPING'|'STOPPED', 'updatedAt': datetime(2015, 1, 1) }, ], 'nextToken': 'string' }
Response Structure
(dict) --
ingestionJobSummaries (list) --
A list of data ingestion jobs with information about each job.
(dict) --
Contains details about a data ingestion job.
dataSourceId (string) --
The unique identifier of the data source for the data ingestion job.
description (string) --
The description of the data ingestion job.
ingestionJobId (string) --
The unique identifier of the data ingestion job.
knowledgeBaseId (string) --
The unique identifier of the knowledge base for the data ingestion job.
startedAt (datetime) --
The time the data ingestion job started.
statistics (dict) --
Contains statistics for the data ingestion job.
numberOfDocumentsDeleted (integer) --
The number of source documents that were deleted.
numberOfDocumentsFailed (integer) --
The number of source documents that failed to be ingested.
numberOfDocumentsScanned (integer) --
The total number of source documents that were scanned. Includes new, updated, and unchanged documents.
numberOfMetadataDocumentsModified (integer) --
The number of metadata files that were updated or deleted.
numberOfMetadataDocumentsScanned (integer) --
The total number of metadata files that were scanned. Includes new, updated, and unchanged files.
numberOfModifiedDocumentsIndexed (integer) --
The number of modified source documents in the data source that were successfully indexed.
numberOfNewDocumentsIndexed (integer) --
The number of new source documents in the data source that were successfully indexed.
status (string) --
The status of the data ingestion job.
updatedAt (datetime) --
The time the data ingestion job was last updated.
nextToken (string) --
If the total number of results is greater than the maxResults value provided in the request, use this token when making another request in the nextToken field to return the next batch of results.
{'ingestionJob': {'status': {'STOPPED', 'STOPPING'}}}
Begins a data ingestion job. Data sources are ingested into your knowledge base so that Large Language Models (LLMs) can use your data.
See also: AWS API Documentation
Request Syntax
client.start_ingestion_job( clientToken='string', dataSourceId='string', description='string', knowledgeBaseId='string' )
string
A unique, case-sensitive identifier to ensure that the API request completes no more than one time. If this token matches a previous request, Amazon Bedrock ignores the request, but does not return an error. For more information, see Ensuring idempotency.
This field is autopopulated if not provided.
string
[REQUIRED]
The unique identifier of the data source you want to ingest into your knowledge base.
string
A description of the data ingestion job.
string
[REQUIRED]
The unique identifier of the knowledge base for the data ingestion job.
dict
Response Syntax
{ 'ingestionJob': { 'dataSourceId': 'string', 'description': 'string', 'failureReasons': [ 'string', ], 'ingestionJobId': 'string', 'knowledgeBaseId': 'string', 'startedAt': datetime(2015, 1, 1), 'statistics': { 'numberOfDocumentsDeleted': 123, 'numberOfDocumentsFailed': 123, 'numberOfDocumentsScanned': 123, 'numberOfMetadataDocumentsModified': 123, 'numberOfMetadataDocumentsScanned': 123, 'numberOfModifiedDocumentsIndexed': 123, 'numberOfNewDocumentsIndexed': 123 }, 'status': 'STARTING'|'IN_PROGRESS'|'COMPLETE'|'FAILED'|'STOPPING'|'STOPPED', 'updatedAt': datetime(2015, 1, 1) } }
Response Structure
(dict) --
ingestionJob (dict) --
Contains information about the data ingestion job.
dataSourceId (string) --
The unique identifier of the data source for the data ingestion job.
description (string) --
The description of the data ingestion job.
failureReasons (list) --
A list of reasons that the data ingestion job failed.
(string) --
ingestionJobId (string) --
The unique identifier of the data ingestion job.
knowledgeBaseId (string) --
The unique identifier of the knowledge for the data ingestion job.
startedAt (datetime) --
The time the data ingestion job started.
If you stop a data ingestion job, the startedAt time is the time the job was started before the job was stopped.
statistics (dict) --
Contains statistics about the data ingestion job.
numberOfDocumentsDeleted (integer) --
The number of source documents that were deleted.
numberOfDocumentsFailed (integer) --
The number of source documents that failed to be ingested.
numberOfDocumentsScanned (integer) --
The total number of source documents that were scanned. Includes new, updated, and unchanged documents.
numberOfMetadataDocumentsModified (integer) --
The number of metadata files that were updated or deleted.
numberOfMetadataDocumentsScanned (integer) --
The total number of metadata files that were scanned. Includes new, updated, and unchanged files.
numberOfModifiedDocumentsIndexed (integer) --
The number of modified source documents in the data source that were successfully indexed.
numberOfNewDocumentsIndexed (integer) --
The number of new source documents in the data source that were successfully indexed.
status (string) --
The status of the data ingestion job.
updatedAt (datetime) --
The time the data ingestion job was last updated.
If you stop a data ingestion job, the updatedAt time is the time the job was stopped.