Amazon Kinesis Firehose

2024/06/06 - 3 updated api methods

Changes   Adds integration with Secrets Manager for Redshift, Splunk, HttpEndpoint, and Snowflake destinations

2024/02/16 - 2 new 3 updated api methods

Changes   This release adds support for Data Message Extraction for decompressed CloudWatch logs, and to use a custom file extension or time zone for S3 destinations.

2024/01/18 - 3 updated api methods

Changes   Allow support for Snowflake as a Kinesis Data Firehose delivery destination.

2023/12/14 - 3 updated api methods

Changes   This release, 1) adds configurable buffering hints for the Splunk destination, and 2) reduces the minimum configurable buffering interval for supported destinations

2023/09/27 - 4 updated api methods

Changes   Features : Adding support for new data ingestion source to Kinesis Firehose - AWS Managed Services Kafka.

2023/09/13 - 3 updated api methods

Changes   DocumentIdOptions has been added for the Amazon OpenSearch destination.

2022/11/29 - 3 updated api methods

Changes   Allow support for the Serverless offering for Amazon OpenSearch Service as a Kinesis Data Firehose delivery destination.

2021/10/07 - 3 updated api methods

Changes   Allow support for Amazon Opensearch Service(successor to Amazon Elasticsearch Service) as a Kinesis Data Firehose delivery destination.

2021/08/30 - 3 updated api methods

Changes   This release adds the Dynamic Partitioning feature to Kinesis Data Firehose service for S3 destinations.

2020/07/29 - 3 updated api methods

Changes   This release includes a new Kinesis Data Firehose feature that supports data delivery to Https endpoint and to partners. You can now use Kinesis Data Firehose to ingest real-time data and deliver to Https endpoint and partners in a serverless, reliable, and salable manner.

2020/04/23 - 3 updated api methods

Changes   You can now deliver streaming data to an Amazon Elasticsearch Service domain in an Amazon VPC. You can now compress streaming data delivered to S3 using Hadoop-Snappy in addition to Gzip, Zip and Snappy formats.

2019/11/20 - 4 updated api methods

Changes   With this release, Amazon Kinesis Data Firehose allows server side encryption with customer managed CMKs. Customer managed CMKs ( "Customer Master Keys") are AWS Key Management Service (KMS) keys that are fully managed by the customer. With customer managed CMKs, customers can establish and maintain their key policies, IAM policies, rotating policies and add tags. For more information about AWS KMS and CMKs, please refer to: https://docs.aws.amazon.com/kms/latest/developerguide/concepts.html. Please refer to the following link to create CMKs: https://docs.aws.amazon.com/kms/latest/developerguide/importing-keys-create-cmk.html

2019/10/07 - 3 updated api methods

Changes   Amazon Kinesis Data Firehose now allows delivering data to Elasticsearch clusters set up in a different AWS account than the Firehose AWS account. For technical documentation, look for ElasticsearchDestinationConfiguration in the Amazon Kinesis Firehose API reference.

2018/12/20 - 3 updated api methods

Changes   Support for specifying customized s3 keys and supplying a separate prefix for failed-records

2018/11/12 - 2 new 4 updated api methods

Changes   With this release, Amazon Kinesis Data Firehose allows you to enable/disable server-side encryption(SSE) for your delivery streams ensuring encryption of data at rest. For technical documentation, look at https://docs.aws.amazon.com/firehose/latest/dev/encryption.html

2018/05/10 - 3 updated api methods

Changes   With this release, Amazon Kinesis Data Firehose can convert the format of your input data from JSON to Apache Parquet or Apache ORC before storing the data in Amazon S3. Parquet and ORC are columnar data formats that save space and enable faster queries compared to row-oriented formats like JSON.

2018/04/20 - 3 new api methods

Changes   With this release, Amazon Kinesis Data Firehose allows you to tag your delivery streams. Tags are metadata that you can create and use to manage your delivery streams. For more information about tagging, see AWS Tagging Strategies. For technical documentation, look for the tagging operations in the Amazon Kinesis Firehose API reference.

2017/11/20 - 3 updated api methods

Changes   This release includes a new Kinesis Firehose feature that supports Splunk as Kinesis Firehose delivery destination. You can now use Kinesis Firehose to ingest real-time data to Splunk in a serverless, reliable, and salable manner. This release also includes a new feature that allows you to configure Lambda buffer size in Kinesis Firehose data transformation feature. You can now customize the data buffer size before invoking Lambda function in Kinesis Firehose for data transformation. This feature allows you to flexibly trade-off processing and delivery latency with cost and efficiency based on your specific use cases and requirements.

2017/08/21 - 1 new 3 updated api methods

Changes   This change will allow customers to attach a Firehose delivery stream to an existing Kinesis stream directly. You no longer need a forwarder to move data from a Kinesis stream to a Firehose delivery stream. You can now run your streaming applications on your Kinesis stream and easily attach a Firehose delivery stream to it for data delivery to S3, Redshift, or Elasticsearch concurrently.

2016/12/20 - 3 updated api methods

Changes   The processing feature enables users to process and modify records before Amazon Firehose delivers them to destinations.