Skip to content

Commit

Permalink
Update solutions/observability/cloud/monitor-amazon-web-services-aws-…
Browse files Browse the repository at this point in the history
…with-amazon-data-firehose.md

Co-authored-by: Arianna Laudazzi <46651782+alaudazzi@users.noreply.github.com>
  • Loading branch information
Kavindu-Dodan and alaudazzi committed Feb 28, 2025
1 parent 7867b41 commit 52c9c02
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ From the **Destination settings** panel, specify the following settings:

* `es_datastream_name`: This parameter is optional and can be used to set which data stream documents will be stored. If not specified, logs are stored in `logs-awsfirehose-default` data stream and metrics are stored in `metrics-aws.cloudwatch-default` data stream.
* `include_cw_extracted_fields`: This parameter is optional and can be set when using a CloudWatch logs subscription filter as the Firehose data source. When set to true, extracted fields generated by the filter pattern in the subscription filter will be collected. Setting this parameter can add many fields to each record and may significantly increase data volume in Elasticsearch. Therefore, use this parameter carefully and only when the extracted fields are required for specific filtering and/or aggregation.
* `set_es_document_id`: This parameter is optional and can be set to allow Elasticsearch to assign each document a random ID or use a calculated unique ID for each document. Default is true. When set to false, a random ID will be used for each document which will help indexing performance.
* `set_es_document_id`: This parameter is optional and can be set to allow Elasticsearch to assign each document a random ID or use a calculated unique ID for each document. The default is true. When set to false, a random ID is used for each document, which helps indexing performance.

* **Backup settings**: It is recommended to configure S3 backup for failed records. These backups can be used to restore data losses caused by unforeseen service outages.

Expand Down

0 comments on commit 52c9c02

Please # to comment.