Elasticsearch downloads

Description

This watcher download provides the possibility to move existing indices into other ILM phases. This specific case was made to move based on disc usage per zone. This is especially helpful if you are short on storage capacity in one of your data tiering zones.

With the default implementation of ILM a user only can move the indices based on the time after the rollover or creation of the index has happened. While this works fine to configure your retention time it could be also challenging to configure it correctly to not hit high storage water marks e.g. in Elastic Cloud.

This watcher job can prevent hitting the thresholds in your data tiering zone by moving an index before the retention has reached. Be careful: This could also lead into situations where your data is moved very early. In those cases it can also influence the performance of your Kibana dashboards or Logs UI in case your timeframe is including data from an index that has already been moved to warm.

To move an index to the next ILM phase using this watcher jobs this download includes:

  1. A job that is extracting the index information using the Kibana API. It will store all the relevant information into a separate index that can be used for further analysis.
  2. A job that is taking the data of the first job and is checking for specific rules like disc threshold for all indices in one single zone. If the disc threshold is higher than expected the watcher job is triggering the ILM move API of Elasticsearch. This is an expert API and hard to configure. You need to know which is your target state of ILM.
Tested versions 7.14
ECS compliant No
Category ,
Tags

You must log in to submit a review.

Related downloads

A watch which alerts if the time spent by a hosts CPU in IOWait, has increased by more than than N% in the last Y mins. N defaults to 5%,…

This watch checks the availability of your Heartbeat observed services. It will trigger an alert whenever at least one of your services is down.

This bundle enhances the Kibana alerting experience. Storing all relevant information in indices and visualize the data in dashboards.

This watcher job is moving specific indices based on e.g. disc usage into the next ILM phase.

This watch is getting data from the Elasticsearch shards API directly and checking for large shards.

These downloads could be also interesting for you

This dashboard shows the history of executed watcher jobs.

This watcher job is moving specific indices based on e.g. disc usage into the next ILM phase.

A plex ingest node pipeline to parse logs from Plex for Elasticsearch

A watch which alerts if the time spent by a hosts CPU in IOWait, has increased by more than than N% in the last Y mins. N defaults to 5%,…

This bundle enhances the Kibana alerting experience. Storing all relevant information in indices and visualize the data in dashboards.

This watch is getting data from the Elasticsearch shards API directly and checking for large shards.