Elasticsearch (ES) is a distributed, scalable, search and analytics engine that enables fast data retrieval. [1]. It exposes a RESTful API, Java and Python libraries, and extensibility with various plugins like the Zookeeper cluster integration plugin.
In this post I'll deploy a small Elasticsearch cluster consisting of one Nginx loadbalancer, two ES client nodes, three ES master nodes and two ES data nodes.
The role of the three different ES node types is:
- Client nodes: act as load balancer for routing queries and index processes. The client nodes do not hold any data.
- Data nodes: hold data, merge segments and execute queries. The data nodes are the main workers.
- Master nodes: manages the cluster and elects a master node using Unicast. The master nodes hold configuration data and the mapping of all the indexes in the cluster.
A simple one node deployment by default configures the ES server to be both a master and a data node. To be able to further scale however, you'll need multiple data nodes, at least 3 masters (to prevent split brain scenarios) and two client nodes to route the requests and results.
Installing and configuring ES cluster is rather simple. First download the Oracle JRE and install it on all ES nodes:
File: gistfile1.txt
-------------------
[es-nodes]$ lsb_release -d
Description: Ubuntu 14.04.4 LTS
[es-nodes]$ cd /usr/src
[es-nodes]$ wget http://download.oracle.com/otn-pub/java/jdk/8u92-b14/jre-8u92-linux-x64.tar.gz
[es-nodes]$ tar zxfv jre-8u92-linux-x64.tar.gz
[es-nodes]$ mkdir /usr/lib/jvm/ && mv jre1.8.0_92/ /usr/lib/jvm/
[es-nodes]$ update-alternatives --install /usr/bin/java java /usr/lib/jvm/jre1.8.0_92/bin/java 2000
[es-nodes]$ export JAVA_HOME=/usr/lib/jvm/jre1.8.0_92/
[es-nodes]$ echo "export JAVA_HOME=/usr/lib/jvm/jre1.8.0_92/" > /etc/profile.d/oraclejdk.sh
[es-nodes]$ java -version
java version "1.8.0_92"
Java(TM) SE Runtime Environment (build 1.8.0_92-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.92-b14, mixed mode)
With Java installed, download and install elasticsearch on all ES nodes:
File: gistfile1.txt
-------------------
[es-nodes]$ wget https://download.elastic.co/elasticsearch/release/org/elasticsearch/distribution/deb/elasticsearch/2.3.3/elasticsearch-2.3.3.deb
[es-nodes]$ dpkg -i elasticsearch-2.3.3.deb
Next configure the different types of ES nodes, starting with the three masters:
File: gistfile1.txt
-------------------
[es-master-n01,02,03]$ cat /etc/elasticsearch/elasticsearch.yml
cluster.name: test-cluster # must be the same on all ES nodes part of the cluster
node.name: es-master-n01 # replace this with n02 and n03
node.data: false
node.master: true # this is what defines the node as a master
network.host: 10.176.66.106 # replace this with the IPs of n02 and n03
discovery.zen.ping.unicast.hosts: ["10.176.66.106", "10.176.66.108", "10.176.66.113"] # The IPs of all the ES masters in the cluster
discovery.zen.minimum_master_nodes: 3 # minimum number of masters to have a quorum
The two data nodes:
File: gistfile1.txt
-------------------
[es-data-n01,02]$ cat /etc/elasticsearch/elasticsearch.yml
cluster.name: test-cluster
node.name: es-data-n01
node.data: true
node.master: false
network.host: 10.176.66.73
discovery.zen.ping.unicast.hosts: ["10.176.66.106", "10.176.66.108", "10.176.66.113"]
discovery.zen.minimum_master_nodes: 3
And finally the two client nodes (note how the main difference between the node types is the node.data and node.master stanzas:
File: gistfile1.txt
-------------------
[es-client-n01,02]$ cat /etc/elasticsearch/elasticsearch.yml
cluster.name: test-cluster
node.name: es-client-n01
node.data: false
node.master: false
network.host: 10.176.6.154
discovery.zen.ping.unicast.hosts: ["10.176.66.106", "10.176.66.108", "10.176.66.113"]
discovery.zen.minimum_master_nodes: 3
On Ubuntu elasticsearch ships with configurable defaults in /etc/default/elasticsearch. Let's set the HEAP size to 2GB and the max number of available file descriptors on all nodes in the cluster:
File: gistfile1.txt
-------------------
[es-nodes]$ cat /etc/default/elasticsearch
ES_HEAP_SIZE=1g
ES_STARTUP_SLEEP_TIME=5
MAX_OPEN_FILES=65535
#ES_HOME=/usr/share/elasticsearch
#CONF_DIR=/etc/elasticsearch
#DATA_DIR=/var/lib/elasticsearch
#LOG_DIR=/var/log/elasticsearch
#PID_DIR=/var/run/elasticsearch
#ES_HEAP_NEWSIZE=
#ES_DIRECT_SIZE=
#ES_JAVA_OPTS=
#ES_RESTART_ON_UPGRADE=true
#ES_GC_LOG_FILE=/var/log/elasticsearch/gc.log
#ES_USER=elasticsearch
#ES_GROUP=elasticsearch
#MAX_LOCKED_MEMORY=unlimited
#MAX_MAP_COUNT=262144
Start all the masters, data nodes and client nodes and watch the formation of the cluster and election of a leading master:
File: gistfile1.txt
-------------------
[es-master-n01]$ /etc/init.d/elasticsearch start
* Starting Elasticsearch Server [ OK ]
[es-master-n01]$ cat /var/log/elasticsearch/test-cluster.log
[2016-05-25 15:11:41,772][INFO ][node ] [es-master-n01] version[2.3.3], pid[6048], build[218bdf1/2016-05-17T15:40:04Z]
[2016-05-25 15:11:41,772][INFO ][node ] [es-master-n01] initializing ...
[2016-05-25 15:11:42,478][INFO ][plugins ] [es-master-n01] modules [reindex, lang-expression, lang-groovy], plugins [], sites []
[2016-05-25 15:11:42,504][INFO ][env ] [es-master-n01] using [1] data paths, mounts [[/ (/dev/xvda1)]], net usable_space [73.7gb], net total_space [78.6gb], spins? [no], types [ext4]
[2016-05-25 15:11:42,504][INFO ][env ] [es-master-n01] heap size [2007.3mb], compressed ordinary object pointers [true]
[2016-05-25 15:11:42,505][WARN ][env ] [es-master-n01] max file descriptors [65535] for elasticsearch process likely too low, consider increasing to at least [65536]
[2016-05-25 15:11:44,695][INFO ][node ] [es-master-n01] initialized
[2016-05-25 15:11:44,695][INFO ][node ] [es-master-n01] starting ...
[2016-05-25 15:11:44,885][INFO ][transport ] [es-master-n01] publish_address {10.176.66.106:9300}, bound_addresses {10.176.66.106:9300}
[2016-05-25 15:11:44,891][INFO ][discovery ] [es-master-n01] test-cluster/eaf0BN5vR9eostNn0UtmJw
[2016-05-25 15:11:48,097][INFO ][cluster.service ] [es-master-n01] detected_master {es-master-n02}{DYCjY5H_QguQEhVlo74tVw}{10.176.66.108}{10.176.66.108:9300}{data=false, master=true}, added {{es-data-n02}{2YUeN6r3TNaHikfE3iNp4g}{10.176.66.101}{10.176.66.101:9300}{master=false},{es-client-n02}{RCIgWbNBTiSXfDgSDBX8qg}{10.176.6.154}{10.176.6.154:9300}{data=false, master=false},{es-master-n02}{DYCjY5H_QguQEhVlo74tVw}{10.176.66.108}{10.176.66.108:9300}{data=false, master=true},{es-client-n01}{GpYXjp4MRums-U9wqmYDLg}{10.176.3.48}{10.176.3.48:9300}{data=false, master=false},{es-data-n01}{LaqNrBQyR4Khb97h_wTBCA}{10.176.66.73}{10.176.66.73:9300}{master=false},{es-master-n03}{Tn6ZgIK0TBSErRgFelGo2g}{10.176.66.113}{10.176.66.113:9300}{data=false, master=true},}, reason: zen-disco-receive(from master [{es-master-n02}{DYCjY5H_QguQEhVlo74tVw}{10.176.66.108}{10.176.66.108:9300}{data=false, master=true}])
[2016-05-25 15:11:48,230][INFO ][http ] [es-master-n01] publish_address {10.176.66.106:9200}, bound_addresses {10.176.66.106:9200}
[2016-05-25 15:11:48,230][INFO ][node ] [es-master-n01] started
Fail the current master and observe the election of a new one:
File: gistfile1.txt
-------------------
[2016-05-24 19:27:27,838][INFO ][discovery.zen ] [es-master-n01] master_left [{es-master-n02}{RSxbeHM6QyqDcHJ0edqSqw}{10.176.66.108}{10.176.66.108:9300}{data=false, master=true}], reason [shut_down]
[2016-05-24 19:27:27,839][WARN ][discovery.zen ] [es-master-n01] master left (reason = shut_down), current nodes: {{es-master-n03}{Tn6ZgIK0TBSErRgFelGo2g}{10.176.66.113}{10.176.66.113:9300}{data=false, master=true},{es-client-n02}{RCIgWbNBTiSXfDgSDBX8qg}{10.176.6.154}{10.176.6.154:9300}{data=false, master=false},{es-client-n01}{GpYXjp4MRums-U9wqmYDLg}{10.176.3.48}{10.176.3.48:9300}{data=false, master=false},{es-master-n01}{n_Wun5GLSeeLcpciPOgHkw}{10.176.66.106}{10.176.66.106:9300}{data=false, master=true},}
[2016-05-24 19:27:27,841][INFO ][cluster.service ] [es-master-n01] removed {{es-master-n02}{RSxbeHM6QyqDcHJ0edqSqw}{10.176.66.108}{10.176.66.108:9300}{data=false, master=true},}, reason: zen-disco-master_failed ({es-master-n02}{RSxbeHM6QyqDcHJ0edqSqw}{10.176.66.108}{10.176.66.108:9300}{data=false, master=true})
[2016-05-24 19:27:35,599][INFO ][cluster.service ] [es-master-n01] detected_master {es-master-n03}{Tn6ZgIK0TBSErRgFelGo2g}{10.176.66.113}{10.176.66.113:9300}{data=false, master=true}, added {{es-master-n02}{DYCjY5H_QguQEhVlo74tVw}{10.176.66.108}{10.176.66.108:9300}{data=false, master=true},}, reason: zen-disco-receive(from master [{es-master-n03}{Tn6ZgIK0TBSErRgFelGo2g}{10.176.66.113}{10.176.66.113:9300}{data=false, master=true}])
[2016-05-24 19:38:19,106][INFO ][cluster.service ] [es-master-n01] added {{es-data-n01}{LaqNrBQyR4Khb97h_wTBCA}{10.176.66.73}{10.176.66.73:9300}{master=false},}, reason: zen-disco-receive(from master [{es-master-n03}{Tn6ZgIK0TBSErRgFelGo2g}{10.176.66.113}{10.176.66.113:9300}{data=false, master=true}])
[2016-05-24 19:43:24,792][INFO ][cluster.service ] [es-master-n01] added {{es-data-n02}{2YUeN6r3TNaHikfE3iNp4g}{10.176.66.101}{10.176.66.101:9300}{master=false},}, reason: zen-disco-receive(from master [{es-master-n03}{Tn6ZgIK0TBSErRgFelGo2g}{10.176.66.113}{10.176.66.113:9300}{data=false, master=true}])
Elasticsearch exposes a great API to check the cluster status or gather various metrics [2]:
File: gistfile1.txt
-------------------
[es-client-n01]$ curl -XGET 'http://10.176.3.48:9200/_cluster/health?pretty=true'
{
"cluster_name" : "test-cluster",
"status" : "green",
"timed_out" : false,
"number_of_nodes" : 7,
"number_of_data_nodes" : 2,
"active_primary_shards" : 5,
"active_shards" : 10,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 0,
"delayed_unassigned_shards" : 0,
"number_of_pending_tasks" : 0,
"number_of_in_flight_fetch" : 0,
"task_max_waiting_in_queue_millis" : 0,
"active_shards_percent_as_number" : 100.0
}
[es-client-n01]$ curl -X GET 'http://10.176.3.48:9200/_cluster/stats?human&pretty'
{
"timestamp" : 1464127115210,
"cluster_name" : "test-cluster",
"status" : "green",
"indices" : {
"count" : 1,
"shards" : {
"total" : 10,
"primaries" : 5,
"replication" : 1.0,
"index" : {
"shards" : {
"min" : 10,
"max" : 10,
"avg" : 10.0
},
"primaries" : {
"min" : 5,
"max" : 5,
"avg" : 5.0
},
"replication" : {
"min" : 1.0,
"max" : 1.0,
"avg" : 1.0
}
}
},
"docs" : {
"count" : 0,
"deleted" : 0
},
"store" : {
"size" : "1.5kb",
"size_in_bytes" : 1590,
"throttle_time" : "0s",
"throttle_time_in_millis" : 0
},
"fielddata" : {
"memory_size" : "0b",
"memory_size_in_bytes" : 0,
"evictions" : 0
},
"query_cache" : {
"memory_size" : "0b",
"memory_size_in_bytes" : 0,
"total_count" : 0,
"hit_count" : 0,
"miss_count" : 0,
"cache_size" : 0,
"cache_count" : 0,
"evictions" : 0
},
"completion" : {
"size" : "0b",
"size_in_bytes" : 0
},
"segments" : {
"count" : 0,
"memory" : "0b",
"memory_in_bytes" : 0,
"terms_memory" : "0b",
"terms_memory_in_bytes" : 0,
"stored_fields_memory" : "0b",
"stored_fields_memory_in_bytes" : 0,
"term_vectors_memory" : "0b",
"term_vectors_memory_in_bytes" : 0,
"norms_memory" : "0b",
"norms_memory_in_bytes" : 0,
"doc_values_memory" : "0b",
"doc_values_memory_in_bytes" : 0,
"index_writer_memory" : "0b",
"index_writer_memory_in_bytes" : 0,
"index_writer_max_memory" : "4.8mb",
"index_writer_max_memory_in_bytes" : 5120000,
"version_map_memory" : "0b",
"version_map_memory_in_bytes" : 0,
"fixed_bit_set" : "0b",
"fixed_bit_set_memory_in_bytes" : 0
},
"percolate" : {
"total" : 0,
"time" : "0s",
"time_in_millis" : 0,
"current" : 0,
"memory_size_in_bytes" : -1,
"memory_size" : "-1b",
"queries" : 0
}
},
"nodes" : {
"count" : {
"total" : 7,
"master_only" : 3,
"data_only" : 2,
"master_data" : 0,
"client" : 0
},
"versions" : [ "2.3.3" ],
"os" : {
"available_processors" : 14,
"allocated_processors" : 14,
"mem" : {
"total" : "6.1gb",
"total_in_bytes" : 6655361024
},
"names" : [ {
"name" : "Linux",
"count" : 7
} ]
},
"process" : {
"cpu" : {
"percent" : 0
},
"open_file_descriptors" : {
"min" : 264,
"max" : 291,
"avg" : 271
}
},
"jvm" : {
"max_uptime" : "2.6h",
"max_uptime_in_millis" : 9637801,
"versions" : [ {
"version" : "1.8.0_92",
"vm_name" : "Java HotSpot(TM) 64-Bit Server VM",
"vm_version" : "25.92-b14",
"vm_vendor" : "Oracle Corporation",
"count" : 7
} ],
"mem" : {
"heap_used" : "623.1mb",
"heap_used_in_bytes" : 653377880,
"heap_max" : "6.8gb",
"heap_max_in_bytes" : 7394164736
},
"threads" : 200
},
"fs" : {
"total" : "393gb",
"total_in_bytes" : 422067834880,
"free" : "385.7gb",
"free_in_bytes" : 414192263168,
"available" : "368.6gb",
"available_in_bytes" : 395856375808
},
"plugins" : [ ]
}
}
[es-client-n01]$ curl -X GET 'http://10.176.3.48:9200/_cat/health?v'
epoch timestamp cluster status node.total node.data shards pri relo init unassign pending_tasks max_task_wait_time active_shards_percent
1464127244 22:00:44 test-cluster green 7 2 10 5 0 0 0 0 - 100.0%
[es-client-n01]$ curl -X GET 'http://10.176.3.48:9200/_cat/master?v'
id host ip node
Tn6ZgIK0TBSErRgFelGo2g 10.176.66.113 10.176.66.113 es-master-n03
[es-client-n01]$ curl -X GET 'http://10.176.3.48:9200/_cat/nodeattrs?v'
node host ip attr value
es-client-n01 10.176.3.48 10.176.3.48 data false
es-client-n01 10.176.3.48 10.176.3.48 master false
es-client-n02 10.176.6.154 10.176.6.154 data false
es-client-n02 10.176.6.154 10.176.6.154 master false
es-data-n01 10.176.66.73 10.176.66.73 master false
es-master-n01 10.176.66.106 10.176.66.106 data false
es-master-n01 10.176.66.106 10.176.66.106 master true
es-master-n02 10.176.66.108 10.176.66.108 data false
es-master-n02 10.176.66.108 10.176.66.108 master true
es-data-n02 10.176.66.101 10.176.66.101 master false
es-master-n03 10.176.66.113 10.176.66.113 data false
es-master-n03 10.176.66.113 10.176.66.113 master true
And finally to add and retrieve an index:
File: gistfile1.txt
-------------------
[es-client-n01]$ curl -X POST '10.176.3.48:9200/test_index/'
{"acknowledged":true}
[es-client-n01]$ curl -X GET '10.176.3.48:9200/test_index/' | python -mjson.tool
{
"test_index": {
"aliases": {},
"mappings": {},
"settings": {
"index": {
"creation_date": "1464126352243",
"number_of_replicas": "1",
"number_of_shards": "5",
"uuid": "n_i3T0i4TLyjfkJspd1ukA",
"version": {
"created": "2030399"
}
}
},
"warmers": {}
}
}
We can directly connect to the two client nodes to perform operations, or front end them with a load balancer:
File: gistfile1.txt
-------------------
[es-lb-n01]$ apt-get update && apt-get install -y nginx
[es-lb-n01]$ cat /etc/nginx/sites-available/elasticsearch_lb
upstream elasticsearch_client_nodes {
least_conn;
server 10.176.3.48:9200;
server 10.176.6.154:9200;
}
server {
listen 9292;
server_name es-lb-n01.example.net;
access_log /var/log/nginx/elasticsearch_lb/access.log;
error_log /var/log/nginx/elasticsearch_lb/error.log;
location / {
proxy_pass http://elasticsearch_client_nodes;
proxy_http_version 1.1;
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forward-For $proxy_add_x_forwarded_for;
proxy_set_header Host $http_host;
}
}
[es-lb-n01]$ ln -s /etc/nginx/sites-available/elasticsearch_lb /etc/nginx/sites-enabled/elasticsearch_lb
[es-lb-n01]$ mkdir /var/log/nginx/elasticsearch_lb/
[es-lb-n01]$ /etc/init.d/nginx restart
To test connect to the LB:
File: gistfile1.txt
-------------------
[workstation]$ curl http://es-lb-n01.example.net/
{
"name" : "es-client-n01",
"cluster_name" : "test-cluster",
"version" : {
"number" : "2.3.3",
"build_hash" : "218bdf10790eef486ff2c41a3df5cfa32dadcfde",
"build_timestamp" : "2016-05-17T15:40:04Z",
"build_snapshot" : false,
"lucene_version" : "5.5.0"
},
"tagline" : "You Know, for Search"
}
To export an index from ES and import it to a different ES server we can use a tool called elasticdump:
File: gistfile1.txt
-------------------
[es-client-n01]$ curl -sL https://deb.nodesource.com/setup_4.x | sudo bash -
[es-client-n01]$ apt-get install -y nodejs
[es-client-n01]$ npm install elasticdump
[es-client-n01]$ ./node_modules/elasticdump/bin/elasticdump --input=http://localhost:9200/your_index --output=/tmp/your_index.json --type=data
[es-client-n01]$ ./node_modules/elasticdump/bin/elasticdump --input=http://localhost:9200/your_index --output=/tmp/your_index_mapping.json --type=mapping
[es-new-client-n01]$ ./node_modules/elasticdump/bin/elasticdump --input=your_index.json --output=http://localhost:9200/your_index
Fri, 19 Aug 2016 15:42:26 GMT | starting dump
Fri, 19 Aug 2016 15:42:26 GMT | got 100 objects from source file (offset: 0)
...
Fri, 19 Aug 2016 15:43:17 GMT | Total Writes: 170114
Fri, 19 Aug 2016 15:43:17 GMT | dump complete
Here are few other useful examples:
File: gistfile1.txt
-------------------
[es-nodes]$ curl -XGET localhost:9200/_cat/shards?v
logstash-2016.08.21 14 p STARTED 23923583 37.1gb 10.2.44.32 es-data-n06.prod.us-east-1.example.com
logstash-2016.08.21 14 r STARTED 23923583 37gb 10.2.79.190 es-data-n24.prod.us-east-1.example.com
logstash-2016.08.21 3 r STARTED 12041352 18.5gb 10.2.37.163 es-data-n10.prod.us-east-1.example.com
logstash-2016.08.21 3 p STARTED 12041352 18.4gb 10.2.68.222 es-data-n16.prod.us-east-1.example.com
logstash-2016.08.21 18 r STARTED 28428955 46.3gb 10.2.58.85 es-data-n23.prod.us-east-1.example.com
logstash-2016.08.21 18 p STARTED 28428955 46.2gb 10.2.26.208 es-data-n01.prod.us-east-1.example.com
logstash-2016.08.21 0 r STARTED 28879857 54.2gb 10.2.22.252 es-data-n17.prod.us-east-1.example.com
logstash-2016.08.21 0 p STARTED 28879857 53.4gb 10.2.56.170 es-data-n07.prod.us-east-1.example.com
logstash-2016.08.28 19 r STARTED 25119161 42.8gb 10.2.20.19 es-data-n21.prod.us-east-1.example.com
[es-nodes]$
[es-nodes]$ curl -XGET localhost:9200/_cat/allocation?v
93 3.3tb 3.5tb 268.3gb 3.8tb 93 10.2.37.163 10.2.37.163 es-data-n10.prod.us-east-1.example.com
88 3.3tb 3.5tb 259.2gb 3.8tb 93 10.2.63.160 10.2.63.160 es-data-n19.prod.us-east-1.example.com
96 3.1tb 3.3tb 464.5gb 3.8tb 88 10.2.78.75 10.2.78.75 es-data-n08.prod.us-east-1.example.com
97 3.1tb 3.3tb 502.9gb 3.8tb 87 10.2.40.3 10.2.40.3 es-data-n18.prod.us-east-1.example.com
90 3.2tb 3.4tb 363.1gb 3.8tb 90 10.2.33.40 10.2.33.40 es-data-n02.prod.us-east-1.example.com
93 3.3tb 3.5tb 347.8gb 3.8tb 91 10.2.56.170 10.2.56.170 es-data-n07.prod.us-east-1.example.com
99 3.2tb 3.4tb 442.7gb 3.8tb 88 10.2.72.159 10.2.72.159 es-data-n04.prod.us-east-1.example.com
[es-nodes]$
[es-nodes]$ curl -XGET localhost:9200/_cat/nodes?v
host ip heap.percent ram.percent load node.role master name
10.2.17.1 10.2.17.1 4 75 0.00 c - kibana-n01.prod.us-east-1.example.com/customer
10.2.79.190 10.2.79.190 56 99 1.25 d - es-data-n24.prod.us-east-1.example.com
10.2.44.32 10.2.44.32 53 98 0.76 d - es-data-n06.prod.us-east-1.example.com
10.2.57.92 10.2.57.92 58 99 3.73 d - es-data-n03.prod.us-east-1.example.com
10.2.25.203 10.2.25.203 47 64 0.01 - - es-client-n03.prod.us-east-1.example.com
10.2.63.147 10.2.63.147 62 99 0.83 d - es-data-n11.prod.us-east-1.example.com
10.2.58.85 10.2.58.85 71 94 0.42 d - es-data-n23.prod.us-east-1.example.com
10.2.18.31 10.2.18.31 21 32 2.31 - - logstash-n01.prod.us-east-1.example.com
10.2.34.196 10.2.34.196 62 92 0.28 d - es-data-n22.prod.us-east-1.example.com
10.2.48.85 10.2.48.85 1 94 1.20 d - es-data-n36.prod.us-east-1.example.com
10.2.23.252 10.2.23.252 15 70 0.00 - * es-master-n01.prod.us-east-1.example.com
10.2.29.56 10.2.29.56 54 99 4.51 d - es-data-n05.prod.us-east-1.example.com
10.2.23.186 10.2.23.186 67 99 1.45 d - es-data-n13.prod.us-east-1.example.com
[es-nodes]$
[es-nodes]$ curl -XPUT localhost:9200/_cluster/settings?pretty -d '{"transient":{"cluster.routing.allocation.disk.watermark.low": "90%", "cluster.routing.allocation.disk.watermark.high": "95%", "cluster.info.update.interval": "1m"}}'
{
"acknowledged" : true,
"persistent" : { },
"transient" : {
"cluster" : {
"routing" : {
"allocation" : {
"disk" : {
"watermark" : {
"low" : "90%",
"high" : "95%"
}
}
}
},
"info" : {
"update" : {
"interval" : "1m"
}
}
}
}
}
[es-nodes]$
Resources:
[1]. https://www.elastic.co/guide/en/elasticsearch/reference/current/getting-started.html
[2]. https://www.elastic.co/guide/en/elasticsearch/reference/current/cat.html
