Skip to content

elasticsearch.md

Latest commit

 

History

History
146 lines (122 loc) · 3.19 KB

elasticsearch.md

File metadata and controls

146 lines (122 loc) · 3.19 KB

Elasticsearch

Some resources

Install

Link

Glossary

Term Explanation
Index Like a database
Typew Like a table
Document Like a row
Hits Result & Metadata
Shards Workers

Some basic request

Below the index is named samples

Delete index

curl -X DELETE 'http://localhost:9200/samples'

List all indexes

curl -X GET 'http://localhost:9200/_cat/indices?v'`

List all docs in index

curl -X GET 'http://localhost:9200/sample/_search'`

Query using URL parameters

curl -X GET http://localhost:9200/samples/_search?q=school:Harvard`

Query with JSON aka Elasticsearch Query DSL:

curl -XGET --header 'Content-Type: application/json' http://localhost:9200/samples/_search -d '{
  "query" : {
    "match" : { "school": "Harvard" }
  }
}'

List index mapping

curl -X GET http://localhost:9200/samples`

Add data:

curl -XPUT --header 'Content-Type: application/json' http://localhost:9200/samples/_doc/1 -d '{
   "school" : "Harvard"			
}'

Update doc:

curl -XPUT --header 'Content-Type: application/json' http://localhost:9200/samples/_doc/2 -d '
{
    "school": "Clemson"
}'

curl -XPOST --header 'Content-Type: application/json' http://localhost:9200/samples/_doc/2/_update -d '{
  "doc" : {
    "students": 50000
  }
}'

Backup index:

curl -XPOST --header 'Content-Type: application/json' http://localhost:9200/_reindex -d '{
  "source": {
    "index": "samples"
  },
  "dest": {
    "index": "samples_backup"
  }
}'

Bulk load data in JSON format:

export pwd="elastic:"

curl --user $pwd  -H 'Content-Type: application/x-ndjson' -XPOST 'https://58571402f5464923883e7be42a037917.eu-central-1.aws.cloud.es.io:9243/0/_bulk?pretty' --data-binary @<file>

Show cluster health:

curl --user $pwd  -H 'Content-Type: application/json' -XGET https://58571402f5464923883e7be42a037917.eu-central-1.aws.cloud.es.io:9243/_cluster/health?pretty

Aggregation and Bucket Aggregation:

curl -XGET --user $pwd --header 'Content-Type: application/json'  https://58571402f5464923883e7be42a037917.eu-central-1.aws.cloud.es.io:9243/logstash/_search?pretty -d '{
  "aggs": {
    "cityName": {
      "terms": {
        "field": "geoip.city_name.keyword",
          "size": 50

      }
    }
  }
}
'

Pretty Print

curl -X GET 'http://localhost:9200/(index)/_search'?pretty=true

To query and return only certain fields:

GET filebeat-7.6.2-2020.05.05-000001/_search
{
  "_source": ["suricata.eve.timestamp","source.geo.region_name","event.created"],
  "query":      {
    "match" : { "source.geo.country_iso_code": "GR" }
  }
}

To Query by Date:

GET filebeat-7.6.2-2020.05.05-000001/_search
{
  "query": {
    "range" : {
      "event.created": {
        "gte" : "now-7d/d"
      }
    }
  }
}