Home Elasticsearch笔记
Post
Cancel

Elasticsearch笔记

Posted Sep 17, 2015 Updated Oct 17, 2022
By 2pc
7 min read

安装配置

这里使用的2.3.3版本，这个版本默认不能用root直接启动。 具体参考Bootstrap.java中的代码

1
2
3
4
5
6
7
8
9
10
11

public static void initializeNatives(Path tmpFile, boolean mlockAll, boolean seccomp, boolean ctrlHandler) {
  final ESLogger logger = Loggers.getLogger(Bootstrap.class);

  // check if the user is running as root, and bail
  if (Natives.definitelyRunningAsRoot()) {
      if (Boolean.parseBoolean(System.getProperty("es.insecure.allow.root"))) {
          logger.warn("running as ROOT user. this is a bad idea!");
      } else {
          throw new RuntimeException("don't run elasticsearch as root.");
      }
  }

可以通过参数-Des.insecure.allow.root=true 来实现

1

bin/elasticsearch  -Des.insecure.allow.root=true

先给Elasticsearch启动，建立一个账户

1
2

Elasticsearch运行账户：Elasticsearch
Elasticsearch环境路径：/data/elasticsearch

新增用户并将/data/elasticsearch目录权限给Elasticsearch用户组(mac os新增用户elasticsearch，加入elasticsearch组)

1
2
3
4
5
6
7
8
9
10
11

mkdir  /data/elasticsearch/
useradd elasticsearch
passwd  elasticsearch
chown -R elasticsearch:elasticsearch  /data/elasticsearch/
cd /data/elasticsearch/
wget https://download.elastic.co/elasticsearch/release/org/elasticsearch/distribution/tar/elasticsearch/2.3.3/elasticsearch-2.3.3.tar.gz
tar zxvf elasticsearch-2.3.3.tar.gz 
chown -R elasticsearch:elasticsearch elasticsearch-2.3.3
su elasticsearch
cd /data/elasticsearch/elasticsearch-2.3.3
bin/elasticsearch

安装ik分词,medcl大神更新很快

1
2

wget https://github.com/medcl/elasticsearch-analysis-ik/releases/download/v1.9.3/elasticsearch-analysis-ik-1.9.3.zip
unzip  elasticsearch-analysis-ik-1.9.3.zip  -d  ./plugins/ik

create an index,pretty 返回数据格式不一样

1
2

curl -XPUT 'localhost:9200/indexname'
curl -XPUT 'localhost:9200/indexname?pretty'

Index and Query a Document

index a simple indexname document，indextype

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16

bash-3.2$ curl -XPUT 'localhost:9200/indexname/indextype/1?pretty' -d '
{
  "name": "John Doe"
}'
{
  "_index" : "indexname",
  "_type" : "indextype",
  "_id" : "1",
  "_version" : 3,
  "_shards" : {
    "total" : 2,
    "successful" : 1,
    "failed" : 0
  },
  "created" : false
}

retrieve that document

1
2
3
4
5
6
7
8
9
10
11

curl -XGET 'localhost:9200/indexname/indextype/1?pretty'
{
  "_index" : "indexname",
  "_type" : "indextype",
  "_id" : "1",
  "_version" : 3,
  "found" : true,
  "_source" : {
    "name" : "John Doe"
  }
}

list All indices

1
2
3
4
5
6
7
8

bash-3.2$ curl 'localhost:9200/_cat/indices?v'
health status index     pri rep docs.count docs.deleted store.size pri.store.size
yellow open   index       5   1          0            0       795b           795b
yellow open   customer2   5   1          0            0       795b           795b
yellow open   twitter     5   1          0            0       795b           795b
yellow open   db_news     5   1          1            0      4.2kb          4.2kb
yellow open   indexname   5   1          1            0      7.1kb          7.1kb
yellow open   customer    5   1          1            0      3.5kb          3.5kb

Delete an Index

1
2
3
4
5
6
7
8
9
10
11
12

bash-3.2$ curl -XDELETE 'localhost:9200/customer?pretty'
{
  "acknowledged" : true
}
bash-3.2$ curl -XDELETE 'localhost:9200/indexname?pretty'
{
  "acknowledged" : true
}
bash-3.2$ curl -XDELETE 'localhost:9200/customer2?pretty'
{
  "acknowledged" : true
}

ik分词测试sense建立type,news

1

curl -XPUT 'localhost:9200/index'

mapping

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22

POST /index/news/_mapping -d’
{
  fulltext: {
    "_all": {
      "analyzer": "ik_max_word",
      "search_analyzer": "ik_max_word",
      "term_vector": "no",
      "store": "false"
    },
    "properties": {
      "content": {
        "type": "string",
        "store": "no",
        "term_vector": "with_positions_offsets",
        "analyzer": "ik_max_word",
        "search_analyzer": "ik_max_word",
        "include_in_all": "true",
        "boost": 8
      }
    }
  }
}

索引

1
2
3
4
5
6
7
8
9
10
11
12
13
14

bash-3.2$ curl -XPOST http://localhost:9200/index/news/1 -d '{
"content":"权力的游戏琼恩雪诺的身世彩蛋你有发现吗 琼恩雪诺的真实身世"}'

bash-3.2$ curl -XPOST http://localhost:9200/index/news/1 -d '
{"content":"iPhone 7为啥取消64GB？苹果太有心计"}'

bash-3.2$ curl -XPOST http://localhost:9200/index/news/1 -d '{"content":"马克飞象是一款专为印象笔记（Evernote）打造的Markdown编辑器，通过精心的设计与技术实现，配合印象笔记强大的存储和同步功能，带来前所未有的书写体验。特点概述"}'
curl -XPOST http://localhost:9200/index/news/3 -d '{"content":"身高差近30cm,王子文是怎么穿上吴亦凡的衣服的"}'
curl -XPOST http://localhost:9200/index/news/4 -d '{"content":"霍建华胡歌邓超李易峰吴亦凡黄晓明 颜高任性！那些不受发型限制的男星"}'
curl -XPOST http://localhost:9200/index/news/2 -d '{"content":"《欧洲攻略》热拍 梁朝伟吴亦凡唐嫣现身"}'
curl -XPOST http://localhost:9200/index/news/1 -d '{"content":"吴亦凡被爆签约华谊 TFBOYS真实相貌疑曝光"}'
curl -XPOST http://localhost:9200/index/news/5 -d '{"content":"干了6年都不觉得人家不称职，从冯大辉加入一路产品高歌猛进，融资一轮比一轮顺，都没觉得人家不称职，现在人家要走了，要兑现你许下的期权，人就突然不称职了，钱啊，真是照妖镜
啊"}'

查询 query

1
2
3
4
5
6
7
8
9
10
11

http://172.16.82.188:9200/index/news/_search
GET
{
  "query": {
    "match_phrase": {
        "content" : {
            "query" : "冯大辉"
        }
    }
  }
}

term

1
2

GET 
{"query" : { "term" : { "content" : "冯" }}}

boolean查询must,should,must_not

  1. must: 文档必须完全匹配条件
  2. should: should下面会带一个以上的条件，至少满足一个条件，这个文档就符合should
  3. must_not: 文档必须不匹配条件

####　elasticsearch5.1.1配置

1
2
3
4

ERROR: bootstrap checks failed
max file descriptors [65535] for elasticsearch process is too low, increase to at least [65536]
max number of threads [1024] for user [elasticsearch] is too low, increase to at least [2048]
max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]

修改vim /etc/security/limits.d/90-nproc.conf

1
2

*          soft    nproc     2048
root       soft    nproc     unlimited

修改vim /etc/security/limits.d/90-nproc.conf

1
2

* soft nofile 65536
* hard nofile 65536

修改 /etc/sysctl.conf

1

sysctl -w vm.max_map_count=262144

ansj

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

curl -XPUT 127.0.0.1:9200/test -d '{
    "settings" : {
        "number_of_shards" : 1,
        "number_of_replicas" : 0

    },
    "mappings" : {
        "test" : {
            "_all" : { "enabled" : false },
            "properties" : {
                "name" : { "type" : "string", "analyzer" : "index_ansj", "search_analyzer" : "query_ansj" }
            }
        }
    }
}'

index

1
2
3
4
5

curl -XPUT 'http://127.0.0.1:9200/test/test/1' -d '{
    "name" : "中国人民万岁",
    "post_date" : "2009-11-15T14:12:12",
    "message" : "trying out Elasticsearch"
}'

query

1

http://127.0.0.1:9200/test/test/_search?q=name:%E4%B8%AD%E5%9B%BD

analyze测试

1
2
3

http://172.17.32.128:9200/_cat/test/analyze?text=%E4%B8%AD%E5%9B%BD%E6%9C%80%E5%A4%A7%E5%AF%B9%E4%BF%84%E9%99%86%E8%B7%AF%E5%8F%A3%E5%B2%B8%E8%BF%8E%E4%B8%AD%E5%9B%BD%E5%9C%A8%E4%BF%84%E5%8A%A1%E5%B7%A5%E4%BA%BA%E5%91%98%E8%BF%94%E4%B9%A1%E6%BD%AE&analyzer=query_ansj

curl http://172.17.32.128:9200/_analyze?text=中国最大对俄陆路口岸迎中国在俄务工人员返乡潮&analyzer=query_ansj&pretty=true

2.3版本的参考文档，

可以看看Breaking changes

  1. 2.3-Breaking changes
  2. 2.2-Breaking changes
  3. 2.1-Breaking changes
  4. 2.0-Breaking changes
  5. 1.6-Breaking changes
  6. 1.4-Breaking changes
  7. 1.0-Breaking changes

参考

distributed
distributed Search Elasticsearch
This post is licensed under CC BY 4.0 by the author.
Recently Updated
Contents