正文

手把手教你写ES存储接口：简单步骤实现数据高效存取

/0 浏览量
0731

在当今大数据时代，搜索引擎（Search Engine）在处理海量数据方面发挥着至关重要的作用。Elasticsearch（简称ES）是一款高性能、可伸缩的全文搜索和分析引擎，它可以帮助我们快速、高效地存储和检索数据。本文将手把手教你如何编写ES存储接口，实现数据的快速存取。

一、准备工作

在开始编写ES存储接口之前，我们需要做一些准备工作：

  1. 安装Elasticsearch：从Elasticsearch官网下载并安装Elasticsearch，确保其正常运行。

  2. 安装Java环境：Elasticsearch使用Java编写，因此需要安装Java环境。

  3. 安装Elasticsearch客户端库：为了方便我们与Elasticsearch进行交互，需要安装Elasticsearch客户端库。以下是一些常用的客户端库：

    • Java客户端：Elasticsearch Java API
    • Python客户端：Elasticsearch-py
    • Node.js客户端：elasticsearch
    • Go客户端：elasticsearch-go

在本文中，我们将使用Java客户端进行演示。

二、创建Elasticsearch客户端

首先，我们需要创建一个Elasticsearch客户端，以便与Elasticsearch集群进行交互。以下是一个简单的示例：

import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.RestClient;

public class ElasticsearchClient {
    private RestHighLevelClient client;

    public ElasticsearchClient(String hostname, int port) {
        this.client = new RestHighLevelClient(
                RestClient.builder(new HttpHost(hostname, port, "http")));
    }

    public void close() throws IOException {
        client.close();
    }

    public RestHighLevelClient getClient() {
        return client;
    }
}

在上面的代码中，我们创建了一个名为ElasticsearchClient的类，它包含一个RestHighLevelClient对象。我们通过构造函数传入Elasticsearch的主机名和端口号来初始化客户端。

三、创建索引

在Elasticsearch中，数据存储在索引（Index）中。首先，我们需要创建一个索引，以便存储数据。以下是一个简单的示例：

import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;

public void createIndex(ElasticsearchClient client, String indexName) throws IOException {
    CreateIndexRequest request = new CreateIndexRequest(indexName);
    CreateIndexResponse response = client.indices().create(request, RequestOptions.DEFAULT);
    System.out.println("Index created: " + response.isAcknowledged());
}

public boolean indexExists(ElasticsearchClient client, String indexName) throws IOException {
    GetIndexRequest request = new GetIndexRequest(indexName);
    GetIndexResponse response = client.indices().get(request, RequestOptions.DEFAULT);
    return response.getIndices().length > 0;
}

在上面的代码中，我们定义了两个方法：createIndex和indexExists。createIndex方法用于创建索引，indexExists方法用于检查索引是否存在。

四、插入数据

接下来，我们将学习如何将数据插入到Elasticsearch索引中。以下是一个简单的示例：

import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.index.Index;
import org.elasticsearch.index.query.QueryBuilders;
import org.elasticsearch.index.reindex.BulkByScrollResponse;
import org.elasticsearch.index.reindex.DeleteByQueryRequest;
import org.elasticsearch.index.reindex.UpdateByQueryRequest;
import org.elasticsearch.search.builder.SearchSourceBuilder;
import org.elasticsearch.search.sort.SortOrder;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
        public void insertData(ElasticsearchClient client, String indexName, String id, Map<String, Object> data) throws IOException {
            IndexRequest request = new IndexRequest(indexName).id(id).source(data);
            IndexResponse response = client.index(request, RequestOptions.DEFAULT);
            System.out.println("Document inserted: " + response.getId());
        }

在上面的代码中，我们定义了一个名为insertData的方法，它用于将数据插入到Elasticsearch索引中。我们通过传入索引名称、文档ID和数据来创建一个IndexRequest对象，然后使用client.index方法将数据插入到索引中。

五、查询数据

在插入数据后，我们通常需要查询数据以满足业务需求。以下是一个简单的示例：

import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.index.query.QueryBuilders;
import org.elasticsearch.search.builder.SearchSourceBuilder;
import org.elasticsearch.search.sort.SortOrder;

public void searchData(ElasticsearchClient client, String indexName, String query) throws IOException {
    SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
    searchSourceBuilder.query(QueryBuilders.matchQuery("field", query));
    searchSourceBuilder.sort("field", SortOrder.ASC);
    SearchRequest searchRequest = new SearchRequest(indexName);
    searchRequest.source(searchSourceBuilder);
    SearchResponse searchResponse = client.search(searchRequest, RequestOptions.DEFAULT);
    System.out.println("Search results: " + searchResponse.getHits().getTotalHits().value);
}

在上面的代码中，我们定义了一个名为searchData的方法，它用于查询Elasticsearch索引中的数据。我们通过传入索引名称和查询条件来创建一个SearchSourceBuilder对象，然后使用client.search方法执行查询。

六、更新和删除数据

除了插入和查询数据外，我们还需要对数据进行更新和删除操作。以下是一些简单的示例：

import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
import org.elasticsearch.client.indices.GetIndexRequest;
import org.elasticsearch.client.indices.GetIndexResponse;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.indices.CreateIndexRequest;
import org.elasticsearch.client.indices.CreateIndexResponse;
        public void updateData(ElasticsearchClient client, String indexName, String id, Map<String, Object> data) throws IOException {
            UpdateRequest request = new UpdateRequest(indexName, id).doc(data);
            UpdateResponse response = client.update(request, RequestOptions.DEFAULT);
            System.out.println("Document updated: " + response.getId());
        }

        public void deleteData(ElasticsearchClient client, String indexName, String id) throws IOException {
            DeleteRequest request = new DeleteRequest(indexName, id);
            DeleteResponse response = client.delete(request, RequestOptions.DEFAULT);
            System.out.println("Document deleted: " + response.getId());
        }

在上面的代码中，我们定义了两个方法：updateData和deleteData。updateData方法用于更新Elasticsearch索引中的数据，deleteData方法用于删除数据。

七、总结

通过本文的介绍，相信你已经掌握了如何编写ES存储接口，实现数据的快速存取。在实际应用中，你可以根据具体需求对上述代码进行修改和扩展。希望本文对你有所帮助！

-- 展开阅读全文 --