Elasticsearch具體版本強依賴性
Elasticsearch以及其周邊的相關平臺都是強版本依賴的,升級過程也需要升級其他相關組件。
目前Elasticsearch的6.x相當于3.x。之所以從2一躍跳到6,Elastic體系內還有Kibana,Logstash,Beats等產品。為了統一各產品版本,所以直接將Elasticsearch的版本從2提升到6 ,6.x版本提供了許多新的特性,并且基于Lucene7.x
性能方面:
1.磁盤空間可以節省近一半
2.索引時間減少近50%
3.查詢性能提升近30%
4.支持IPV6
性能的具體數據可以查看Elasticsearch性能監控。性能的提升主要是Lucene6版本之后的很多底層結構的優化。Lucene6使用Block K-D trees
數據結構來構建索引。BKD Trees
是一種可以動態擴展的KD-tree
結構。
想了解BKD Trees可以參考:
https://users.cs.duke.edu/~pankaj/publications/papers/bkd-sstd.pdf
Elasticsearch也是一種數據庫,屬于非關系型數據庫,不需要自己建庫建表
與SpringBoot進行集成
依賴引入
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-web</artifactId>
</dependency>
<dependency>
<groupId>org.springframework.boot</groupId>
<artifactId>spring-boot-starter-data-elasticsearch</artifactId>
</dependency>
實體類:
@Data
@Document(indexName = "province", type = "city")
public class City implements Serializable {
@Id
@Field(fielddata = true)
private Long id;
private String score;
private String name;
private String description;
}
加上@Id
注解后,在Elasticsearch里對應的該列就是主鍵了,在查詢時就可以直接用主鍵查詢
相關代碼說明:
@Document源碼
@Persistent
@Inherited
@Retention(RetentionPolicy.RUNTIME)
@Target({ElementType.TYPE})
public @interface Document {
String indexName();
String type() default "";
boolean useServerConfiguration() default false;
short shards() default 5;
short replicas() default 1;
String refreshInterval() default "1s";
String indexStoreType() default "fs";
boolean createIndex() default true;
}
indexName()
:索引庫的名稱,建議以項目的名稱命名,類似于關系型數據庫中數據庫
type()
:類型,建議以實體的名稱命名,類似于關系型數據庫中數據庫表
useServerConfiguration()
:是否使用服務器配置
shards()
:默認分區數
replicas()
:每個分區默認的備份數
refreshInterval()
:刷新間隔
indexStoreType()
:索引文件存儲類型
createIndex()
:是否創建索引
@Field源碼
@Retention(RetentionPolicy.RUNTIME)
@Target({ElementType.FIELD})
@Documented
@Inherited
public @interface Field {
FieldType type() default FieldType.Auto;
boolean index() default true;
DateFormat format() default DateFormat.none;
String pattern() default "";
boolean store() default false;
boolean fielddata() default false;
String searchAnalyzer() default "";
String analyzer() default "";
String normalizer() default "";
String[] ignoreFields() default {};
boolean includeInParent() default false;
String[] copyTo() default {};
}
type()
:類型,默認自動檢測,也可以根據實際情況設置
index()
:原來的analyzed/not_analyzed/no
變為只接受boolean
值。分別代替not_analyzed/no
format()
:時間類型的格式化
store()
:是否存儲原文
searchAnalyzer()
:指定字段搜索時使用的分詞器
ignoreFields()
:忽略某個字段
注:因為Elasticsearch
6.x中的Mapping
改變,原有的@Field(type = FieldType.string)
類型的索引映射需要替換成@Field(type = FieldType.Keyword)
或者@Field(type = FieldType.Text)
。 要精確搜索就用Keyword
,否則用Text
。如果不需要通過該字段進行查詢,則index
設置false
即可。
可能出現的報錯:
Caused by: java.lang.IllegalArgumentException: mapper [xx] of different type, current_type [xxx], merged_type [xxx]
因為索引已經存在了,創建索引時不會覆蓋原有的,所以刪除原有的就不會報錯了
數據操作層
Spring Data JPA和Spring Data Elasticsearch共享相同的通用基礎架構。與JPA存儲庫一樣,基本原則是基于方法名稱自動構造查詢。
public interface CityRepository extends ElasticsearchRepository<City,Long> {
}
ElasticsearchRepository源碼
@NoRepositoryBean
public interface ElasticsearchRepository<T, ID extends Serializable> extends ElasticsearchCrudRepository<T, ID> {
<S extends T> S index(S var1);
Iterable<T> search(QueryBuilder var1);
Page<T> search(QueryBuilder var1, Pageable var2);
Page<T> search(SearchQuery var1);
Page<T> searchSimilar(T var1, String[] var2, Pageable var3);
void refresh();
Class<T> getEntityClass();
}
為什么具有Crud操作呢
注意看以下繼承關系
public interface ElasticsearchCrudRepository<T, ID extends Serializable> extends PagingAndSortingRepository<T, ID>
public interface PagingAndSortingRepository<T, ID> extends CrudRepository<T, ID>
不難發現最后有繼承CrudRepository
接口
CrudRepository源碼
@NoRepositoryBean
public interface CrudRepository<T, ID> extends Repository<T, ID> {
<S extends T> S save(S var1);
<S extends T> Iterable<S> saveAll(Iterable<S> var1);
Optional<T> findById(ID var1);
boolean existsById(ID var1);
Iterable<T> findAll();
Iterable<T> findAllById(Iterable<ID> var1);
long count();
void deleteById(ID var1);
void delete(T var1);
void deleteAll(Iterable<? extends T> var1);
void deleteAll();
}
控制層
實現簡單的添加功能
@RestController
public class CityRestController {
private final CityRepository cityRepository;
@Autowired
public CityRestController(CityRepository cityRepository) {
this.cityRepository = cityRepository;
}
@PostMapping("/api/city")
public City createCity(@RequestBody City city) {
return cityRepository.save(city);
}
}
yml配置文件
spring:
data:
elasticsearch:
cluster-nodes: localhost:9300
cluster-name: my-application
server:
port: 8888
注:記得修改目錄config
下的elasticsearch.yml
配置文件
1.把cluster.name:my-application
注釋打開
2.network.host
改為localhost
,也就是network.host: localhost
下面使用postman測試下
再插入一條數據
{
"id":2,
"score":"5",
"name":"廣州",
"description":"也是一線城市"
}
查看Elasticsearch的數據
head插件下
kibana客戶端下
第一次進入kibana如果提示沒索引就創建下,索引名就是indexName
有Table和JSON兩種查看方式
注:插入數據的主鍵如果相同,新數據將會覆蓋舊數據
推薦參考:
接口文檔:
https://docs.spring.io/spring-data/elasticsearch/docs/3.1.3.RELEASE/reference/html/
API文檔:
https://docs.spring.io/spring-data/elasticsearch/docs/3.1.3.RELEASE/api/
Elasticsearch查詢
我們都知道es是一個分布式的存儲和檢索系統,在存儲的時候默認是根據每條記錄的_id字段做路由分發的,這意味著es服務端是準確知道每個document分布在那個shard上的。
相對比于CURD上操作,search一個比較復雜的執行模式,因為我們不知道那些document會被匹配到,任何一個shard上都有可能,所以一個search請求必須查詢一個索引或多個索引里面的所有shard才能完整的查詢到我們想要的結果。
QueryBuilder 是Elasticsearch中提供的一個查詢接口,
具體實現需要使用QueryBuilders進行查詢
public final class QueryBuilders {
private QueryBuilders() {
}
public static MatchAllQueryBuilder matchAllQuery() {
return new MatchAllQueryBuilder();
}
public static MatchQueryBuilder matchQuery(String name, Object text) {
return new MatchQueryBuilder(name, text);
}
public static CommonTermsQueryBuilder commonTermsQuery(String fieldName, Object text) {
return new CommonTermsQueryBuilder(fieldName, text);
}
public static MultiMatchQueryBuilder multiMatchQuery(Object text, String... fieldNames) {
return new MultiMatchQueryBuilder(text, fieldNames);
}
public static MatchPhraseQueryBuilder matchPhraseQuery(String name, Object text) {
return new MatchPhraseQueryBuilder(name, text);
}
public static MatchPhrasePrefixQueryBuilder matchPhrasePrefixQuery(String name, Object text) {
return new MatchPhrasePrefixQueryBuilder(name, text);
}
public static DisMaxQueryBuilder disMaxQuery() {
return new DisMaxQueryBuilder();
}
public static IdsQueryBuilder idsQuery() {
return new IdsQueryBuilder();
}
public static IdsQueryBuilder idsQuery(String... types) {
return (new IdsQueryBuilder()).types(types);
}
public static TermQueryBuilder termQuery(String name, String value) {
return new TermQueryBuilder(name, value);
}
public static TermQueryBuilder termQuery(String name, int value) {
return new TermQueryBuilder(name, value);
}
public static TermQueryBuilder termQuery(String name, long value) {
return new TermQueryBuilder(name, value);
}
public static TermQueryBuilder termQuery(String name, float value) {
return new TermQueryBuilder(name, value);
}
public static TermQueryBuilder termQuery(String name, double value) {
return new TermQueryBuilder(name, value);
}
public static TermQueryBuilder termQuery(String name, boolean value) {
return new TermQueryBuilder(name, value);
}
public static TermQueryBuilder termQuery(String name, Object value) {
return new TermQueryBuilder(name, value);
}
public static FuzzyQueryBuilder fuzzyQuery(String name, String value) {
return new FuzzyQueryBuilder(name, value);
}
public static FuzzyQueryBuilder fuzzyQuery(String name, Object value) {
return new FuzzyQueryBuilder(name, value);
}
public static PrefixQueryBuilder prefixQuery(String name, String prefix) {
return new PrefixQueryBuilder(name, prefix);
}
public static RangeQueryBuilder rangeQuery(String name) {
return new RangeQueryBuilder(name);
}
public static WildcardQueryBuilder wildcardQuery(String name, String query) {
return new WildcardQueryBuilder(name, query);
}
public static RegexpQueryBuilder regexpQuery(String name, String regexp) {
return new RegexpQueryBuilder(name, regexp);
}
public static QueryStringQueryBuilder queryStringQuery(String queryString) {
return new QueryStringQueryBuilder(queryString);
}
public static SimpleQueryStringBuilder simpleQueryStringQuery(String queryString) {
return new SimpleQueryStringBuilder(queryString);
}
public static BoostingQueryBuilder boostingQuery(QueryBuilder positiveQuery, QueryBuilder negativeQuery) {
return new BoostingQueryBuilder(positiveQuery, negativeQuery);
}
public static BoolQueryBuilder boolQuery() {
return new BoolQueryBuilder();
}
public static SpanTermQueryBuilder spanTermQuery(String name, String value) {
return new SpanTermQueryBuilder(name, value);
}
public static SpanTermQueryBuilder spanTermQuery(String name, int value) {
return new SpanTermQueryBuilder(name, value);
}
public static SpanTermQueryBuilder spanTermQuery(String name, long value) {
return new SpanTermQueryBuilder(name, value);
}
public static SpanTermQueryBuilder spanTermQuery(String name, float value) {
return new SpanTermQueryBuilder(name, value);
}
public static SpanTermQueryBuilder spanTermQuery(String name, double value) {
return new SpanTermQueryBuilder(name, value);
}
public static SpanFirstQueryBuilder spanFirstQuery(SpanQueryBuilder match, int end) {
return new SpanFirstQueryBuilder(match, end);
}
public static SpanNearQueryBuilder spanNearQuery(SpanQueryBuilder initialClause, int slop) {
return new SpanNearQueryBuilder(initialClause, slop);
}
public static SpanNotQueryBuilder spanNotQuery(SpanQueryBuilder include, SpanQueryBuilder exclude) {
return new SpanNotQueryBuilder(include, exclude);
}
public static SpanOrQueryBuilder spanOrQuery(SpanQueryBuilder initialClause) {
return new SpanOrQueryBuilder(initialClause);
}
public static SpanWithinQueryBuilder spanWithinQuery(SpanQueryBuilder big, SpanQueryBuilder little) {
return new SpanWithinQueryBuilder(big, little);
}
public static SpanContainingQueryBuilder spanContainingQuery(SpanQueryBuilder big, SpanQueryBuilder little) {
return new SpanContainingQueryBuilder(big, little);
}
public static SpanMultiTermQueryBuilder spanMultiTermQueryBuilder(MultiTermQueryBuilder multiTermQueryBuilder) {
return new SpanMultiTermQueryBuilder(multiTermQueryBuilder);
}
public static FieldMaskingSpanQueryBuilder fieldMaskingSpanQuery(SpanQueryBuilder query, String field) {
return new FieldMaskingSpanQueryBuilder(query, field);
}
public static ConstantScoreQueryBuilder constantScoreQuery(QueryBuilder queryBuilder) {
return new ConstantScoreQueryBuilder(queryBuilder);
}
public static FunctionScoreQueryBuilder functionScoreQuery(QueryBuilder queryBuilder) {
return new FunctionScoreQueryBuilder(queryBuilder);
}
public static FunctionScoreQueryBuilder functionScoreQuery(QueryBuilder queryBuilder, FilterFunctionBuilder[] filterFunctionBuilders) {
return new FunctionScoreQueryBuilder(queryBuilder, filterFunctionBuilders);
}
public static FunctionScoreQueryBuilder functionScoreQuery(FilterFunctionBuilder[] filterFunctionBuilders) {
return new FunctionScoreQueryBuilder(filterFunctionBuilders);
}
public static FunctionScoreQueryBuilder functionScoreQuery(ScoreFunctionBuilder function) {
return new FunctionScoreQueryBuilder(function);
}
public static FunctionScoreQueryBuilder functionScoreQuery(QueryBuilder queryBuilder, ScoreFunctionBuilder function) {
return new FunctionScoreQueryBuilder(queryBuilder, function);
}
public static MoreLikeThisQueryBuilder moreLikeThisQuery(String[] fields, String[] likeTexts, Item[] likeItems) {
return new MoreLikeThisQueryBuilder(fields, likeTexts, likeItems);
}
public static MoreLikeThisQueryBuilder moreLikeThisQuery(String[] likeTexts, Item[] likeItems) {
return moreLikeThisQuery((String[])null, likeTexts, likeItems);
}
public static MoreLikeThisQueryBuilder moreLikeThisQuery(String[] likeTexts) {
return moreLikeThisQuery((String[])null, likeTexts, (Item[])null);
}
public static MoreLikeThisQueryBuilder moreLikeThisQuery(Item[] likeItems) {
return moreLikeThisQuery((String[])null, (String[])null, likeItems);
}
public static NestedQueryBuilder nestedQuery(String path, QueryBuilder query, ScoreMode scoreMode) {
return new NestedQueryBuilder(path, query, scoreMode);
}
public static TermsQueryBuilder termsQuery(String name, String... values) {
return new TermsQueryBuilder(name, values);
}
public static TermsQueryBuilder termsQuery(String name, int... values) {
return new TermsQueryBuilder(name, values);
}
public static TermsQueryBuilder termsQuery(String name, long... values) {
return new TermsQueryBuilder(name, values);
}
public static TermsQueryBuilder termsQuery(String name, float... values) {
return new TermsQueryBuilder(name, values);
}
public static TermsQueryBuilder termsQuery(String name, double... values) {
return new TermsQueryBuilder(name, values);
}
public static TermsQueryBuilder termsQuery(String name, Object... values) {
return new TermsQueryBuilder(name, values);
}
public static TermsQueryBuilder termsQuery(String name, Collection<?> values) {
return new TermsQueryBuilder(name, values);
}
public static WrapperQueryBuilder wrapperQuery(String source) {
return new WrapperQueryBuilder(source);
}
public static WrapperQueryBuilder wrapperQuery(BytesReference source) {
return new WrapperQueryBuilder(source);
}
public static WrapperQueryBuilder wrapperQuery(byte[] source) {
return new WrapperQueryBuilder(source);
}
public static TypeQueryBuilder typeQuery(String type) {
return new TypeQueryBuilder(type);
}
public static TermsQueryBuilder termsLookupQuery(String name, TermsLookup termsLookup) {
return new TermsQueryBuilder(name, termsLookup);
}
public static ScriptQueryBuilder scriptQuery(Script script) {
return new ScriptQueryBuilder(script);
}
public static GeoDistanceQueryBuilder geoDistanceQuery(String name) {
return new GeoDistanceQueryBuilder(name);
}
public static GeoBoundingBoxQueryBuilder geoBoundingBoxQuery(String name) {
return new GeoBoundingBoxQueryBuilder(name);
}
public static GeoPolygonQueryBuilder geoPolygonQuery(String name, List<GeoPoint> points) {
return new GeoPolygonQueryBuilder(name, points);
}
public static GeoShapeQueryBuilder geoShapeQuery(String name, ShapeBuilder shape) throws IOException {
return new GeoShapeQueryBuilder(name, shape);
}
public static GeoShapeQueryBuilder geoShapeQuery(String name, String indexedShapeId, String indexedShapeType) {
return new GeoShapeQueryBuilder(name, indexedShapeId, indexedShapeType);
}
public static GeoShapeQueryBuilder geoIntersectionQuery(String name, ShapeBuilder shape) throws IOException {
GeoShapeQueryBuilder builder = geoShapeQuery(name, shape);
builder.relation(ShapeRelation.INTERSECTS);
return builder;
}
public static GeoShapeQueryBuilder geoIntersectionQuery(String name, String indexedShapeId, String indexedShapeType) {
GeoShapeQueryBuilder builder = geoShapeQuery(name, indexedShapeId, indexedShapeType);
builder.relation(ShapeRelation.INTERSECTS);
return builder;
}
public static GeoShapeQueryBuilder geoWithinQuery(String name, ShapeBuilder shape) throws IOException {
GeoShapeQueryBuilder builder = geoShapeQuery(name, shape);
builder.relation(ShapeRelation.WITHIN);
return builder;
}
public static GeoShapeQueryBuilder geoWithinQuery(String name, String indexedShapeId, String indexedShapeType) {
GeoShapeQueryBuilder builder = geoShapeQuery(name, indexedShapeId, indexedShapeType);
builder.relation(ShapeRelation.WITHIN);
return builder;
}
public static GeoShapeQueryBuilder geoDisjointQuery(String name, ShapeBuilder shape) throws IOException {
GeoShapeQueryBuilder builder = geoShapeQuery(name, shape);
builder.relation(ShapeRelation.DISJOINT);
return builder;
}
public static GeoShapeQueryBuilder geoDisjointQuery(String name, String indexedShapeId, String indexedShapeType) {
GeoShapeQueryBuilder builder = geoShapeQuery(name, indexedShapeId, indexedShapeType);
builder.relation(ShapeRelation.DISJOINT);
return builder;
}
public static ExistsQueryBuilder existsQuery(String name) {
return new ExistsQueryBuilder(name);
}
}
部分方法說明
termQuery("key", obj)
完全匹配
termsQuery("key", obj1, obj2..)
: 一次匹配多個值
matchQuery("key", Obj)
:單個匹配, field不支持通配符, 前綴具高級特性
multiMatchQuery("text", "field1", "field2"..)
:匹配多個字段, field有通配符
matchAllQuery()
:匹配所有
詳細可以參考官方說明:
https://www.elastic.co/guide/en/elasticsearch/client/java-rest/current/java-rest-high-query-builders.html
通過源碼可以看到方法返回的對象時各種Builder
繼承關系都是這樣的
public class xxxxBuilder extends AbstractQueryBuilder<xxxxBuilder>
public abstract class AbstractQueryBuilder<QB extends AbstractQueryBuilder<QB>> implements QueryBuilder
最后都會實現QueryBuilder接口
QueryBuilder源碼
public interface QueryBuilder extends NamedWriteable, ToXContentObject, Rewriteable<QueryBuilder> {
Query toQuery(QueryShardContext var1) throws IOException;
Query toFilter(QueryShardContext var1) throws IOException;
QueryBuilder queryName(String var1);
String queryName();
float boost();
QueryBuilder boost(float var1);
String getName();
default QueryBuilder rewrite(QueryRewriteContext queryShardContext) throws IOException {
return this;
}
}
特殊情況下,ElasticsearchRepository里面有幾個特殊的search方法,這些是ES特有的,和普通的JPA區別的地方,用來構建一些ES查詢的。
主要是看QueryBuilder和SearchQuery兩個參數,要完成一些特殊查詢就主要看構建這兩個參數。
從這個關系中可以看到ES的search方法需要的參數SearchQuery是一個接口,有一個實現類叫NativeSearchQuery,實際使用中,我們的主要任務就是構建NativeSearchQuery來完成一些復雜的查詢的。
NativeSearchQuery源碼
public class NativeSearchQuery extends AbstractQuery implements SearchQuery {
private QueryBuilder query;
private QueryBuilder filter;
private List<SortBuilder> sorts;
private final List<ScriptField> scriptFields = new ArrayList();
private List<FacetRequest> facets;
private List<AbstractAggregationBuilder> aggregations;
private HighlightBuilder highlightBuilder;
private Field[] highlightFields;
private List<IndexBoost> indicesBoost;
public NativeSearchQuery(QueryBuilder query) {
this.query = query;
}
public NativeSearchQuery(QueryBuilder query, QueryBuilder filter) {
this.query = query;
this.filter = filter;
}
public NativeSearchQuery(QueryBuilder query, QueryBuilder filter, List<SortBuilder> sorts) {
this.query = query;
this.filter = filter;
this.sorts = sorts;
}
public NativeSearchQuery(QueryBuilder query, QueryBuilder filter, List<SortBuilder> sorts, Field[] highlightFields) {
this.query = query;
this.filter = filter;
this.sorts = sorts;
this.highlightFields = highlightFields;
}
public NativeSearchQuery(QueryBuilder query, QueryBuilder filter, List<SortBuilder> sorts, HighlightBuilder highlighBuilder, Field[] highlightFields) {
this.query = query;
this.filter = filter;
this.sorts = sorts;
this.highlightBuilder = highlighBuilder;
this.highlightFields = highlightFields;
}
public QueryBuilder getQuery() {
return this.query;
}
public QueryBuilder getFilter() {
return this.filter;
}
public List<SortBuilder> getElasticsearchSorts() {
return this.sorts;
}
public HighlightBuilder getHighlightBuilder() {
return this.highlightBuilder;
}
public Field[] getHighlightFields() {
return this.highlightFields;
}
public List<ScriptField> getScriptFields() {
return this.scriptFields;
}
public void setScriptFields(List<ScriptField> scriptFields) {
this.scriptFields.addAll(scriptFields);
}
public void addScriptField(ScriptField... scriptField) {
this.scriptFields.addAll(Arrays.asList(scriptField));
}
public void addFacet(FacetRequest facetRequest) {
if (this.facets == null) {
this.facets = new ArrayList();
}
this.facets.add(facetRequest);
}
public void setFacets(List<FacetRequest> facets) {
this.facets = facets;
}
public List<FacetRequest> getFacets() {
return this.facets;
}
public List<AbstractAggregationBuilder> getAggregations() {
return this.aggregations;
}
public void addAggregation(AbstractAggregationBuilder aggregationBuilder) {
if (this.aggregations == null) {
this.aggregations = new ArrayList();
}
this.aggregations.add(aggregationBuilder);
}
public void setAggregations(List<AbstractAggregationBuilder> aggregations) {
this.aggregations = aggregations;
}
public List<IndexBoost> getIndicesBoost() {
return this.indicesBoost;
}
public void setIndicesBoost(List<IndexBoost> indicesBoost) {
this.indicesBoost = indicesBoost;
}
}
這里主要看構造方法
QueryBuilder query:查詢構造器
QueryBuilder filter:查詢構造器
List<SortBuilder> sorts:排序構造器
HighlightBuilder highlighBuilder:高亮構造器
Field[] highlightFields:高亮的字段
構造NativeSearchQuery一般不是直接是new ,而是使用NativeSearchQueryBuilder的build方法
源碼如下:
public class NativeSearchQueryBuilder {
private QueryBuilder queryBuilder;
private QueryBuilder filterBuilder;
private List<ScriptField> scriptFields = new ArrayList();
private List<SortBuilder> sortBuilders = new ArrayList();
private List<FacetRequest> facetRequests = new ArrayList();
private List<AbstractAggregationBuilder> aggregationBuilders = new ArrayList();
private HighlightBuilder highlightBuilder;
private Field[] highlightFields;
private Pageable pageable = Pageable.unpaged();
private String[] indices;
private String[] types;
private String[] fields;
private SourceFilter sourceFilter;
private List<IndexBoost> indicesBoost;
private float minScore;
private boolean trackScores;
private Collection<String> ids;
private String route;
private SearchType searchType;
private IndicesOptions indicesOptions;
public NativeSearchQueryBuilder() {
}
public NativeSearchQueryBuilder withQuery(QueryBuilder queryBuilder) {
this.queryBuilder = queryBuilder;
return this;
}
public NativeSearchQueryBuilder withFilter(QueryBuilder filterBuilder) {
this.filterBuilder = filterBuilder;
return this;
}
public NativeSearchQueryBuilder withSort(SortBuilder sortBuilder) {
this.sortBuilders.add(sortBuilder);
return this;
}
public NativeSearchQueryBuilder withScriptField(ScriptField scriptField) {
this.scriptFields.add(scriptField);
return this;
}
public NativeSearchQueryBuilder addAggregation(AbstractAggregationBuilder aggregationBuilder) {
this.aggregationBuilders.add(aggregationBuilder);
return this;
}
public NativeSearchQueryBuilder withFacet(FacetRequest facetRequest) {
this.facetRequests.add(facetRequest);
return this;
}
public NativeSearchQueryBuilder withHighlightBuilder(HighlightBuilder highlightBuilder) {
this.highlightBuilder = highlightBuilder;
return this;
}
public NativeSearchQueryBuilder withHighlightFields(Field... highlightFields) {
this.highlightFields = highlightFields;
return this;
}
public NativeSearchQueryBuilder withIndicesBoost(List<IndexBoost> indicesBoost) {
this.indicesBoost = indicesBoost;
return this;
}
public NativeSearchQueryBuilder withPageable(Pageable pageable) {
this.pageable = pageable;
return this;
}
public NativeSearchQueryBuilder withIndices(String... indices) {
this.indices = indices;
return this;
}
public NativeSearchQueryBuilder withTypes(String... types) {
this.types = types;
return this;
}
public NativeSearchQueryBuilder withFields(String... fields) {
this.fields = fields;
return this;
}
public NativeSearchQueryBuilder withSourceFilter(SourceFilter sourceFilter) {
this.sourceFilter = sourceFilter;
return this;
}
public NativeSearchQueryBuilder withMinScore(float minScore) {
this.minScore = minScore;
return this;
}
public NativeSearchQueryBuilder withTrackScores(boolean trackScores) {
this.trackScores = trackScores;
return this;
}
public NativeSearchQueryBuilder withIds(Collection<String> ids) {
this.ids = ids;
return this;
}
public NativeSearchQueryBuilder withRoute(String route) {
this.route = route;
return this;
}
public NativeSearchQueryBuilder withSearchType(SearchType searchType) {
this.searchType = searchType;
return this;
}
public NativeSearchQueryBuilder withIndicesOptions(IndicesOptions indicesOptions) {
this.indicesOptions = indicesOptions;
return this;
}
public NativeSearchQuery build() {
NativeSearchQuery nativeSearchQuery = new NativeSearchQuery(this.queryBuilder, this.filterBuilder, this.sortBuilders, this.highlightBuilder, this.highlightFields);
nativeSearchQuery.setPageable(this.pageable);
nativeSearchQuery.setTrackScores(this.trackScores);
if (this.indices != null) {
nativeSearchQuery.addIndices(this.indices);
}
if (this.types != null) {
nativeSearchQuery.addTypes(this.types);
}
if (this.fields != null) {
nativeSearchQuery.addFields(this.fields);
}
if (this.sourceFilter != null) {
nativeSearchQuery.addSourceFilter(this.sourceFilter);
}
if (this.indicesBoost != null) {
nativeSearchQuery.setIndicesBoost(this.indicesBoost);
}
if (!CollectionUtils.isEmpty(this.scriptFields)) {
nativeSearchQuery.setScriptFields(this.scriptFields);
}
if (!CollectionUtils.isEmpty(this.facetRequests)) {
nativeSearchQuery.setFacets(this.facetRequests);
}
if (!CollectionUtils.isEmpty(this.aggregationBuilders)) {
nativeSearchQuery.setAggregations(this.aggregationBuilders);
}
if (this.minScore > 0.0F) {
nativeSearchQuery.setMinScore(this.minScore);
}
if (this.ids != null) {
nativeSearchQuery.setIds(this.ids);
}
if (this.route != null) {
nativeSearchQuery.setRoute(this.route);
}
if (this.searchType != null) {
nativeSearchQuery.setSearchType(this.searchType);
}
if (this.indicesOptions != null) {
nativeSearchQuery.setIndicesOptions(this.indicesOptions);
}
return nativeSearchQuery;
}
}
QueryBuilder主要用來構建查詢條件、過濾條件,SortBuilder主要是構建排序。
譬如,我們要查詢距離某個位置100米范圍內的所有人、并且按照距離遠近進行排序
double lat = 39.929986;
double lon = 116.395645;
Long nowTime = System.currentTimeMillis();
//查詢某經緯度100米范圍內
GeoDistanceQueryBuilder builder = QueryBuilders.geoDistanceQuery("address").point(lat, lon)
.distance(100, DistanceUnit.METERS);
GeoDistanceSortBuilder sortBuilder = SortBuilders.geoDistanceSort("address")
.point(lat, lon)
.unit(DistanceUnit.METERS)
.order(SortOrder.ASC);
Pageable pageable = new PageRequest(0, 50);
NativeSearchQueryBuilder builder1 = new NativeSearchQueryBuilder().withFilter(builder).withSort(sortBuilder).withPageable(pageable);
SearchQuery searchQuery = builder1.build();
Elasticsearch與SpringBoot進行集成遇到的問題
1.Caused by: java.lang.IllegalStateException: availableProcessors is already set to [x], rejecting [x]
原因:這是netty與初始化Elasticsearch client沖突時的異常
解決方法
在啟動類中加入System.setProperty("es.set.netty.runtime.available.processors", "false");
public class Application {
public static void main(String[] args) {
System.setProperty("es.set.netty.runtime.available.processors", "false");
SpringApplication.run(Application.class, args);
}
}