Tagged Questions
Elasticsearch is an Open Source (Apache 2), Distributed, RESTful, Search Engine built on top of Lucene.
0
votes
0answers
4 views
Passing reduced ES query results to SQL
This is a follow-up question to How to pass ElasticSearch query to hadoop.
Basically, I want to do a full-text-search in ElasticSearch and then pass the result set to SQL to run an aggregation query. ...
0
votes
0answers
4 views
Unknown issue in Nutch elastic indexing
I am very new to Apache Nutch. I tried crawling a small set of urls by running nutch 1.12 in distributed mode on aws emr. Everything works fine until the dedup crawldb phase. During the indexing phase ...
0
votes
0answers
8 views
Aggregating elasticsearch data based on keys which contains colon with regular expression
I am looking to get the aggregated data from elasticsearch based on the keys which contain colon, and I am providing regular expression for that key. I have written down the query, but it is giving ...
0
votes
0answers
24 views
JSON request body - objective c formatting
I've got an iOS app written in obj-c which takes a query typed into a search box and performs a multi match field query on the elasticsearch api. Can someone help with the formatting of the JSON ...
0
votes
0answers
5 views
Combine two float fields into a geo_point field
I'm getting an external stream of data that has (among many other fields) two fields that represent latitude and longitude. I'm trying to figure out a mapping that will allow me to merge these two ...
1
vote
1answer
13 views
Elasticsearch monitoring indices
I am new to ELK stack and playing around with it in a development environment. That's why I end up deleting an index (DELETE /index_name) and recreating multiple times. Deleting an index that I ...
0
votes
0answers
15 views
How to add two separate fields and aggregate over that sum
I have some mock data for banks in elastic search which looks like this:
{
"_index": "test_data",
"_type": "test_type",
"_id": "AVobMd1YHpQD-9cT3TmO",
"_score": 1,
"_source": {
"bank_name": "...
0
votes
0answers
14 views
Elasticsearch boolean facets returned as wrong type
I'm using ES v5.1.2 and having an issue with the facets returning incorrect types for boolean fields. Here's a minimal setup to reproduce and demonstrate the problem:
from elasticsearch_dsl import ...
0
votes
1answer
9 views
Elasticsearch. Can not find custom analyzer
I have model like this:
@Getter
@Setter
@Document(indexName = "indexName", type = "typeName")
@Setting(settingPath = "/elastic/elastic-setting.json")
public class Model extends BaseModel {
@Field(...
0
votes
0answers
14 views
Filtering Source using the Java API
I'm trying to limit my Java API-run Elasticsearch queries so that they only return some specific fields from _source.
The analogous query using the REST API looks like:
curl -X GET http://localhost:...
0
votes
1answer
9 views
Nested count queries
i'm looking to add a feature to an existing query. Basically, I run a query that returns say 1000 documents. Those documents all have the same structure, only the values of certain fields vary. What i'...
0
votes
0answers
15 views
What is the theory behind, Elasticsearch indexing the unstructured data like pdf files?
I have read about full-text searches from elasticsearch documentation but not able to understand the algorithm it uses for indexing pdf files.
0
votes
1answer
13 views
Is it a bad architectural choice to use both Varnish and elasticsearch?
I have a REST service that users use and a Varnish cache in front of it to protect the database from too many requests.
A new requirement came by to be able to perform quick searches on the data set ...
0
votes
0answers
15 views
Node js- change connection dynamically
I am using elasticsearch and nodejs+express, I have several elasticsearch cluster, what I want to achieve is that- user can select which one they want to use from a dropdown.
Currently, I have a ...
0
votes
1answer
17 views
ElasticSearch Filtered query
I created an elastic search index and the result of a simple search looks like:
{
"took": 2,
"timed_out": false,
"_shards": {
"total": 5,
"successful": 5,
"failed": 0
},
"hits": ...
0
votes
0answers
7 views
Error in creating repository in azure using azure cloud plugin?
I created storage account in azure but when i create a repository in azure it is showing error like this.
I given command as
PUT _snapshot/azurerepository
{
"type": "azure"
}
Response
{
"error"...
0
votes
0answers
7 views
Inserting arrays in Elasticsearch via PySpark
I have a case much like this one:
Example DataFrame:
from pyspark.sql.types import *
schema = StructType([ # schema
StructField("id", StringType(), True),
StructField("email", ArrayType(...
0
votes
1answer
10 views
How I can get a simple query multimatch text in SQL in Elasticsearch?
How I can get this simple query in Elasticsearch?
SELECT * FROM [mytype] WHERE name = alex AND health = good
I'm really having troubles with its syntax, multi-match queries don't work in my case, ...
1
vote
2answers
27 views
How not to parse some fields?
I have a log-file which looks like this (simplified):
{ "startDate": "2015-05-27", "endDate": "2015-05-27",
"request" : {"requestId":"123","field2":1,"field2": 2,"field3":3, ....} }
Log-...
1
vote
1answer
13 views
Elasticsearch constant_score does not suport multi_match
I have a query in Elasticsearch where I want a match on multiple fields to get a constant score
"query": {
"bool": {
"must": [
{
"constant_score": {
"...
0
votes
0answers
8 views
Apache Reverse Proxy not redirecting URL with special charcaters
I have set up a reverse proxy using apache mod_proxy, and it is working fine for all the URLs I set up, except some URLs which contain special characters (specifically *)
I tried encoding the special ...
0
votes
0answers
7 views
logstash-input-twitter plugin issue with proxy
I am using logstash 5.2.1 when I run the twitter-input plug in without the proxy it works fine but when i run it with proxy it give me
reach end of file error
here is the configuration file of ...
0
votes
1answer
10 views
ElasticSearch in Windows docker image vm max map coun
I am new to docker and elastic search.'
I am using Windows 7 machine. I am using docker-compose up to bring up the docker. My yml file has
elasticsearch:
image: elasticsearch:5.1.1
...
1
vote
0answers
21 views
ElasticSearch aggregations for facet search (mongoosastic)
I have been struggling with something lately. I am using Node.js with mongoosastic and ElasticSearch for search engine on the project I am working for.
The problem is that I need to do a facet filter ...
0
votes
0answers
22 views
how to use elasticsearch in Wagtail CMS?
Can anyone give a brief tutorial on 'how to implement elasticsearch in wagtail cms.'
i am new at both wagtail and elastic search. i have gone through the documentation of implementing search in ...
0
votes
0answers
12 views
Is it possible to define an io scheduler at boot time for specific device
I am looking for a way to define an io scheduler for a specific device, and I want to make it persistent upon reboot.
I am trying to do this for an elasticsearch node which use a partition as data ...
0
votes
1answer
10 views
How to create percolate index in Elasticsearch by multiple fields
I have an index: products
curl -XPUT "http://localhost:9200/products/product/1" -d'
{
"title": "Iphone 6",
"category_id": 4,
"price": 7788,
"owner_id": 21
}'
How to create percolate ...
0
votes
0answers
18 views
How to index a pdf file using Elasticsearch ingest-attachment plugin?
I have to implement a full-text based search in a pdf document using Elasticsearch ingest plugin. I'm getting an empty hit array when I'm trying to search the word someword in the pdf document.
//...
0
votes
1answer
26 views
Search By Partial word of a sentence in elastic search
I am very new to Elastic Search , I want to search a result based on a partial word of a sentence , like the search string is
"val"
and it should search the result with string value
"value is ...
0
votes
1answer
22 views
How to map doctrine array to elastic search
I don't know how to map an array from a doctrine entity to elastic search.
Indexation seems working for 1 but not for the second.
Here is my entity :
/**
* @var array $viewers
* @ORM\Column(name=...
0
votes
1answer
25 views
REST API, Elasticsearch and Ember.js [on hold]
I'm devellopping a web application with an Ember.js application and a RESTapi built with laravel.
I would like to use Elasticsearch to search data with location, date & match filter. For now I ...
0
votes
0answers
13 views
Error when I run re-indexing data after model changed
I have User model and specified index for only username field => It worked:
class User {
@Field(type = FieldType.String, index = FieldIndex.analyzed)
private String username;
@Field(type = ...
0
votes
1answer
20 views
Elastic search - search_after parameter
I read this doc to understand 'search_after' and have two question.
I'm curious that where "tweet#654323" comes from. Is this one of
document id or field data?
When I added multiple parameter of ...
0
votes
1answer
16 views
Get count of particular field in a document using Elasticsearch
Requirement:
I want to find the count of aID for a particular category ID.
(i.e for categoryID 2532 i want the count as 2 that means it is assigned to two aID's).
I tried with aggregations but with ...
0
votes
1answer
7 views
Not able to create a index with specific shard numbers in ES
Am working on ES to create some new index in ES by limiting the shard number using below command
curl -XPUT localhost:9200/es_test_index '{ "settings : { "number_of_shards" ; 2 } }'
but there is ...
0
votes
2answers
22 views
Must match query is not working in elastic search
I am tying to find all Videos with the name "The Shining"
but also with a parent_id = 189, and parent_type = "folder"
My query seams to connect all of the match statements with "OR" instead of "AND"
...
0
votes
0answers
9 views
Elastic Search - java api for inner hit
I made some query like below.
"query" : {
"nested" : {
"path" : "comments.votes",
"query" : { ... },
"inner_hits" : {}
}
}
and I convert it as java api
QueryBuilders.boolQuery()....
0
votes
0answers
8 views
my elastic search query is matching videos it is not supposed to be [duplicate]
I am doing a search in elastic search with a match,
however other videos are being displayed that do not match "the Shining"
I need to ensure that all matches have the parent_id 189, and parent_type ...
0
votes
0answers
12 views
Elasticsearch store size 1,000 times the document byte size
I am experiencing a roughly 1,000x increase in store.size over the document byte size. I've got a very simple mapping with very small documents (less than 1kb) and I've compared my mapping to ...
0
votes
1answer
26 views
How to pass ElasticSearch query to hadoop
I am working on a project to allow searching on Hadoop. How it works is the query is first passed to ES, then the resulting IDs are passed back to SQL, like so:
SELECT ... WHERE id in [1,24,383,2912,....
0
votes
1answer
17 views
Is constant_score faster in ElasticSearch queries if I don't care about scoring?
I make several queries to ElasticSearch to retrieve documents by keywords (I match them by code or internal id's). I don't really care about scoring in those queries, just retrieving the documents.
...
0
votes
1answer
13 views
Elasticsearch Partial match or fuzzy match, boost partial results
Trying to query in Elasticsearch w/ the PHP client and give priority to partial words matches but still include fuzzy matches. If I remove the address.company match block, the query works as expected, ...
0
votes
0answers
12 views
Elasticsearch Date conversion on insertion
Is it possible to convert a date string to a specified date format in Elastic search?
Specifically, if I pass in "2016-09-17T00:00:02.475+00:00", can I specify some sort of convert mapping within ES ...
0
votes
3answers
35 views
Extract all status codes from a JSON response using a regex
I would like to extract all the status codes from a JSON response (Elasticsearch response to a bulk request) so that I can count how many documents have been created and how many errored.
Which regex ...
0
votes
0answers
7 views
Elasticsearch PHP 2.0 deleteByQuery alternatives
Looks like deleteByQuery is deprecated in PHP 2.0 elasticsearch API. Is there any alternative to it? I want to remove all records matching criteria
0
votes
0answers
8 views
How to structure scripture-based lookups in elastic search
My objective is to provide chapter/verse-based searching functionality. I'll have content that has a book, chapter and verse references associated with it. I'd like for the searcher to be able to ...
0
votes
1answer
23 views
Elasticsearch.net - NEST Scroll keeps returning the same results
I'm trying to understand why an elasticsearch.net NEST scroll call keeps returning the same results. I have an outer loop in my C# application that tracks the current page and it's passed in along ...
0
votes
1answer
14 views
Empty inner_hits in compound Elasticsearch filter
I'm seeing what appears to be aberrant behavior in inner_hits results within nested boolean queries.
Test data (abbreviated for brevity):
# MAPPING
PUT unit_testing
{
"mappings": {
"...
0
votes
0answers
8 views
Slicing Array in elastic search
I am working with Java Api of elastic search.
Lets say I fetch below mentioned json data from elastic search.
{
"id":"123",
"genres":[{"key":"EN","value":"action"},{"key":"FR","value":"...
0
votes
1answer
25 views
ElasticSearch query
Id Field Data
--------------------------------------------------
1 A Data1
2 B Data2
2 ...