All Questions
Tagged with full-text-search elasticsearch
524 questions
0
votes
1
answer
44
views
How to handle alphanumeric combinations (like "Hotel101") in Elasticsearch query results with multi_match?
I am working with Elasticsearch and I have an index that contains entries with alphanumeric combinations like "Hotel101 fort". When I search using a query like "Hotel 101 fort", I ...
0
votes
1
answer
53
views
How do traditional search engines like Lucene handle tokenization and indexing, and why don't they use integer mappings for tokens?
I've been learning about how traditional search engines like Lucene work, and I understand that they typically build an inverted index by tokenizing the text in the corpus. These tokens are then used ...
- 9
0
votes
1
answer
91
views
Azure AI search handling special characters
I have created the following index in Azure AI search,
{
"name": "classic-index",
"defaultScoringProfile": "",
"fields": [
{
...
- 97
0
votes
1
answer
142
views
Best alternatives for a fast search on a big table on a Postgres database?
We have an Express API that connects to a Postgres database using Sequelize.
One of our endpoints returns a list of sales, which accepts different query parameters like page, column order, filters, ...
- 534
0
votes
0
answers
57
views
What to use for text search for a niche e-commerce site using Postgres
I have this small/medium e-commerce site for a niche market. We have tens of thousands of products and are looking to implement of fully functional search bar (previously searched through guided flow/...
0
votes
1
answer
84
views
Elasticsearch Query for Exact Substring Matching with Spaces
I'm trying to perform an exact substring match in Elasticsearch, including substrings that contain spaces. Here’s what I need:
Search for an exact substring within a larger text field.
The substring ...
- 53
0
votes
0
answers
37
views
Georgian full text search solutions
I am developing a web application that should support the Georgian language. And I cannot implement the full text search.
I have various products in my app that have multiple text properties, such as ...
- 73
0
votes
0
answers
35
views
How to Filter Nested Values in Elasticsearch Using Python
I am successfully integrating Elasticsearch into my Python application but facing challenges with nested file type filtering. Specifically, I need the search to return assets that match the query, ...
- 23
0
votes
1
answer
32
views
Elasticsearch - Default token in Analyzer if emitted tokens are empty
The requirement is - when firing a Search query on Elasticsearch index, we have one big Elastic Query DSL query built to run a a search on the index.
For one of the property field, we have applied a ...
0
votes
0
answers
276
views
Indexing data in OpenSearch from single DynamoDB table with multiple sort keys
I have a single DynamoDB table which has data using the same partition key but different sort keys which stores different data structures based on the sort key. The structure of the table is similar ...
- 520
1
vote
0
answers
55
views
Preserving Field Order in Elasticsearch _source Retrieval?
I'm working with Elasticsearch and have encountered an issue with the order of fields within nested objects when retrieving documents using _source.
{
"student_id": "123",
&...
- 23
1
vote
1
answer
210
views
how do I enable full text search for large pdfs in cost effective way?
I have large number of PDFs (to say around 1 million) and those PDFs varies in their size. They could be from 5 pages top 100 pages long. I want my users to be able to do a text search (a google like ...
- 405
1
vote
0
answers
80
views
Elastichsearch deep pagination? Result window is too large, from + size must be less than or equal to: [2000000] but was [22863460]
I am using elasticsearch as a backend to store my application data. Storing data for last 120 days with monthly index pattern. On my application's Live Feed Section i am showing data for mentioned ...
- 61
1
vote
0
answers
139
views
Lucene.Net for full-text search on the site
I am using Lucene.Net for full-text search on the site, in general it turned out to achieve good results, but there is one problem that I can not solve in any way
For example, in the database there is ...
- 11
1
vote
3
answers
518
views
Efficient Text Search for Large Term List: Python vs PostgreSQL vs Elasticsearch
I have a list containing terms that vary in length from 1 to 10 words, with approximately 500,000 entries. My goal is to search for these terms in a long text (converted from a PDF, typically 1.5 to 2 ...
- 1,855
3
votes
1
answer
286
views
Indexing performance and memory usage for Elasticsearch vs Memgraph
I am building a graph search and display system for a huge dataset (all companies and company partner's from a country, so people can find relationships between owners and unrelated companies), ...
0
votes
1
answer
48
views
elasticsearch cannot search by separate terms
I have an es doc, and it is like below.
{
"_index" : "trigger",
"_type" : "_doc",
"_id" : "urn:trigger:(urn:analyticsplatform:uc4):...
- 17
0
votes
1
answer
78
views
Searching documents in Elasticsearch with most common terms with my query but also with least uncommon terms
I am struggling with an Elasticsearch query over a ngrams field. I am trying to fetch those documents that have a value in that field whose ngram tokens are the most similiar to the ones of my query ...
- 13
0
votes
1
answer
212
views
Elasticsearch "AND" Operator Not working as expected with Highlight Query
I'm encountering an issue with Elasticsearch where I'm using a highlight query with the "AND" operator, but it's matching a document that doesn't contain all the specified terms in the query....
0
votes
1
answer
96
views
ElasticSearch find doc by phrase with/without extra words
I use span_near with fuzzy query to search text by phrase. It works well if I type exact phrase even if words order is wrong. But I want to find NOT exact phrase, but something very similar.
For ...
- 341
0
votes
1
answer
22
views
Elastic Search: Query Filter not working with Scripts?
Basically i'm trying to get the record_created_at dates where day is Monday
I've wrote below script in query
Query:
{
"_source": "false",
"query": {
"...
- 1,171
0
votes
1
answer
592
views
`index_prefixes` in OpenSearch?
I am very new to the elastic/ opensearch technologies so pardon me if my understanding is inadequate.
I am trying to implement a search feature using OpenSearch where the user can type in any part of ...
- 47
0
votes
1
answer
280
views
Missing data during processing documentdb stream via lambda
I want to introduce full text query based on documentdb, opensearch and lambda (AWS Cloud). I prepared small architecture:
Documentdb cluster, with two instances and changeStreams set on true
Lambda ...
- 11
0
votes
1
answer
94
views
ElasticSearch: advanced search inside the array of objects
Let's assume that I have the following documents stored in Elasticsearch:
{
id: '349dec5f-4ddf-4faa-beb0-79a0ea08bad6',
name: 'Iphone 13',
criteria: [
{
name: 'color',
options: ['...
0
votes
1
answer
83
views
Elastic search - Seacrh by free text, sort by numeric all of it within a radius
Trying to search within an Index by query string, sort by numeric field all within a specific radius.
There is no reference in the Elastic documentation, so I may have to solve it at the application ...
0
votes
0
answers
47
views
Multiple wildcards in single elasticsearch query
I am trying to get some results from elasticsearch using the below query. But it gives no result. I have data which should come in the result. If i run any of the mentioned wildcard then it gives ...
- 1,720
0
votes
1
answer
38
views
Searching large text files inside folder for specific text with php
I have request from client to add feature in app that will be like search engine for text files from specific folder. For example inside folder x are 20 doc, docx, txt files and i need to open every ...
- 45
0
votes
0
answers
39
views
How to score elastic query results on dynamic derived attributes of documents
I have a question on information retrieval patterns.
I have close to 10 Mil Documents in my search cluster like these
{
"id":"7ftCdTQAAAAJ",
"authors":[
{
...
- 1
1
vote
0
answers
118
views
How to use stopwords and filters properly in Elasticsearch (python client)
I'm learning Elasticsearch using Python client and have managed to build an index and query function.
Problem: Even if I have used stemmer and stop words in the below settings, when I query a text ...
- 4,132
0
votes
1
answer
61
views
how can I treat whitespace as logical AND in elasticsearch unified highlighter
Currently what I want to do is to treat the elasticSearch highlight query whitespace as a logical and because for example when I give it the following query
"New Zealand" | (flutter | This ...
- 109
2
votes
1
answer
522
views
Elasticsearch: how to index html documents and perform search with "signals"
I have a set of html documents which I want to index into ES. Is there any html parser integrated in ES, that will extract the content of each html file into various fields (e.g. title, headers, bold ...
- 21
1
vote
0
answers
133
views
How does Elasticsearch/Lucene achieve such performance when querying multiple fields?
According to the answer given here, Elasticsearch doesn't seem to use compound indexes for querying multiple fields, and instead queries multiple indexes and then intersects the results.
My question ...
1
vote
1
answer
65
views
In Elasticsearch, how to know which element in the array is chosen by the fuzzysearch when querying against a list
I have a tricky case and want to consult the experts here.
We store our user info in Elasticsearch, an user may have different name aliases, all stored in a "names" array like below
"...
- 11
0
votes
1
answer
123
views
Modify Input Dynamically to Search against data stored in Elastic Search
I am new to Elastic Search, have been reading a lot about it, but I stumbled at one requirement.
Consider a field of type text in all the documents in a index be "app_data"
Now app_data ...
1
vote
1
answer
1k
views
Elastic Search - How to update mapping field from keyword to text
{
"properties":{
"device":{
"type":"object",
"properties":{
"id":{
"type":&...
- 1,046
0
votes
1
answer
174
views
ElasticSearch - Search for value on nested object under any key
I have documents indexed in ES with the following structure:
doc 1:
{
"map": {
"field1": ["foo"],
"field2": ["bar"]
}
}
doc2
{
"map&...
- 1,088
0
votes
1
answer
319
views
Elasticsearch: query best match first
I'm trying to figure out how to query articles from the database using a couple of words. And it should return a list of articles (best match first).
I have some articles like this:
{
"article&...
- 324
0
votes
1
answer
218
views
Does non-indexed field update triggers reindexing in elasticsearch8?
My index mapping is the following:
{
"mappings": {
"dynamic": False,
"properties": {
"query_str": {"type&...
- 311
0
votes
1
answer
33
views
Сount how many requests there were to a specific document
I'm using elasticsearch index as a cache table for some kind of search API.
I am currently using the following mapping:
{
"mappings": {
"dynamic": False,
...
- 311
0
votes
1
answer
538
views
What is the best way to update cache in elasticsearch
I'm using elasticsearch index as a cache table.
My document structure is the following:
{
"mappings": {
"dynamic": False,
"properties": {
...
- 311
0
votes
1
answer
395
views
How to swap two elsticsearch indexes
I want to implement cash for highly loaded elasticsearch-based search system. I want to store cash in special elastic index. The problem is in cache warm-up: once an hour my system needs to update ...
- 311
0
votes
1
answer
472
views
fulltext search in elasticsearch and laravel scout is not working
i implemented elasticsearch and laravel scout in laravel 9.x application
and i also installed matchish/laravel-scout-elasticsearch repository as driver for scout
but the problem is: When the searched ...
- 1,137
0
votes
2
answers
539
views
How to sort a query in Elasticsearch based on another field?
In Elasticsearch, I'm storing data as below:
{
"name" : "John Doe",
"country" : "India"
},
{
"name" : "John Doe",
"country"...
- 627
0
votes
1
answer
23
views
General approach to search into large CSV files in Ruby, at a reasonable time & affordable cost
I found some answers on StackOverflow, but nothing fits exactly my needs.
I am writing a Ruby script to find rows by a specific key into large CSV files (~500MB and 1M records each file).
The grep ...
- 61
0
votes
1
answer
110
views
Elastic search not ranking properly for single character in query
I am unable to get correct results for a particular use in elastic search.
The search query will have the following text tower A flat no 1103. Since I have specified tower A in the search query I ...
0
votes
1
answer
840
views
Bulk indexing in elasticsearch 8.x : 'Action/metadata line [1] contains an unknown parameter [_type]'
I have been trying to do a bulk index in the elasticsearch 8.x using this:
from elasticsearch.helpers import bulk as bulk_indexer
success, failed = bulk_indexer(self.es_client, actions, stats_only=...
- 9
0
votes
1
answer
117
views
elasticsearch fuzzy query seems to ignore brazilian stopwords
I have stopwords for brazilian portuguese configured at my index. but if I made a search for the term "ios" (it's a ios course), a bunch of other documents are returned, because the term &...
- 13
0
votes
0
answers
942
views
How to do basic semantic search using ElasticSearch?
I want to implement basic semantic search in my product search service which uses ElasticSearch.
I am fairly new to ML and NLP and implementing a full contextual search using models trained on search ...
- 473
0
votes
0
answers
40
views
Elasticsearch match phrase prefix - confusion
"query": {
"match_phrase_prefix": {
"product_code": {
"query": "klock"
}
}
}
...
0
votes
1
answer
581
views
Elasticsearch Query NOT searching in the specified fields
I am struggling with an elasticsearch query. In the fields option, we have specified '*' which means it should look in all fields as well as given the higher weights to a few fields. But it isn't ...
- 219