All Questions
164 questions
0
votes
0
answers
38
views
ES log loading error...... (Springboot - elastic,kibana) I'm really going crazy
Version
springboot - 3.1.6
'logback-elasticsearch-appender', version: '1.6'
'logback-access-spring-boot-starter', version: '4.1.0'
- Below is the logback-access-spring.xml I wrote.
<?xml version=&...
1
vote
0
answers
163
views
How to toggle hide and unhide sensitive information in kubernetes and kibana logs that comes from spring boot app?
I have a spring boot app that logs sensitive information in the kubernetes and kibana.
How do I create a flag to toggle hide/unhide sensitive information ?
This sensistive information can be used only ...
- 11
0
votes
1
answer
654
views
How to change date field format in elasticsearch in existing indexes as well
So I have quite lots of documents/indexes , in elastic search .
They have a mapping for a date field , and its format is "epoch_millis" .
I have been asked to change its format to some ...
-1
votes
1
answer
36
views
I am trying to filter results from an array in elasticsearch is a nested fields, but the results are not as expected
I am trying to filter results for store number 1 which are not in a specific date range which in my case is from 2023-01-27 to 2023-07-27, but the result hits are not including which should have.
For ...
0
votes
0
answers
23
views
Does Integration of DataDriven Test framework with kibana make sense?
I have a dilemma. I have a Cucumber-Java framework integrated with Jenkins. It is primarily sequential testing with a lot of different inputs. As an output, I have Extent Reports from Cucumber, and I'...
- 27
0
votes
0
answers
191
views
ElasticSearch Java API Client returning same document multiple times in response
I am using Elasticsearch Java API Client but getting duplicate documents in the response.
Basically, I am trying to fetch documents from MyDocument index, which are in ON mode and have a certain tag ...
- 1
-1
votes
1
answer
494
views
IllegalArgumentException: unhandled Query implementation org.springframework.data.elasticsearch.client.erhlc.NativeSearchQuery
I'm encountering an issue with the Spring Data Elasticsearch library when using JDK 17 and Spring Boot version 3.1. The problem arises when I try to execute a search operation using ...
0
votes
1
answer
191
views
How to configure elastic apm url in application.yml file in spring boot application?
It works just fine in application.properties but it doesn't work with yml file.
This is how I configured in the application properties file
service_name: my-products
server_url: http://corp.myproducts....
- 1
0
votes
0
answers
134
views
Sharing Log4j2 configuration between services to ensure same formatting etc.?
Assume I know how to setup and use Log4j2 for gathering logs from one service.
Now let's consider a case where logging is wanted on a multiple services, let's say 50 just to have a number. Company ...
- 31
1
vote
0
answers
212
views
How to calculate retention in elasticsearch?
I got a request that calculate user's retention in elasticsearch.
In my project, I storage user infomation in one index call user
How to calculate this metric?
For example, I have one index which ...
- 23
0
votes
1
answer
448
views
Convert elasticsearch bool query to Java
GET feeds/_search
{
"query": {
"bool": {
"should": [
{
"nested": {
"path": "comment",
&...
- 23
0
votes
0
answers
109
views
ElasticSearch not running on raspberry pi
I am trying to install and run elasticsearch on my raspberry pi and when I execute the command sudo service elasticsearch restart I don't see elasticsearch running and when I check the status using ...
- 2,134
0
votes
1
answer
81
views
Elastic ExistsRequst for field value and field type
I'm working on a project creating integration tests and the data I have includes all the schema updates people have done in the past. For example My "documents" field has a property of user,...
- 1,013
0
votes
1
answer
221
views
ActiveMQ Artemis metrics in Kibana Elastic?
Based on the ActiveMQ Artemis documentation is it possible to have metrics displayed in Kibana with the help of this plugin?
I am not able to use it, and I did not find any example of how to do that.
...
2
votes
1
answer
176
views
How to write custom Elasticsearch Query in Java?
This is my query on Elasticsearch,
GET index101/_search
{
"query": {
"function_score": {
"boost_mode": "replace",
"query": {
...
- 35
2
votes
1
answer
2k
views
Why is logback.encoder StructuredArguments not printing the log?
Dependency
implementation("net.logstash.logback:logstash-logback-encoder:${version}")
Code Sample
import static net.logstash.logback.argument.StructuredArguments.keyValue;
@Component
@...
- 109
-1
votes
1
answer
635
views
How to write query in kibana Devtool for showing all indexes [closed]
I'm trying to write a query in Kibana DevTools that would give me list of index present in elastic search so how to write query in kibana devtool
GET /.......
0
votes
0
answers
147
views
Problem: indexOf not taking effect when using script syntax in elasticsearch
As shown in the figure, the indexOf of the longer id is valid but the indexOf of the shorter id is all -1.
my search result I would like to know how to make the indexOf for these short ids also take ...
- 1
0
votes
2
answers
973
views
Display "Seq_no" and "primary_term" in Elastic's response
I am trying to retrieve the "_seq_no" and "_primary_term" from my elastic search cluster, however it is not displaying in Kibana or when I run a search through my Java application. ...
- 1,013
0
votes
1
answer
40
views
ElasticSearch get top 2 results per specific term in aggregations
Given this query, i want to retrieve and limit only to top 2 cities from each country.
So, given the most popular country, retrieve top 2 cities, then next country, top 2 cities and etcera.
{
"...
- 27
2
votes
4
answers
3k
views
How I can convert Map to String?
This is my map:
Map<String, Object> params = new HashMap<>();
params.put("topicRef", "update-123456-78925-new-u1z1w3");
params.put("parentRef",...
- 113
0
votes
1
answer
369
views
XML data display in grid using kibana and logstash
I wanted to display XML data using logstash and Kibana in grid format. using below conf file I am able to display data into grid but not able to split row data.
Example:
Output
logstash.conf file :
...
- 362
2
votes
1
answer
2k
views
logback cannot set timezone in Spring Boot App
I have an example related with ELK in my Spring Boot. Even if I defined timezone in logback-spring.xml and set my timezone in dateFormat:tz of Kibana, timestamp in document is 3 hours back of ...
0
votes
0
answers
263
views
Java Script Webstite Logging : Logging on Kibana,eslastic,splunk or Server Side
How do we log JavaScript based website code, what are the best practices and solution.
Currently we do not have any logging in Javascript code, we started with small but now it has become humongous ...
- 850
2
votes
1
answer
661
views
Combine Filebeat Logs to ship to Elastic Search based on unique Trace Id (Without Logstash)
I have configured filebeat for shipping logs of my spring boot application directly to AWS Opensearch Service without configuration of logstash. I want to configure filebeat multiline regex in a way ...
- 21
0
votes
0
answers
127
views
ElastAlert Spike Alert for Multiple API's
I am new to elastic alerts and trying to write an alert where there will be a field in the index with the name api which refers to API name ( String ). Now I want to create a spike alert such that for ...
0
votes
1
answer
387
views
How to send logs into elastic - logstash
I need to send logs into elastic and then watch them with kibana
I've done this
1.this is my yml file
spring:
application:
name: ELK-STACK-EXAMPLE
server:
port: 9898
logging:
file: /...
- 3
0
votes
1
answer
323
views
How to properly store event.duration field in Elastic?
I have a Java service that writes logs in JSON format, they are then picked up by filebeat and sent to Elastic. I would like to be able to set one of the ECS fields (event.duration) described here
I ...
- 339
1
vote
1
answer
582
views
Elasticsearch 7 - query with raw JSON of Kibana
Recently I've started using the Elasticsearch (7.6.x) with Java backend (I'm pretty much a beginner in ES) and I have a general question, I've searched for that but didn't find an answer:
My workflow ...
- 42.3k
0
votes
0
answers
294
views
KIBANA message needed to be splitted using a log pattern
I have a requirement to split the msg field further in KIBANA logs (for service responses) as some fields appear as splited fields instead of showing it as raw text in logs.
Sample response in logs as ...
- 27
0
votes
0
answers
405
views
Logback writing json in kibana not correct
I using logstash-logback-encoder 6.3. I want write structured arguments in Kibana.
My code:
Map<String, String> extractHeaders = ...
log.debug(Markers.append("http", Map.of("url&...
- 1,389
0
votes
1
answer
852
views
ElasticSearch Aggregation Query to Select Top 1 for each Group base on Terms Array values
I have written below ES Query for fetching data Using filter and Must:
I can use only ElasticSearch V5 for writing queries.
{
"bool" : {
"must" : [
{
"term&...
- 790
-2
votes
1
answer
2k
views
How to insert document to an index in elasticsearch without specifying document id using java apis?
I'm new to Elastic search and I'm doing a task in which I need to upload more number of documents to ES. Whenever I upload everytime, I need to specify document id for that document in IndexRequest ...
0
votes
1
answer
1k
views
Impossible to stop Logstash
I am using ELK stack with Netflow module. First of all, when I checked CPU usage Logstash was using a lot of resources and I decided to stop it. This moment Elasticsearch/Kibana/Logstash is stopped. I ...
- 13
0
votes
2
answers
1k
views
How to upload Json Data or file in Elasticsearch using Java?
This is my sample Json Data coming from .json file now I want to do bulk_insert to elasticsearch dynamically so that I can perform operations on it ..can someone help me with java code to add this ...
user15316614
1
vote
2
answers
2k
views
Is it possible to create custom fields in a Kibana dashboard?
I am using a Java micro-service architecture in my application and generating separate log files for each micro-service.
I am using ELK stack approach to visualize the logs in Kibana, but the problem ...
- 91
1
vote
0
answers
111
views
how to index each feature elasticsearch featurecollection
I got a typical FeatureCollection json file, when I import this file via Kibana I can see that the index has docs count equivalent to a number of features in FeatureCollection, so I can do a query and ...
0
votes
1
answer
168
views
Java equivalent of elasticsearch CURL query?
My project had a new reqiurement of migrating all datas which are currently in postresql to elasticsearch. Successfully migrated all my datas, but I am stuck with writing java code to search for some ...
- 139
1
vote
2
answers
57
views
Elasticsearch SELECT * FROM IP="1.1.1.1" AND NAME="ETH1/10"
I am ne on elastichSearch. i am trying the exact match and and operation. I tried so many ways but all the time the response is mess for me. It is like fuzzy match. I need exact match as RDBMS
SELECT *...
1
vote
2
answers
2k
views
Trying to launch Logstash on Windows, but gives errors
I'm trying to launch logstash via CMD. I have the right directory, but when I enter logstash.bat command to launch it gives the following errors (see in the picture):
Please help me out.
- 11
1
vote
0
answers
3k
views
Logstash A plugin had an unrecoverable error
I have installed ELK using docker from following link https://github.com/deviantony/docker-elk/tree/release-7.x
It works very well before, but recenty I got an issue on several new servers. The issue ...
- 1,619
1
vote
1
answer
723
views
How to show the JSON spring boot logs as a seperate fields out of the messages in the table format
I have a task that i need to view the spring boot JSON logs in the table format. It should not dump into the message field of kibana. It has to view as a seperate field in the table format.
Eg: ...
- 11
2
votes
3
answers
13k
views
Kibana has strict security requirements enabled that your current browser does not meet
I want to write automatic test which tests if there are logs in the kibana UI and I have a problem with sending a http request using java to kibana. From the browser everything is working fine but ...
- 109
1
vote
1
answer
3k
views
ElasticSearch failed to parse date field
I have the following query that I'm trying to run on Elasticsearch 5.6 in Kibana Dev Tools:
{
"query": {
"bool": {
"filter": {
"bool": {
...
0
votes
1
answer
6k
views
Elastic APM Java - Transactions & Spans are recorded but not reported to Elastic APM Server or Kibana
I have a standalone JAVA application.
And have integrated it successfully with Elastic APM (+ElasticSearch +Kibana) for capturing telemetries.
Java Version: 8 - OpenJDK
Elastic Agent & Library ...
2
votes
1
answer
653
views
OAuth Token API Not Working In Elastic Search Even Security Disabled
I'm new to Elastic search, using Elastic search version 7.7.1
I want to generate OAuth token by following Elastic Search documentation
When I've Tried below call through Kibana to get the OAuth token ...
- 1,925
1
vote
2
answers
2k
views
OAuth Token API Not Working In Elastic Search
I'm new to Elastic search. Integrated my Spring boot application with Elastic search through Java High Level Rest Client and I've enabled security by providing below properties after setting up the ...
- 1,925
0
votes
1
answer
66
views
JSON returning caret (^) in the value and returning null in the response
I am working on mapping json values with kibana, one element i.e amount it is returning beginning with "^" and its not mapping the getters and setters. How could I map it?, I used @...
- 1,406
0
votes
1
answer
38
views
How to create an index in elasticsearch such that with every day upload of data it creates a new index alias with date and allow me to delete them
PUT myindex-000001
{
"aliases": {
"myindex-alias":{
"is_write_index": true
}
}
}
PUT _ilm/policy/my_policy
{
"policy": {
"phases": {
"hot": {
"...
- 185
2
votes
1
answer
91
views
I am having issues with my Date field while loading it into elasticsearch. Its not coming as proper Date
Here is my getter setter code :
public Date getUpdateTime() {
return UpdateTime;
}
public void setUpdateTime(Date UpdateTime) {
this.UpdateTime = UpdateTime;
}
Here is my mapping to the ...
- 185