All Questions
Tagged with grafana elasticsearch
213 questions
0
votes
1
answer
27
views
Grafana and Azure Elasticsearch service data source: open port 9200
I am setting up Elasticsearch data source in Grafana. I am following the instructions
The Elasticsearch is running in Azure as Service (Elastic Observability (Elasticsearch) - An Azure Native ISV ...
- 9
0
votes
0
answers
33
views
Discrepancy between bar chart and pie chart values in Grafana using Elasticsearch data
I'm new to working with data and am currently building a Grafana dashboard using data from Elasticsearch. I have a field called "Letters" that contains values like a, aa, ab, ac, b, ba, bb, ...
- 1
0
votes
0
answers
29
views
Setting timeFrom equal to a specific time of the current day in Grafana
I would like my panel to be able to grab data from 6am to now each day. Using Grafana with Elasticsearch... still very new to it too.
I currently have "timeFrom": "now/d", which ...
- 1
0
votes
0
answers
47
views
Is it possible to delete data in elastic from grafana with a specific index?
I have a data source with several indexes, but one of my indexes has an elastic column (called "NbCnx") and normally I only have integers, but I don't know why I have also had strings for 2-...
0
votes
1
answer
31
views
How to link data in Grafana from Elasticsearch to Postgresql
I'm collecting log files and indexing them in Elasticsearch with Apache NIFI
{
"took" : 340,
"timed_out" : false,
"_shards" : {
"total" : 1,
"...
0
votes
1
answer
287
views
Grafana elasticsearch lucene query to limit columns
In grafana I'm using elasticsearch data source with the query type of Logs. All the colums are displayed but I just want to see 2 of 3 of them , source_timestamp , access_Type and active_event_count. ...
- 1,677
0
votes
1
answer
99
views
grafana connecting datasource elasticsearch with index pattern
When trying to connect to elasticsearch 8.x from grafana 10.4.2 it works with indexes that do not have patterns.. For example
index_1 = success
But
index_1.2024.05.11 fails , even when I select "...
- 1,677
0
votes
0
answers
44
views
Grafana/Elastic - Filter certain fields alone from the document and draw graph
Problem Statement:
Out of multiple fields from the elastic document, draw graph considering certain fields alone from the elastic document
There are documents in the elastic database in the below ...
- 139
1
vote
0
answers
146
views
How to extract specific text/string from a field in ELK logs?
In my ELK, a single document has multiple fields (k8s.pod,k8s.ns,timestamp,logtag,steream and message). In the message field, I am getting the logs like below
[36m15:25:47.583[0;39m [1;30m[default-...
- 23
0
votes
0
answers
74
views
How to use "Relative time" and "Time shift" in Grafana "Query options" so it will query future data [duplicate]
I am using Grafana 10.
I have a simple panel using Elasticsearch as a data source.
I'd like to specify a custom time range for this particular panel, independent from the Dashboard time picker, so I'm ...
0
votes
1
answer
30
views
How to account one record in kibana in several aggregation items
We're running reports over our application(s) log files, which are collected in an elastic search storage. The logs have among others following fields
@timestamp:
Oct 24, 2023 @ 20:15:52.043
...
- 48.2k
0
votes
0
answers
80
views
How to flatten aggregations returned by elastic search query
We're running reports over our application(s) log files, which are collected in an elastic search storage. Due to limitations in the stack, and the need to do some ETL-like transform (convert system ...
- 48.2k
0
votes
0
answers
208
views
How to use variable in a panel with time series format in Grafana (elasticsearch data source)
I used ElasticSearch as a data source in Grafana 9 and set the metric to “Raw Data” mode, then selected some fields using “Organize Fields Transform” and hid the rest. I also placed the visualization ...
- 13
0
votes
1
answer
613
views
How to put the Grafana time range into an ElasticSearch log link?
I'm adding a Data Link or Panel Link to my Grafana panel or data. I want the link to go to ElasticSearch logs... but I want to include the current time range of my Grafana dashboard.
Here's a portion ...
- 3,584
0
votes
2
answers
210
views
Sum of groupby timestamp with grafana/elasticsearch : value always 0
I have data that looks like:
datetime resolution_code area_code area_type_code area_name map_code total_load_value update_time
"2014-12-31 23:15:00" "PT15M" "...
- 495
0
votes
1
answer
334
views
Group Grafana chart by presence of a datetime field with Elasticsearch datasource
I have an Elasticsearch datasource with a field called aborted_at. It’s an ISO-8601 timestamp, and it is only present for some records.
I want to create a bar chart, stacked to 100%, that shows the ...
- 38.4k
0
votes
0
answers
639
views
Using dashboard variable in JSON query with Elastic Search on Grafana
I work with an ElasticSearch data source on Grafana 7.15. The data source has a field 'id' of which the type is 'keyword'.
I'm trying to use a dynamic variable called 'site' in the JSON query meant to ...
- 1
0
votes
0
answers
665
views
Grafana - Combine Results after some Regex operations
We have a table in Grafana with an elastic search data source. I try to combine all the results by the part of the string which I call "Name".
Here are the results of our query:
Results
...
- 11
1
vote
0
answers
219
views
Grafana / Elasticsearch datasource / Count values with no group by clause
With elasticsearch datasource, I would like to populate a stats widget with the count of records corresponding to a query.
It seems it's mandatory to provide a group by field with the count option and ...
- 21
0
votes
2
answers
955
views
How to configure OpenSearch/ElasticSearch SQL plug-in as a datasource in Grafana?
OpenSearch (or ElasticSearch) has a SQL plug-in that is accessible via /_plugins/_sql URL.
I can run a SQL Query on the ES Dashboard using a query like this:
POST /_plugins/_sql
{
"query": ...
- 1,635
-1
votes
1
answer
457
views
how to correctly use kql operators ( =, >, >= ) in Grafana
Right now I'm trying to transfer some old dashboards from kibana to Grafana 8.5+
Dashboards in kibana use filters for some mappings. For example we have some event: "JOB_STARTED" and this ...
- 71
1
vote
0
answers
413
views
Grafana Variables Query using ElasticSearch - Filter doesn't work
I am currently using Grafana v9.1.7 and ElasticSearch 8.4.2
What I'm trying to achieve is to create a dashboard that can filter the data by country. I have a keyword field named honeypot_country (it's ...
- 71
0
votes
1
answer
2k
views
Grafana Alert Value String Templating
I'm creating a Grafana alert with the Elastic datasource. The condition operator is grouping all meaningful labels from my alert.
[ var='A0' metric='' labels={header_host=hostname1.com value=1496 ], [ ...
- 1,855
0
votes
0
answers
688
views
Why Grafana Variables query from data source ElasticSearch returned None?
In elastic exist index
gitlab-ci-store
create POST
PUT gitlab-ci-store
{
"mappings": {
"properties": {
"gitlab-ci-store": {
"properties": {
...
- 1,676
0
votes
1
answer
1k
views
Grafana query filter by key and value
In my Grafana ElasticSearch Datasource, I have an attribute like this:
=== object_attributes.variables ====
[
{ "key": "fruit", "value": "apple" },
{ &...
- 1,058
1
vote
1
answer
753
views
Get data from only the latest Elastic index in Grafana
I have a series of indexes in Elastic, myindex-YYYY.MM.DD. In a Grafana panel, I want to read data only from the latest such index each time. I have created a datasource [myindex-]YYYY.MM.DD with ...
- 6,869
0
votes
1
answer
886
views
Metricbeat not show volume mount under dev filesystem
Let me explain the problem and context. This is a server for a database solution. The database was created with docker, and added a volume to the server. Then all docker installation path was moved to ...
- 532
2
votes
0
answers
212
views
How to stringify object which returned from elastic search DB to display in grafana table?
I'm using grafana dashboard to display elastic search (jeager logs data) json data as table format.
But some columns showing [object object] rows. I could resolve this by change cell display mode to ...
- 23
3
votes
1
answer
3k
views
How to avoid escaping custom Grafana variable?
My Grafana dashboard shows statistics for some Elastic documents. Some of these documents have the attribute important_details, some don't. I want to create a "Has important details: Yes/No/All&...
- 6,869
0
votes
1
answer
2k
views
Grafana variable: Return all Elastic documents when selecting "All" and the attribute might be an empty list
Take the following Lucene query:
provision_org.keyword:$provision_org
If $provision_org has the value "hello", the query returns all documents where provision_org (a list) contains the item ...
- 6,869
0
votes
1
answer
127
views
How to label the names on x-axis and also change names accordingly in ad-hoc filters in grafana elasticsearch?
Here if i want to change the name of others to something else. how must I do in grafana. my datasource is elasticsearc
0
votes
0
answers
47
views
Remove stopwords from Grafana user searches panel (elastic)
I have the following user searches panel in Grafana, and I want to remove stopwords like "and". While I've been able to do it using a Ruby filter in Logstash, I think I'd prefer to store the ...
- 6,869
0
votes
1
answer
616
views
Set Interval in Time series to 1 second
I am trying to display logs from elastic search in grafana using the lucene query. It works overall but I will like to set the interval in the time series as 1 second but from the grafana ui it seems ...
- 707
1
vote
0
answers
142
views
Grafana custom editor for every query/series
I was wondering if it is possible to write a custom editor (StandardEditorProps) that displays multiple input fields dynamically for every query (every series in the dataFrame).
I would need the same ...
- 211
2
votes
0
answers
208
views
Grafana Elastic Histogram
I am making a graph in Grafana using Elasticsearch as datasource. I am using time series graph.
Vertical Axis: count of documents
Horizontal Axis: Latency in milliseconds
Sample Graph: Graph
As ...
- 21
3
votes
0
answers
2k
views
Grafana alerts - Error:failed to query data: context deadline exceeded
I am fairly new to grafana. I am currently running a dockerized version of Grafana v8.3.1.
I have set up three alerts, all pointing to the same Elasticsearch data source. When I navigate to the “Alert ...
2
votes
0
answers
921
views
How to create a Grafana dashboard from ElasticSearch logs
I have connected grafana to an elasticsearch data source. The goal is to create metric dashboards out of elastic search logs. I have two lucene queries in grafana. The first query retrieves all logs ...
- 707
0
votes
1
answer
972
views
Properly plotting on Grafana from Elasticsearch data
I wan to plot a time series on Grafana from some documents stored in ElasticSearch. The documents are structured as follows:
{
"timestamp": date,
"name1": str,
"...
- 524
2
votes
0
answers
215
views
Grafana with Elastic - Show requests count toguether with average response time
I'm new at Grafana and I'm trying to create a graph that shows the requests count together with the average response time for the requests, I was able to create my requests count but now I'm ...
1
vote
1
answer
2k
views
Grafana Elasticsearch - Query condition that references field value
Given the following Elasticsearch document structure
{
"mappings": {
"doc": {
"properties": {
"projectKey": {
"type": &...
- 1,426
0
votes
1
answer
27
views
Is there a way to transform a full path name to just a class name for labels in a bar chart
I am using ElasticSearch and Grafana to create a aggregated logging solution. The exceptions are being pushed to ElasticSearch no problem. But the library that I am using pushes the full name, for ...
- 13.4k
6
votes
2
answers
8k
views
Is it possible to aggregate Loki logs by day on Grafana?
I have a set of logs like this:
{"action": "action_a", "username": "user_1", "ts": "2021-09-10T02:18:14.103Z"}
{"action": "...
- 2,940
0
votes
1
answer
1k
views
Grafana - How can we join data from TimescaleDB and ElasticSearch?
Populate data from TimescaleDB and ElasticSearch based on a field which is present in both data sources.
- 11
3
votes
1
answer
893
views
Grafana Value Mapping an Array
So I'm using grafana to display some data in a table. So in my grafana table I have a column named 'request_types'. Its value is represented by an array such as
["all"], ["Music", &...
- 343
1
vote
0
answers
203
views
Is there a way to parse messages in Grafana with elasticsearch as the source?
I am using Grafana v7.2.0 with Elasticsearch as a data source.
My logs look like
{
"message": "Counter: 10",
"id": "Rd57OnsBW_gLMXbXxjMh",
"level&...
- 169
0
votes
0
answers
1k
views
How to create TPS dashboard in grafana with elasticsearch as the source
In graphana, i am not sure how to add queries for obtaining the TPS graph, and this is first time am using grafanaThis the Tps graph in jmeter
In the image i get few fields, using that i need to ...
- 1
0
votes
0
answers
253
views
Update Grafana panel plugin on data received using React&TypeScript
I'm trying to make a custom panel plugin for Grafana 7.5.2 using TypeScript and React.
At the moment I'm traying to understand the mechanics of updating the front-end (React) when new data is ...
- 211
1
vote
0
answers
667
views
How to groupby unique values from elasticsearch with grafana
Info:
Grafana 7.5.7
Elastic 7.11
Linux OS
I would like to know how can I get unique values from elasticsearch with Grafana’s query editor.
My Query's Data is the following:
Query: $snort
Metric: ...
- 55
0
votes
1
answer
3k
views
Regex Query -- Grafana
Hi everyone I have Grafana v 7.5.7 and I'm trying to extract some content from my data.
In this case, my goal is to take the message from snort alert.
I created an event. original as my own variable ...
- 55