r/elasticsearch • u/seti321 • Mar 07 '19
r/elasticsearch • u/lboraz • Mar 27 '25
Alternatives to Kibana
So, to be short, Kibana is broken in many ways, I'd like to keep elasticsearch as a backend and replace Kibana with something else. Is Grafana the only real alternative?
Update: For the problems mentioned below, we involved elastic support several times and even had on-site consultants (from elastic) to look at the issues, providing no solution. After watching kibana getting worse over the years we are ready to replace it, if there was a replacement.
Update2: To elastic employees, please don't contact me in private. I'm not looking for a solution. We pay support already with the enterprise license and in the last 4 years no solutions came from you. Stop pretending
r/elasticsearch • u/Feeling_Current534 • Aug 18 '26
Show & Tell Elastic101 – Best Practice #002: shard size
I've spent close to a decade running Elasticsearch clusters in production, from 3-node dev setups to multi-hundred-node deployments handling billions of documents a day.
One thing I've seen repeatedly in production is that teams either let shards balloon for years without noticing, or over-correct and split everything into tiny shards "to be safe."
Elastic101 – Best Practice #002 – Shard Size
Smaller shards increase overhead more cluster state to track, more per-shard costs (file handles, memory, translog), and more coordination work on every query.
Larger shards cause the opposite problem: recovery and rebalancing get painfully slow, and a single hot shard can bottleneck an entire index.
The goal is to keep shard size around 50GB.
Pro tip: you cannot simply change the primary shard count of an existing index. If you need to change it, you typically need to use the Reindex API or the Shrink API, depending on the situation. Also, if you reindex a 200GB index, you should have at least 200GB of additional free disk space available in the cluster for the new index. Choose your primary shard count wisely from the start, fixing it later is expensive.
Previous Elastic101 best practices:
Try here: Searchali Elasticsearch Monitoring Connect your cluster in 10 seconds. No agent. No data leaves your machine.
r/elasticsearch • u/ssb61 • Jul 12 '20
Serverless Real-time Indexing: A Low Ops Alternative to Elasticsearch
Are you familiar with Converged Indexing? It combines search and columnar indexing to give you not just fast search and aggregations but also joins. It is built on RocksDB not Lucene. And its serverless so you don't have the hassle of managing clusters, sharding and re-indexing as you scale.
If you are curious, join us for a tech-talk on "Serverless Real-time Indexing: A Low Ops Alternative to Elasticsearch"
The Talk
Both Rockset and Elasticsearch are queryable datastores that can store data and serve queries. Both of them index data and use the index to serve queries. Both systems are document-sharded. But that is where their similarities end. Rockset is a serverless real-time indexing database that does converged indexing on RocksDB. Elastic is a search index that does search indexing using Lucene. Rockset is built to exploit cloud elasticity with minimal ops, while Elastic requires special expertise and effort to manage the ELK stack.
Ben Hagan, a former solutions architect from Elasticsearch, and Shruti Bhat will go over some of the ops considerations for deploying and managing elastic clusters at scale, as we compare and contrast to Rockset’s serverless ops in the cloud
Collecting real-time events, managing change data capture and denormalization: With Elasticsearch, you manage different ingestion and input source pipelines to denormalize data. In contrast, Rockset supports click and connect integrations for continuously indexing data from MongoDB, DynamoDB, Kafka, S3 etc. It has native support for JOINs, so there is no need to denormalize your data.
Configuring clusters and managing node types: When deploying Elasticsearch, it is important to configure master nodes, data nodes, ingest nodes, coordinating nodes, alerting nodes in your cluster and optimize them based on the use case and requirements. In contrast, Rockset is a modern serverless system that is highly optimized for fast queries out-of-the-box
Scaling writes, sharding and re-indexing: Elasticsearch uses a primary-backup model for replication so each replica re-indexes the data locally again. As your data size grows, you may will typically increase the shard size and re-index your data in elasticsearch. In contrast, Rockset uses RocksDB remote compaction and micro-sharding to eliminate the need for re-indexing overhead.
Scaling reads and isolating workloads: The Elastic Cloud offers different types of nodes each with fixed compute/memory ratios such as io-optimized and storage-optimized nodes, and moving between these requires a data migration. In contrast, Rockset separates compute from storage to allow seamless scaling of reads by increasing the compute allocation in the form of fully isolated virtual compute for each workload.
Managing data durability and performance: Elasticsearch assumes a shared-nothing storage architecture where data durability is guaranteed via replication among data nodes, and you manually configure the resiliency of new writes. Rockset uses the cloud’s storage model with automatic S3-backed durable storage already configured in the cloud.
Save your spot - https://rockset.com/elastisearch-talk/
r/elasticsearch • u/Evening-Jelly523 • Jun 01 '26
Show & Tell PackRun — Run Elasticsearch on a clean Linux machine without Docker or Java
Hi everyone,
I'm Miguel and I built PackRun, a tool that packages Linux applications like Elasticsearch into a single .run file.
No Docker.
No Java.
No Elasticsearch installation.
Just download and run:
wget packrun.io/images/elasticsearch-8.13.run
sudo ./elasticsearch-8.13.run --data ./my-data
Your indices, documents and data are preserved.
The goal is simple: package an application together with everything it needs and run it on another Linux machine with a single command.
My LinkedIn:
https://www.linkedin.com/in/miguelmedinac/
Website:
https://packrun.io
GitHub:
https://github.com/LordsMikel/packrun
Youtube Video:
https://youtube.com/shorts/KtPVPj19Yno?si=CKVttzLShtWBxnJu
I'd love to hear your feedback.
r/elasticsearch • u/One_Detective4145 • May 24 '25
Unfair Exam Experience and Lack of Result Transparency
I failed the Elastic certification exam and received an email stating that, for fairness, no further details can be shared I find this quite absurd.
All internationally recognized certification exams typically provide a breakdown of topics, showing which areas carry more weight, and you receive at least a result summary, not just a pass/fail status.
Being asked to send feedback via email, without even minimal insight into how I performed, feels disrespectful to candidates especially considering the testing environment, which is far from comfortable or professional.
Thank you, and goodbye $400.
r/elasticsearch • u/UnableOrganization43 • Apr 28 '26
Elastic Cloud Serverless KNN costs are absolutely insane — $16/month for 300 documents??
Solo dev here. I'm using Elastic Cloud Serverless for vector similarity search (KNN on dense_vector fields, 768 dimensions, cosine similarity).
My dataset is laughably small:
~200-300 documents total across 2 indices
0.006 GB storage
I am the only user
This month I've burned through 16 ECU ($16). For context, I run maybe 50-100 KNN queries per batch job, a few times a week. The rest of the time the indices just sit there doing nothing.
Let that sink in. Three hundred documents. One user. Sixteen dollars.
My Postgres database holds orders of magnitude more data and costs less. My entire VPS costs less. I'm paying $16/month for what is essentially a glorified nearest-neighbor lookup on a dataset that fits in a single JavaScript array.
And the scary part — how does this scale? If one developer running a handful of KNN queries costs $16/month, what happens when I have actual users? 10k users each doing a few vector searches per session? VCU cost scales linearly with zero volume discount. We're talking potentially tens of thousands of dollars per month. For similarity search.
Meanwhile I could do the exact same KNN search with pgvector in Postgres, which I'm already paying for. Same HNSW algorithm, same cosine similarity, same results. Zero additional cost.
Am I missing something fundamental about the pricing model, or is Elastic Serverless just not viable for vector search workloads? Has anyone migrated to pgvector and never looked back?
This is a screenshot of how usage evolves so it doesnt seem to be idle it fluctuates quite a lot:

r/elasticsearch • u/xuezhongyu01 • Apr 06 '23
‘The client noticed that the server is not a supported distribution of Elasticsearch‘ error and…
r/elasticsearch • u/fosstechnix • Nov 20 '21
#12:How to Install Elasticsearch and Kibana on Amazon Linux 2|Configure ...
r/elasticsearch • u/hscbaj • Jan 06 '20
Elastic Search contractor needed
Hope it's ok to post this request?
I have a SaaS platform that uses ES as our main data store, it's works sweetly and I'd like to keep it that way. I'm looking for someone with good linux / ES knowledge who can spare half a day a month to dive in and make sure things are ok, a health check if you will. Obviously paid at whatever rate you charge. If someone is interested, please DM me.
r/elasticsearch • u/ZaBbeast • Feb 23 '22
Write about Elastic Search, earn, and promote yourself!
Hi,
Two years ago, I have launched the bestmonitoringtools.com website to write about the best monitoring tools such as Zabbix, Elastic Stack, and Prometheus. I have managed to write 30 articles on Zabbix and SNMP topics. That alone attracts about 50k users monthly. And the earnings from the ads are not bad at all, considering the number of articles on the site.
However, I have limited time (daytime job, wife, and children), and I m struggling to update the Zabbix articles, and there is just no time to write Elastic Search articles.
So it crossed my mind that it would be great if someone else is writing tutorials about Elastic Stack who loves technology and writing, but has no knowledge or time to invest in learning about blogging, SEO, marketing and does not want to deal with the hosting/domain maintenance.
This is an excellent opportunity for someone who wants to write tutorials about Elastic Stack, earn some money and promote his expertise. Note that 20% of the overall earnings would be used for server maintenance (hosting, domain) and my SEO services. Also, we can put it all on paper in the form of a contract if necessary. This is some kind of symbiotic partnership because the 50k users that come to the site for Zabbix tutorials will potentially click the Elastic Stack tutorials and vice versa. I can also pay per article if this kind of partership is not your thing.
Note, that Elastic Stack tutorials must be of a high quality (min. 1500 words) and systematically written (see Zabbix examples on the website).
If you have at least 1 year of experiance with Elastic Stack, and find this offer interesting, then contact me via my website: https://bestmonitoringtools.com/contact/
Regards
Aldin
r/elasticsearch • u/Arkamedus • Dec 20 '20
Spectre ES GUI lets you update Documents inline and it's only $2 (Multi-platform)
r/elasticsearch • u/tvb46 • Jan 15 '21
Elasticsearch and Kibana are now business risks
r/elasticsearch • u/OpsterHQ • Feb 14 '21
What should we do after the Elastic license change?
A lot of people have questions about the Elasticsearch license change and how it will affect users. Answers to some of the most popular questions here: https://opster.com/blogs/elasticsearch-license-change/
r/elasticsearch • u/sergii-demianchuk • Feb 19 '22
ElasticSearch as you have never known it before - EXCLUSIVE CONTENT
Hi, everybody I want to present an introduction to my on-line course: "Elasticsearch as you have never known it before". At that course I am sharing my production experience with using ElasticSearch for building advanced search systems and recommendation modules. I am also providing real practice examples with using Java, Python and PHP programming languages. You may view the whole course at udemy using next link with discount: link to udemy
r/elasticsearch • u/TheHeffNerr • Apr 17 '25
Elastic's sharding strategy SUCKS.
Sorry for the quick 3:30AM pre-bedtime rant. I'm starting to finish my transition from Beats > Elastic Agent fleet managed. I keep coming across more and more things that just piss me off. The Fleet Managed Elastic Agent forces you into the Elastic sharding strategy.
Per the docs:
Unfortunately, there is no one-size-fits-all sharding strategy. A strategy that works in one environment may not scale in another. A good sharding strategy must account for your infrastructure, use case, and performance expectations.
I now have over 150 different "metrics" indices. WHY?! EVERYTHING pre-build in Kibana just searches for "metrics-*". So, what is the actual fucking point of breaking metrics out into so many different shards. Each shard adds overhead, each shard generates 1 thread when searching. My hot nodes went from ~60 shards to now ~180 shards.
I tried, and tried, and tried to work around the system and to use your own sharding strategy if you want to use the elastic ingest pipelines (even via routing logs to Logstash). Beats:Elastic Agent is not 1:1. With WinLogBeat a lot of the processing was done on the host via the WinLogBeat pipelines. Now with the Elastic Agent, some of the processing is done on the host, with some of it moved to the Elastic Pipelines. So, unless you want to write all your own Logstash pipelines (again). You're SOL.
Anyway, this it is dumb. That is all.
r/elasticsearch • u/OMGZwhitepeople • Sep 17 '25
Open Search feature questions
Is there something similar to ECK (Elastic Cloud for Kubernetes) That Opensearch offers? I see they have a Opensearch Kubernetes Operator but I am not sure its as good as ECK? For instance with CNI integrations do they have (Azure, AWS, GCP etc.) Also does Opensearch offer Frozen ILM storage policy? or just hot, warm, cold? Is the alerting good? Lastly anyone actually use the cluster replication, does it work well?
r/elasticsearch • u/robert_winter • Feb 17 '21
Observability: What it is and why you need it | Logging, Metrics & Alerts
r/elasticsearch • u/awesomehingu • May 07 '18
What is ElasticSearch in Detail
r/elasticsearch • u/psfletcher • Oct 09 '20
Logstash as a elasticsearch proxy
Hi all, Any ideas if Logstash can act as a elasticsearch proxy? I have a pfsense telegraph plugin for elasticsearch but in one of my environments it can't have direct access to where the elasticsearch server is, everything else in that environment is going via Logstash. I've looked and it looks like I can read a elasticsearch dB into Logstash. But I haven't found this functionality. Any ideas?
Thanks
r/elasticsearch • u/Tech-Security • Sep 18 '23
Elastic v8.10 has been withdrawn.
I was wondering what the reason for this may be?
r/elasticsearch • u/Terrible-Item-6293 • Jan 29 '24
Elastic bought Opster and immediately ruined it
Lol, as expected. Went to checkout opster this morning and noticed they've disabled opster gpt and their other free community tools as they are "currently being integrated into elastic. Stay tuned for an enhanced solution" - Translation: we will be introducing a paid tier for these previously free and helpful tools.
I knew this was going to happen as soon as a I saw they were acquired by Elastic. Sigh.
r/elasticsearch • u/[deleted] • Feb 19 '21
Help: Anyone familiar with OpenDistro Alerting?
I need to create a Monitor that alerts when a user's account becomes locked out. It will be looking at Windows logs. Here is what I am looking at in more detail: