Elasticsearch Query Language (ES|QL)

Introduction ES|QL is a new query language for Elasticsearch. It is the unified language for all kinds of use cases like simple queries, aggregations, performing correlations, finding logs, etc. It provides simple easy syntax to perform complex queries. If you come from SQL background, You going to find this very handy. It is a piped separated langugage with a combination of source commands and process commands. The Elasticsearch Query Language (ES|QL) makes use of “pipes” (|) to manipulate and transform data in a step-by-step fashion. This means output of the first step will go as an input for second step. ...

February 1, 2024 · 3 min · Ashish Tiwari
Vector and hybrid search with Elasticsearch

Elasticsearch: Vector and Hybrid Search

Introduction Search is not just traditional TF/IDF any more but the current trend of machine learning and models has opened another dimension for search. This talk gives an overview of: Classic search and its limitations. What is a model and how can you use it. How to use vector search or hybrid search in Elasticsearch. Where OpenAI’s ChatGPT or similar LLMs come into play to with Elastic. Check how to leverage Leverage ChatGPT with Elasticsearch. ...

August 29, 2023 · 1 min · Ashish Tiwari
Monitor kubernetes cluster with Elastic Observability

Monitor Kubernetes cluster with Elastic

Introduction Bring logs, metrics, and traces from your Kubernetes cluster and the workloads running on it into a single, unified solution. Elastic observability gives better visibility on your kubernetes ecosystem where you can monitor your pods, services, workload etc. Use a centrally managed Elastic Agent to gain visibility into your Kubernetes deployments on EKS, AKS, GKE or self-managed clusters. Talk Video

July 28, 2023 · 1 min · Ashish Tiwari
arch linux main screen

Workshop - Leverage ChatGPT with Elasticsearch

July 21, 2023 · 6 min · Ashish Tiwari
Receive webhook requests using ELK

Receive Webhook Requests Using ELK

In this blog, we will see how you can quickly setup ELK (Elasticsearch, Logstash, Kibana) stack to receive the HTTP webhook. Mostly ELK stack is known for logging purposes. But Elastic stacks are much more beyond the logging use case. Elastic provides Search, Observability & Security you can check more on this with official documentation. What is Webhook ? Webhook enables the two programs to communicate or transfer the data with the help of callback functions / hooks. Now in the modern tech world it is also known as Reverse API, Push API etc. Mostly it is used to send small amounts of data from source to destination. It is a one way data transfer procedure. It works over the HTTP protocol using REST API. It is simple like client and server communication. Most of the saas allow you to integrate their product with your system with the help of APIs and Webhook only. E.g. Slack and discord allows you to push messages with the help of webhooks. To accept the webhook event, You need to expose one HTTP endpoint lets say ...

January 23, 2023 · 5 min · Ashish Tiwari