Serverless Ahmedabad 2023: Monitoring serverless environment with Elastic observability

Serverless Ahmedabad 2023: Monitoring serverless environment with Elastic observability

Introduction Serverless architectures take on-demand tasks to the next level with event-driven scheduling of workloads. Elastic Observability gives you the same insights into your serverless activities as the rest of your environment. Gather logs and metrics from your serverless invocations and tie them together with traces from your serverless functions. For example Identify AWS Lambda latency issues, cold starts, and other invocation issues. Logs are collected with the rest of your telemetry data, so you can look at all your data in context, in one place....

June 3, 2024 · 1 min · Ashish Tiwari
GIDS 2024 - Smart Search with RAG: Elasticsearch Meets Language Models

GIDS 2024 - Smart Search with RAG: Elasticsearch Meets Language Models

Introduction In today’s data-driven world, just having a search engine is not enough; the key is making it smart. Enter Elasticsearch Relevance Engine (ESRE) augmented with Retrieval Augmented Generation (RAG), a powerful solution that marries Elasticsearch’s superior search capabilities with Large Language Models (LLMs) like ChatGPT for precise, contextual querying over proprietary datasets. This session is a hands-on guide that will show you how to amplify the power of Elasticsearch with advanced LLMs....

June 3, 2024 · 1 min · Ashish Tiwari

Convert json to nd-json for elasticsearch

Convert JSON to nd-json for bulk indexing into Elasticsearch. movies.json [ { "title_x": "Student of the Year 2", "imdb_id": "tt7255568", "poster_path": "https://upload.wikimedia.org/wikipedia/en/thumb/3/3c/Student_of_the_year_2_Poster.jpg/220px-Student_of_the_year_2_Poster.jpg", "wiki_link": "https://en.wikipedia.org/wiki/Student_of_the_Year_2", "title_y": "Student of the Year 2", "original_title": "Student of the Year 2", "is_adult": 0, "year_of_release": "2019", "runtime": "146", "genres": "Drama|Romance|Sport", "imdb_rating": 2.5, "imdb_votes": 12671, "story": "A student must face off against bullies and overcome hurdles both academic and romantic to win his college's coveted Student of the Year trophy....

March 29, 2024 · 7 min · Ashish Tiwari

Setup & Observe Kubernetes cluster

Introduction In this gist we will quickly spin a sample Kubernetes cluster and deploying the nginx pod. Additionally, we will implement monitoring using Elastic. Setup K8s cluster Cluster architecture 3 Node cluster Machine - Centos7, 4GB RAM kube1.local - Control plane node kube2.local - worker node kube3.local - worker node Here I am setting hostname kube1.local, kube2.local, kube3.local. Login into all of the servers and perform below command on all three nodes....

March 28, 2024 · 3 min · Ashish Tiwari

Elasticsearch Query Language (ES|QL)

Introduction ES|QL is a new query language for Elasticsearch. It is the unified language for all kinds of use cases like simple queries, aggregations, performing correlations, finding logs, etc. It provides simple easy syntax to perform complex queries. If you come from SQL background, You going to find this very handy. It is a piped separated langugage with a combination of source commands and process commands. The Elasticsearch Query Language (ES|QL) makes use of “pipes” (|) to manipulate and transform data in a step-by-step fashion....

February 1, 2024 · 3 min · Ashish Tiwari