eBPF and Kubernetes

Scaling Kubernetes
- There are monitoring and logging systems, but its tough to monitor everything accurately in a distributed environment
- The Kubernetes cluster does not expose kernel level monitoring data
- Process/Service Specific Monitoring
  - Since Kubernetes Service is essentially a process run by the linux Kernel
  - With eBPF it is easy to monitor a specific process, so teams can monitor a process running across all of their infrastructure nodes.
  - More granular than logs
  - No special instrumentation needed
  - unlike the sidecar pattern eBPF install a very small overhead
Challenges

There is no easy way to install eBPF on all nodes of the cluster, orchestration is a challenge, they can use Cilium like tools to get more visibility into their cluster though.

References:
- https://searchitoperations.techtarget.com/answer/Why-and-how-to-use-eBPF-for-Kubernetes-scaling

Comments

Fractals and Mandelbrot Set

While mathematics is in itself quite interesting and forms the basis of any modern day research, be it computational biology, machine learning or building complex structure, it can be quite a challenge to decide where to start. That is why i decided to explore Fractals, thinking of it as a bridge between the nature and science. It brings in some really fascinating concepts which should be good enough for me as a gateway go deeper. Fractals are in simple language never ending patterns which keep on repeating without an end, because fractals are never ending they have an infinite perimeter but finite area. Since the patterns repeats indefinitely but if you draw a circle around the peremeter the area will remain finite. It is like adding 1+0.1+0.01+0.001 and never making 2 This video explains the basic concept really well Fractals are found everywhere nature in Trees, Rivers, Branching patterns, Hurricanes and Galaxies. It tries to bring order and understandin...

Las Vegas

January has been pretty exciting for me since last three years, It marks my annual ritual trip to Las Vegas, this is my third trip this year. Almost all of my trips have been because of work. Since Las Vegas has some of the biggest hotels[1] in the world it has become a natural choice for some of the biggest American companies to host their internal and external conferences. As an example, CES hosts some 200,000 people every year [2]. This year I started my 30-hour flight journey, yes you heard it right I had a 9-hour layover at the London airport. Though it was far from ideal it was not that bad. If you can arrange priority pass [3] card from your credit card company or pay for it. Then you can use the lounge, showers and much more for free. I manage to steal the below picture from a hoarding at the airport. Then after much rest and time pass at the airport terminal, I boarded my next flight to Las Vegas. When I landed McCarran International Airport, the first surprise for me was the...

It was a great experience to talk to a huge audience in Mumbai and Delhi about how to start your ML journey at Google Cloud Summit ’18 India

Suchit Puri

Search This Blog