On Ftrace, kprobes, tracepoints

Posted on Wed 09 August 2017 in Performance • Tagged with linux-kernel, tracing, bpf, ftrace

For a beginner, tracing infrastructure in Linux can be considerably confusing. It's easier to get lost while trying to figure out what exactly are tracing mechanisms, which ones should be used. Addition of new eBPF support for tracing has added more to it. This is just an attempt to compile what is my current understanding, with a slightly more bias towards what facilities eBPF provides, as this is the state of the art.


Continue reading

So Vector Operations Are Fast, Right?

Posted on Mon 07 August 2017 in Performance • Tagged with pandas, numpy

Recently, for one of the projects we are working on, I was looking at processing data from Pandas panel. I wanted to find out certain items in a Panel based on certain criteria on the minor axis. I worked with two flavors and the findings for different data-sets are quite interesting. Something that would definitely qualify as an interesting learning. We discuss, how profiling can be successfully used to explain certain Performance behavior, that often looks counter-intuitive.


Continue reading