Evaluate Profile-Guided Optimization (PGO) about cachegrand HOT 2 OPEN

Thanks a lot for your comment!

It is fair to say though that having a generalized memtier run on a bunch of different commands might lead to some generalized performance improvements so I will definitely give it a try.

Even if it doesn't bring a "generalized" improvement, it can bring a higher improvement on one specific workload. It's still a good result for some users. E.g. in this case they could estimate that for some specific workload, Cachegrand could be optimized further with PGO. Even if in this case you cannot provide an optimized binary to your users - they would be able to do PGO optimization on their own workload, based on PGO notes from Cachegrand documentation.

from cachegrand.

Hi @zamazan4ik,

Yes, PGO is a very interesting topic, in cachegrand we do a fair amount of manual optimizations unrolling loops and using ad-hoc attributes to optimize the branching of the hot path but of course it can really help a lot to do it.

The issue though is that cachegrand codebase tries to minimize the branching in the hotpath, favouring small hashtables, and most of the time is spent during I/O on the kernel side.

It is fair to say though that having a generalized memtier run on a bunch of different commands might lead to some generalized performance improvements so I will definitely give it a try.

Thanks for bringing it up!

from cachegrand.