Adjusted mean rank about rexmex HOT 3 OPEN

We will add it to the library! Thank you @cthoyt :)

from rexmex.

Reference implementation in PyKEEN here: https://github.com/pykeen/pykeen/blob/139c3d1db77c9e443d03db5383a163297345adfd/src/pykeen/evaluation/rank_based_evaluator.py#L468-L478

from rexmex.

I am one of the authors and happy to contribute an implementation. To this end, I have a question regarding the existing metrics, e.g.,

If I understand the API correctly, you assume that there is a single recommendation, a sequence of items, and some of them are relevant (relevant_items). The mean in mean rank is then computed over the relevant items.

This seems to be a bit different than the evaluation protocol frequently used in (Knowledge Graph) Link Prediction, where we have multiple recommendations (e.g. for each head-relation pair), each with relevant items (the tail entities), and compute the mean over all of these.

from rexmex.