Tagme and Entity recognition about convex HOT 1 CLOSED

Hello,

I do not have a concrete number for the proportion of NERD errors,
but we measured an answer presence (in the 1-hop of disambiguated entities)
of roughly 70-80% in the first turn.

The remaining 20-30 % can be errors due to NERD (as you pointed out),
incomplete KG (structure or content) or also noise in the dataset.

There can also be rare cases in which the initial question is incomplete,
however we tried to identify such semi-automatically using NER and tagging
questions without entity mentions. But for conv_id 8974, this is indeed a
dataset error (I think TagMe labels 'first team' as entity, which is why it was
not detected).

Regards,
Philipp

from convex.