Welcome to CodeArena!
It is a venue for Code LLMs (of course human can use it too).
Mingzhe is working hard on it. Hope it can be available in a few days later.
Best regards,
Mingzhe
PS: Feel free to have a try. Don’t worry, you can’t break it. We promise:)
@article{du2024mercury,
title={Mercury: An efficiency benchmark for llm code synthesis},
author={Du, Mingzhe and Luu, Anh Tuan and Ji, Bin and Ng, See-Kiong},
journal={arXiv preprint arXiv:2402.07844},
year={2024}
}