make the container and each individual item resizable horizontally with framer motion

it's really bad right now. Admin has no linking to any other pages.

need to add more as more LLMs come along. Long-term task

Experienced this on mobile, chrome, iOS.

Will look into it

Need to add some contributor guidelines in the repo and link to it

overflow-x on mobile for about and contribute pages

If not all filters are checked, there is a possibility in which no LLM charts are shown, which can be confusing to users. Need to add an empty state to it.

looks a bit whacky

Might not want it there all the time and just show widgets

too many declarations, codebase is messy

Something like LLMArena?

TBD

Super annoying having to create new container components for everything. Would help a lot.

talk about how to do scores (no percentage)

uses seeded data, doesn't look good

Might be in other browsers as well, have yet to test.

Make it look nice in embeds

Note shows over downshift

Says 1 more approval required when only one vote.

Should say 3 more approvals required

test

Getting this error a bunch

Detected multiple Jotai instances. It may cause unexpected behavior with the default store. https://github.com/pmndrs/jotai/discussions/2044

Might migrate away from jotai and just use context providers

Currently the emails are dynamic templates in Sendgrid and terribly designed. Would be nice to bring them in here as HTML and send them through the sendgrid API.

If a contributor gets suspended for abuse, if a model gets removed from the platform for abuse, or if one gets approved/rejected, we should send the contributor an email / notification.

for better screenshots

try-catches look super ugly, repetitive.

Tons of imports for auth 'n stuff.

Some metrics have labels like "0-shot", "3-shot", etc.
Some HumanEval tests are only in one language or something.

There needs to be a way to fix this.

checkbox to make sure you've read the guidelines before submitting an LLM

Allow people to share a link that already has specific LLMs compared side-by-side

The link (darkdarcool) doesn't open in a new tab

Would be nice if you could export a widget as an image, sort of like how ray.so does it.

A dialog/sheet component would be ideal for this.

Just a couple suggestions for improving the mobile experience.

1. On the main dashboard, consider giving the main container a dynamic height to prevent unnecessary scrolling (support for dvh was just added in tailwind 3.4)
2. Update the filters for mobile. Currently, they're a bit crowded. Proposed change: hide the labels (the controls seem clear enough) and move the toggle to a popover on the right hand side.

Screenshot:

probably quite laggy, animations are overkill

Add a third type of vote called a "change request" that changes an LLM's vote count but doesn't apply an approval/rejection status.

Change requests get bumped to the top and can be voted on. If the change request gets approved, apply the changes to the LLM (e.g. adding/editing/deleting a metadata field)

Make sure to improve SEO and lighthouse score on the following paths:

• /
• /about
• /contribute

allow you to view the meta of an individual LLM? Permalink maybe?

nice to have. We don't have it yet.

Markdown would be nice in the source description display

It's terrible right now, and the input sucks and consists of a ton of components and javascript.

Need to fix, possibly with a third-party library or just make a better implementation.

If contributors make PRs, there has to be some CI pipelines to ensure everything runs right

blocking pagespeed insights alltogether smh

Some fields are just one amongst others, they should be hidden or there should be an option to hide them

With #5, I'll have to space tables out a bit to add additional notes (for benchmarks and stuff)

Boolean tables and string tables look really bad right now.

If no results are found with the term "abc", "abcd" should not trigger a search.

Apply in:

• finding a metadata property
• finding an LLM (public)
• finding an LLM (contributors/admins)

Replit has been having a ton of trouble with Prisma. Found a workaround that you could use NPM to get it to work but not a scalable solution for the future.

OpenSSL versioning and prisma client engine is real wonky on Replit's nix env.

Can help reduce the bundle size and remove some dependencies a bit.

Note pixels off, meta field border too thick