This is a simple webapp (React.js + Slate.js) text editor that uses ๐ค's transformers library with FastAPI websockets to run text completion for user-written text.
I made some hacks to the transformers library to allow for repeated token streaming, rather than returning full completion chunks at once.