mrdjohnson / llm-x Goto Github PK

Sometimes during generation of a response I get the error below. Have not been able to reproduce it reliably but seems to be more often when generating code.

Unexpected non-whitespace character after JSON at position 132 (line 2 column 1)

SyntaxError: Unexpected non-whitespace character after JSON at position 132 (line 2 column 1)
at JSON.parse (<anonymous>)
at OllmaApi.streamChat (https://localhost:5173/llm-x/src/utils/OllamaApi.ts:46:25)
at async Object.generateMessage (https://localhost:5173/llm-x/src/models/ChatModel.ts:113:24)

Problem:

When there are too many images in the local storage, the app has the potential to slow down dramatically, and also run out of space very quickly.

Solutions should be take into consideration that this is a browser only application. There is not any node access available to reach the local file system.

Goals:

• App continues to allow users to add an image for text-to-image, and to receive images for image-to-text.
• App should increase the amount of storage space it is able to use
• App should decrease the potential for a performance: currently while a bot is "speaking" it re-saves all chats, including images

Non-goals:

• move everything from local storage, this specifically about images
• move the app to nextjs or electron (probably will need to happen if this app will get bigger, but for now lets see how far we can keep the PWA approach)

I dont like seeing an empty issue list so I am adding this one.

If you're like me and you were curious about what issues there were in this project, welcome! Please use the app and find something 😆

as of Mar 22, 2024 this project is very active and I'm looking for direction on where to take it!

We cannot take on open-webui due to PWA limitations but we should have feature parity with majority of the Ollama UIs where we can be! If there is a feature request they're very welcomed!

Repo goals: Over take ollama simple ui In popularity 🤞

Issue: This site is set up as a PWA through the vite-pwa plugin Prompt for update. Unfortunately that means that even if not used as a PWA the user still needs to click the update button that 😬

Request: update the PWA if the user is not currently interacting with Ollama (or any future chat agent) on any (inclusive) of the open tabs/apps.

On Windows, running npm run dev fails with

> [email protected] dev
> npm run remove-dev-dist && DEBUG=vite-plugin-pwa SW_DEV=true vite --force


> [email protected] remove-dev-dist
> rm -rf dev-dist

'rm' is not recognized as an internal or external command,
operable program or batch file.

Transferring conversations should:

• have an option to include/exclude images
• have a popup describing what is being transferred
• allow users to transfer via pasting a file or dragging/dropping a file

Importing images should:

• allow users to import via pasting a file

I'm seeing two vertical scroll bars on Chrome, Ubuntu 23.10. See screenshot.