Comments (13)
Thanks for the suggestion @nausher!
I've been meaning to find a workaround for the issue you're describing (i.e. parsing content from Google docs, etc). Even the Highlighted Content feature does not work as expected. Let me see what I can come up with.
from lumos.
Some info, though perhaps stale:
https://stackoverflow.com/questions/75019646/how-to-get-selected-text-in-google-docs-with-javascript
from lumos.
Ability to load clipboard content as an attachment will released in v1.0.15
.
from lumos.
A couple of things I noted - (1) Clicking the 'paper clip icon' immediately opens the file dialog box, perhaps a different icon for clipboard history can be used?
I'll keep iterating on the UI/UX for this feature. Thanks for the feedback! One of the challenges with this feature is that browsers cannot access clipboard content without explicit action from the user. I haven't found a way to optionally render a UI component based on if clipboard content is available. Ideally, I'd like to do that so the UI isn't cluttered with more buttons. I may need to remove some of the existing buttons.
(2) When I copy the content from the Lumos chat pop-up, the text seems to be rich and I get the background yellow copied over too. If this could be a setting or a configuration, there could be an option to copy only the plain text without any formatting from the Lumos window.
Created an issue for this: #181. In the meantime, the cmd + c
shortcut copies the last AI message and it doesn't include the yellow background.
from lumos.
I've noticed similar issues with Google Docs, though never dove in to see exactly what it is. Is it using a lot of nested iframes?
No, actually, I have a vague memory that the window.getSelection() api was not working. Perhaps they implement their own editor control and selection geometry system?
from lumos.
I looked at it briefly a while back and I think they implemented some kind of custom editor. Other tools like Grammarly are able to access the content (seemingly without access to Google APIs), so there must be some way to access it. I'll need to investigate.
from lumos.
Would a simpler fix (hack) be to provide a checkbox option to use what's in the clipboard similar to "Disable content parsing".
The user could then just copy the content of the Google doc to their clipboard, the content can be then chunked or truncated depending on the context length and passed to Ollama.
from lumos.
https://workspaceupdates.googleblog.com/2021/05/Google-Docs-Canvas-Based-Rendering-Update.html
from lumos.
Would a simpler fix (hack) be to provide a checkbox option to use what's in the clipboard similar to "Disable content parsing". The user could then just copy the content of the Google doc to their clipboard, the content can be then chunked or truncated depending on the context length and passed to Ollama.
I'll consider this. However, I prefer to avoid having too many input components cluttering the UI, which is already pretty cluttered IMO.
from lumos.
I think a reasonable product experience is to treat clipboard content like an attachment. If the attachment/clipboard content is present, then those contents will take precedence over the web page's content for parsing. A user must explicitly remove the attachment/clipboard content to resume parsing the web page's content.
This feels simple to understand given the attachment functionality already exists. The Disable content parsing
flag will remain as is. If it's checked, Lumos will skip parsing the clipboard content.
from lumos.
Hi, I updated to the 1.0.15 version but I'm not seeing a attach file option. Please see screenshot attached.
from lumos.
Hi, I updated to the 1.0.15 version but I'm not seeing a attach file option. Please see screenshot attached.
The sideways paperclip icon is the button to attach a file. When you attach a file, another icon will appear that lets you remove the attachment.
However, you don't need to click the button to load clipboard content. Just copy text to your clipboard from any app (i.e. cmd + c
), open Lumos, and press the cmd + b
shortcut key. Now the clipboard content is loaded. You should see the same icon that lets you remove the attachment, but instead it will be for removing the clipboard content.
from lumos.
Thanks, I finally was able to get it working after a few attempts.
A couple of things I noted - (1) Clicking the 'paper clip icon' immediately opens the file dialog box, perhaps a different icon for clipboard history can be used?
(2) When I copy the content from the Lumos chat pop-up, the text seems to be rich and I get the background yellow copied over too. If this could be a setting or a configuration, there could be an option to copy only the plain text without any formatting from the Lumos window.
Thanks for quickly fixing this issue. I'm now able to use Lumos in Google Apps.
from lumos.
Related Issues (20)
- Support uploading image file (multimodal)
- Add shortcut to unattach file
- Add functionality to delete individual message (or regenerate LLM response)
- Add LangChain `YoutubeLoader` HOT 4
- Add audio document loader HOT 1
- WebLLM HOT 2
- Window resolution abnormal HOT 12
- Add support for embedding model `mxbai-embed-large`
- Summarize chat for chat title/preview (chat history view)
- Support `snowflake-arctic-embed` embedding model
- Add support for `moondream`, `llava-llama3`, and `llava-phi3` models
- Experiment with Ollama API concurrency HOT 1
- Any plans for Firefox? HOT 1
- Review/edit Mutable AI wiki
- Preload Ollama models
- Investigate LangGraph/agent implementation
- OPENAI embeddings API Integration HOT 4
- Yellow background is copied with text when highlighting text > right click > copy > paste
- TypeScript error when building `langgraph` branch with Webpack HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lumos.