Code Monkey home page Code Monkey logo

Comments (6)

abe33 avatar abe33 commented on July 22, 2024 3

I started working on it, I plan to using stream for both the preview and the opening of the file (so that I can add a progress indicator on opening) and limiting the preview size to a value specified through a setting. So far it looks promising, I could open a 8MB file without having the preview making trouble, so I think the biggest problem was the generation of the preview table in @sylistine case, I'm still looking for a source for huge csv of several dozen MB to assert whether there's a memory issue with huge table once in the editor, but for the 8MB file even the editor was still smooth enough.

from atom-tablr.

abe33 avatar abe33 commented on July 22, 2024 1

FYI version 1.2.0 was 🚢 with the new stream-based CSV open, there's still probably some bottleneck here and there (like the save routine that is still synchronous) but I think that for the most part it's now usable with big files. Let me know if you still get crashes or big hangup when manipulating such files.

from atom-tablr.

sylistine avatar sylistine commented on July 22, 2024

After a short wait, a csv of about half size (1.25mb) generates the preview alright. Obviously changing options causes another wait of about 30seconds.

Otherwise I love this package. Looking forward to updates.

from atom-tablr.

k0pernikus avatar k0pernikus commented on July 22, 2024

I have to second that. I have a 32MB csv file that has a delimiter |, and I can't even go past the selection of my custom delimiter. Once select the field, one CPU is at 100%, and after a while it just crashes.

selection_166

Alas, I cannot provide the csv file.

from atom-tablr.

nmccready avatar nmccready commented on July 22, 2024

This might be a current limitation of Atom.io as atom is slow as heck on large files. It would be great if they could fix this issue. It should be possible as vscode (MSFT) does not seem to have large file problems.

from atom-tablr.

jameshowison avatar jameshowison commented on July 22, 2024

I'm getting hangups working with files about 5 MB. tablr preview is fine, but after the two progress bars Atom freezes. In addition it seems that tablr skips the "Ask before opening large files" prompt if I chose "Open Table Editor".

Could the preview show the size of the file (MB and rows?) Given Atom's difficulties with large files I just wouldn't open large CSVs.

from atom-tablr.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.