Comments (6)
Hi @seperman, thanks for the suggestion! You're correct that the package works without pandas too. Do you have a particular use case in mind where the additional dependency on pandas is problematic? One the one hand I can imagine having a smaller set of dependencies may be useful for some, but for others having the pandas wrappers by default may be very helpful. I'd like to understand both sides well before I make such a change. Let me know! :)
from clevercsv.
Hi @GjjvdBurg
Sorry I didn't get back to you earlier. Yes I do run into type of work that requires data ingestion and the source of data is often a csv. In such cases there is no need for pandas but the CSV sniffing is always required. This is particularly true for ELT pipelines where the transformations happen after the CSV is extracted and loaded.
from clevercsv.
Hi @seperman,
I've created a PR with a potential separation of the package into a core and full version. I'd like to hear your thoughts on this change and whether it addresses your concerns.
Of course, if anyone else seeing this has an opinion on the proposed split, please do let me know.
from clevercsv.
Hi @GjjvdBurg
Thanks for the PR. It looks good. I left some minor comments.
from clevercsv.
Fixed in version 0.6.0. Thanks for the suggestion @seperman!
from clevercsv.
Thanks @GjjvdBurg !
from clevercsv.
Related Issues (20)
- Allow avoidance of Pandas dependency HOT 1
- header detect error
- Header Detection Error HOT 1
- Code generation UnicodeDecodeError HOT 4
- Built-in support for cChardet HOT 2
- Please consider signing new tags HOT 1
- Date delimiter prevales on column delimiter HOT 7
- allowed delimiters? HOT 1
- can this detect the datatype (ie timestamp, int, double, string) of each column in csv? HOT 1
- delimiter detection error HOT 4
- precedence for delimiter characters? HOT 1
- Invalid abstract representation of the file with repeating newline HOT 1
- Testsuite failure with Python 3.11 HOT 9
- Please migrate away from setup.py HOT 6
- 0.7.4: pep517 build fails HOT 5
- cchardet is no longer maintained HOT 1
- 0.7.5: pytest is failing in `tests/test_unit/test_encoding.py::EncodingTestCase::test_encoding_cchardet` unit HOT 4
- A Possible Typo in the Readthedocs docs of Clevercsv package. HOT 2
- allow more rows to be checked
- Detection breaks on good file
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clevercsv.