Comments (5)
till-m
commented on June 10, 2024
Hi @SysuJayce, I appreciate the bug report and sadly this is not the first time this specific issue has presented itself, if I remember correctly. Unfortunately it is very hard to solve without code that consistently reproduces the problem, so I am not sure what I can do here.
from pandarallel.
till-m
commented on June 10, 2024
Presumably this should take less than 20minutes, yes? Could you try running the task with progress bars disabled?
from pandarallel.
SysuJayce
commented on June 10, 2024
hi @till-m , I found that disable progress_bar is a workaround. Thanks
from pandarallel.
till-m
commented on June 10, 2024
Hi @SysuJayce, could you check the following?
- do the progress bars freeze consistently, i.e. if you rerun as originally, do they freeze again and at the same position?
- if you're running in jupyter, can you try running in a terminal and check if they freeze there also (and vice-versa if you're running in terminal currently)?
from pandarallel.
till-m
commented on June 10, 2024
Closing for now, feel free to update with more information.
from pandarallel.
Related Issues (20)
- cant run on python3.6 HOT 2
- Python 3.13 GIL-free HOT 1
- Why the JupyterNoteBook cell is still running after the progress bars have been finished? HOT 3
- Notice on maintenance HOT 2
- Is there a way to make the progress bar more compact? HOT 1
- [General Question] How to properly access an out-of-scope/shared DF HOT 1
- Error displaying widget: model not found HOT 1
- Does pandarallel not support parallel_apply with multiple columns groupby? HOT 5
- parallel_apply not working with Pandas >= 2.1 HOT 3
- AttributeError: 'DataFrameGroupBy' object has no attribute 'parallel_apply' HOT 2
- Pandarallel very slow after loading huge dataframe HOT 2
- consider taking in global environment variable for nb_workers and possibly other parameters too HOT 3
- DataFrame.applymap has been deprecated. HOT 2
- use pool as spawn HOT 2
- Python 3.12.1 with pandarallel==1.6.5 usage of parallel_apply time increase X3 HOT 1
- Pandarallel could stuck without raising any errors when using all the physical cores HOT 2
- Parallel_apply gets stuck HOT 4
- Memory usage increases across multiple `parallel_apply` HOT 2
- Dataframe with 64000 rows is being processed twice HOT 3
- Is there an implementation that do not require picke dump to any file system?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pandarallel.