Comments (2)
Instead of having all libraries implement their own API, another option is some shared library they all use, which would reduce maintenance burden for OpenBLAS etc. maintainers, and make life easier for profilers since it require integration only once.
This involves a can of worms (Python extensions are dlopen()
ed, how do you distribute 3rd party shared library in multiple OSes, how does it get loaded at all)... Best idea I have at the moment is #ifdef code combined with calls to shared library that gets preloaded via Python extension module, so this only is enabled for Python code. But that's very handwavy and dlopen()
is not one's friend.
I guess another options is CPython grows support for this info but that seems esoteric...
from filprofiler.
I wonder if you could do something involving a .h
file that has a function that uses dlsym()
to get at Python's thread local API. And profilers could just look up task IDs at a well-known thread local key. That's still not a complete solution, though, since there's still the problem of how you have a single global key shared across all libraries.
from filprofiler.
Related Issues (20)
- Where are the data files referenced or saved from the blog? HOT 1
- Regression: pandas.read_parquet hangs when using filprofiler 2022.09.0 HOT 4
- Link to Sciagraph in more places
- Run smoke tests on wheels
- Documentation has wrong font HOT 2
- Maybe instead of exiting, OOM heuristic detection should merely dump
- Fix slow flamegraphs
- Fil crashes with panic if /proc/meminfo is missing information
- Debug assertion fails in oom.rs
- ARM wheels for Linux aren't building for some reason
- The Jupyter extension can be preloaded
- Recent versions likely have source-code-less Jupyter tracebacks
- Thread panicked HOT 22
- Issue template, to remind people to include versions of Fil/Python/OS
- Do you know of a way in which fil can be used with pytest? HOT 1
- Fil profiler fails for fairly large dataset HOT 11
- Re-enable out-of-memory (OOM) detection on macOS
- Update Sciagraph comparison
- Basic example not working HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from filprofiler.