Comments (11)
I see, thanks for looking into this!
It would be nice to have CI support! Let me check with some folks to see whether there's a preferred solution or whether Travis CI would be fine.
from model-analysis.
Hi Sergei,
What command did you run? If you would like to generate whl file from source codes, you could simply run python bdist setup.py
.
from model-analysis.
I wanted to run tests with Bazel. Would you recommend running them via e.g. pytest instead?
from model-analysis.
It turns out that our BUILD files need to be fixed quite a bit to get them to work. We'll work on fixing the BUILD files and pushing a new version with the fixed BUILD files soon. In the meantime, you can try running the tests directly with Python. Sorry for the inconvenience, and thanks for your patience!
from model-analysis.
Okay, after some discussion, we'll be removing the BUILD files for the Python targets for now, since they don't really add much. Could you try running the tests with Python directly, and let us know if you run into any issues?
from model-analysis.
I have tried running the tests locally:
============== 23 failed, 85 passed, 1 warnings in 247.46 seconds ==============
most failures involve the repr of dilll internals and are tricky to diagnose. Full output of pytest: failures.txt
from model-analysis.
My guess is that they have something to do with Beam. Which version of Beam do you have installed?
from model-analysis.
2.6.0 which matches the apache-beam[gcp]>=2.5,<3
constraint in setup.py.
I have the same number of failures with 2.5.0 and 2.4.0, and the error messages look similar. Could it be the dill version then?
from model-analysis.
The failures are caused by pytest. I think it instruments unittest classes (or possibly instances) in a way which makes them non-pickleable. Therefore, the error: "cannot pickle generators".
Interestingly, the error goes away if pytest is executed with the--pdb
flag :)
Would you accept a PR adding Travis CI support?
from model-analysis.
Okay, so I checked with some other folks, and it looks like the plan is to set up a CI solution similar to what we have with the TensorFlow repository. Thanks for offering to add Travis CI support though!
from model-analysis.
Thanks for checking, closing the issue.
from model-analysis.
Related Issues (20)
- Unable to use custom Keras metrics with TFX evaluator component HOT 4
- AttributeError: partially initialized module error, test.py HOT 2
- Incorrect Documentation for MetricConfig
- Custom multilabel Keras metrics: dynamically initialize weight shape HOT 1
- Fairness indicator metrics do not show up HOT 5
- Validation bug when using feature values as slicing specs HOT 2
- No longer compatible with Dataflow runner v1 after v0.29
- Renaming Custom Layer breaks TFMA Evaluator HOT 6
- Error in merge_accumulators when using keras metrics on dataflow HOT 3
- TFMA analyze_raw_data function support with MultiClassConfusionMatrixPlot HOT 3
- Analytics HOT 1
- Breaking changes: tfma.metrics.MetricComputation `preprocessor` argument changed from accepting beam DoFn to `preprocessors` accepting a list of `Preprocessor` HOT 1
- Move to numpy >=1.20 because <1.20 is difficult to build on Apple Silicon HOT 4
- TFMA on Flink does not seems to be parallelizing work. HOT 5
- only integer values should be passed to num_instances metric. HOT 3
- Render_plot is failing HOT 2
- Feat: Have ability to return the HTML rather than creating the plots HOT 1
- CVE in Pyarrow dependency HOT 1
- CNN HOT 2
- pip install tensorflow-model-analysis fails on WSL2 on Windows 11 HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from model-analysis.