Comments (9)
powderluv
commented on May 18, 2024
Does no error on the output mean successful run ?
from shark.
powderluv
commented on May 18, 2024
maybe we can run the inference a few times and output the time it took to run similar to:
from shark.
pashu123
commented on May 18, 2024
Sounds good.
from shark.
pashu123
commented on May 18, 2024
Added here: https://github.com/NodLabs/dSHARK/pull/33/files
from shark.
powderluv
commented on May 18, 2024
Can we also please add a number of iteration flag ?
from shark.
pashu123
commented on May 18, 2024
Iters flag to run https://github.com/NodLabs/dSHARK/blob/db5be15310dda3d8906206d68cc9eb7136373bac/shark/examples/minilm_jit.py#L30
from shark.
pashu123
commented on May 18, 2024
Basically no. of times to run the inference?
from shark.
powderluv
commented on May 18, 2024
yeah
from shark.
powderluv
commented on May 18, 2024
maybe even a number of warmup runs
from shark.
Related Issues (20)
- LoRA models not showing up in dropdown
- System interrupts gets very high CPU followed by complete computer shutdown HOT 3
- Document for the compilation flow ?
- Enable llama2 benchmarking with Turbine HOT 1
- FP8 Support HOT 10
- (Shark-1.0) setup_venv.ps1 specifies a torch-mlir version that has dropped off the end of package index
- RuntimeError: duplicate registrations HOT 3
- Gradio Button has no attr "label"
- Gradio JSON has no option interactive
- problem with Torch-mlir on Ubuntu, latest en previous Shark version
- (Studio2) Centralize and minimize prompt handling for LLMs
- (Studio2) (Windows) 'rocm devices are not available'
- Drastic difference in images generated in 984 vs 1091
- Can't run SDXL Turbo at all. My 32GB of RAM at 100% and fails. HOT 2
- After compiling Vulkan shaders, multiple errors ensue HOT 3
- bf16 result mismatch for Conv2D op HOT 30
- Compiling vulkan shaders never ends HOT 4
- "AttributeError: module 'mpmath' has no attribute 'rational'" when recreating .venv (+workaround) HOT 2
- Error registering modules: C:\actions-runner\w\SRT\SRT\c\runtime\src\iree\hal\drivers\vulkan\native_executable.cc:51:
- running SDXL set to 1024x1024 renders a black image
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from shark.