Comments (5)
Redis AI 1.2.5 cpu bionic
Docker build using:
https://github.com/applied-knowledge-systems/the-pattern-platform/blob/benchmark/conf/Dockerfile
Steps to reproduce:
git clone -b benchmark --recurse-submodules [email protected]:applied-knowledge-systems/the-pattern.git
./bootstrap_benchmark.sh
redis-cli -c -p 30001 -h 127.0.0.1
than output above from @mikhailredis
from redisai.
Confirm fixed:
ai_git
ai_git_sha:5a66cb397e410f15eb7b1e02a5ebab41afd2cf31
from redisai.
Still zeros:
# ai_versions
ai_RedisAI_version:1.2.5
ai_low_level_API_version:1
ai_rdb_version:4
# ai_git
ai_git_sha:746b199e69f272d12aab00c26d31c8e35eb48b29
# ai_load_time_configs
ai_threads_per_queue:1
ai_inter_op_parallelism:0
ai_intra_op_parallelism:0
ai_model_execution_timeout:5000
ai_backend_memory_limit:0
# ai_backends_info
ai_Torch_version:NA
# ai_cpu
ai_self_used_cpu_sys:369.307624
ai_self_used_cpu_user:231.629582
ai_children_used_cpu_sys:5.037731
ai_children_used_cpu_user:22.320745
ai_main_thread_used_cpu_sys:33.307624
ai_main_thread_used_cpu_user:34.629582
ai_queue_CPU_bthread_n1_used_cpu_total:401.920353
I thought it was fixed, but no:
AI.INFO bert-qa{5Ls}
1) "key"
2) "bert-qa{5Ls}"
3) "type"
4) "MODEL"
5) "backend"
6) "TORCH"
7) "device"
8) "CPU"
9) "tag"
10) ""
11) "duration"
12) (integer) 0
13) "samples"
14) (integer) 0
15) "calls"
16) (integer) 0
17) "errors"
18) (integer) 0
from redisai.
Model called on the shard and returns answer:
==> 30006.log <==
64:M 17 Apr 2022 09:44:18.793 * <rg> GEARS: QA cached called from keymiss
64:M 17 Apr 2022 09:44:18.793 * <rg> GEARS: Called with ['bertqa{5Ls}', 'PMC302072.xml:{5Ls}:145', 'Who performs viral transmission among adults']
64:M 17 Apr 2022 09:44:18.793 * <rg> GEARS: Key PMC302072.xml:{5Ls}:145
64:M 17 Apr 2022 09:44:18.793 * <rg> GEARS: Question Who performs viral transmission among adults
64:M 17 Apr 2022 09:44:18.793 * <rg> GEARS: Shard_id {5Ls}
64:M 17 Apr 2022 09:44:22.007 * <rg> GEARS: Answer her no a pc
64:M 17 Apr 2022 09:44:22.007 * <rg> GEARS: Result her no a pc
64:M 17 Apr 2022 09:44:22.007 * <rg> GEARS: Cache key bertqa{5Ls}_PMC302072.xml:{5Ls}:145_Who performs viral transmission among adults
but no reflection in AI.INFO.
from redisai.
Hey @AlexMikhalev,
You should run with Redis AI edge cpu bionic docker (instead of 1.2.5). The fix is in our master branch, but we hadn't released yet a new version (1.2.6 version should be out soon)
Can you check and see if it's working as expected with edge docker?
from redisai.
Related Issues (20)
- MTENSORGET HOT 11
- redislabs/redisai gpu docker images not working HOT 4
- Missing tests/test_data/graph.pb ? HOT 1
- dockerwrapper fixes needed to support both ai + others
- AI.DAGEXECUTE and AI.TENSORGET without key = redis crashes HOT 4
- RedisAI arm64 Dockerfile HOT 10
- torch GPU deployment get nvrtc: error HOT 7
- Shutdown when using saved dump.rdb HOT 3
- [Documentation] AI.SCRIPTSTORE example references AI.SCRIPTSET HOT 1
- Redis AI docker image redis-cli command crash exit while running info modules HOT 2
- Retrieve model chunk size HOT 1
- AI.CONFIG MODEL_CHUNK_SIZE fails on Redis clusters HOT 7
- Looking for dockerfile.jetson with RedisAI 1.2.5 and ONNX backend
- how to use RedisAI in redis cluster? HOT 1
- How to use redisai in redis cluster environment? HOT 1
- Examples on deploy multiple models in a DAG graph? HOT 1
- What is the definition of execute_command? HOT 2
- please provide a PDF of your CLA that I can route for signature
- Responsible disclosure policy HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from redisai.