Comments (3)
it seems that autoscheduler_get_tunning_tasks do not have the default parameter "opt_level".
I browsed all versions of tvm on GitHub, and did not find any version of the corresponding interface "autoscheduler_get_tunning_tasks" to receive the "opt_level" parameter. so what is the official tvm version and what should I do?
from tpat.
it seems that autoscheduler_get_tunning_tasks do not have the default parameter "opt_level". I browsed all versions of tvm on GitHub, and did not find any version of the corresponding interface "autoscheduler_get_tunning_tasks" to receive the "opt_level" parameter. so what is the official tvm version and what should I do?
We have made some changes to the TVM source code. So you should try to use BlazerML-tvm(https://github.com/Tencent/TPAT/tree/main/3rdparty).
We recommend using Dockerfile directly. you can found the Dockerfile at https://github.com/Tencent/TPAT. The Dockerfile is based on the mirrors of NVIDIA:
FROM nvcr.io/nvidia/tensorflow:20.06-tf1-py3
you can choose the base mirrors in https://catalog.ngc.nvidia.com/containers
Tips: the mirrors must be installed tensorflow and tensorrt.
from tpat.
Thanks for your suggestion, I re-experimented as you suggested, but still got some errors. as follows.
WARNING:tensorflow:From test_tpat.py:33: The name tf.set_random_seed is deprecated. Please use tf.compat.vl.set_random_seed inste ad.
WARNING:tensorflow:From test_tpat.py:36: The name tf.ConfigProto is deprecated. Please use tf.compat.vl.ConfigProto instead.
begin to process
2022-08-11 16:33:11.870908627 [W:onnxruntime:Default, onnxruntime_pybind_state.cc:5O9 CreateExecutionProviderlnstance) Failed to create TensorrtExecutionProvider. Please reference https://onnxruntime.ai/docs/execution-providers/TensorRT-ExecutionProvider.htm l#requirements to ensure all dependencies are met.
2022-08-11 16:33:11.870959029 [W:onnxruntime:Default, onnxruntime_pybind_state.cc:535 CreateExecutionProviderlnstance) Failed to create CUDAExecutionProvider. Please reference https://onnxruntime.ai/docs/reference/execution-providers/CUDA-ExecutionProvider.h tml#requirements to ensure all dependencies are met.
Couldn't find reusable plugin for node abs_O
Start auto-tuning!
2022-08-11 16:33:11.955133673 [W:onnxruntime:Default, onnxruntime_pybind_state.cc:535 CreateExecutionProviderlnstance) Failed to create CUDAExecutionProvider. Please reference https://onnxruntime.ai/docs/reference/execution-providers/CUDA-ExecutionProvider.h tml#requirements to ensure all dependencies are met.
URLError(gaierror(-2, 'Name or service not known'))
Download attempt 0/3 failed, retrying.
URLError(gaierror(-2, 'Name or service not known'))
Download attempt 1/3 failed, retrying.
WARNING:root:Failed to download tophub package for cuda: <urlopen error [Errno -2) Name or service not known>
Compile...
WARNING:auto_scheduler:/tmp/tuning.log does not exist!
WARNING:download:URLError(gaierror(-2, 'Name or service not known'))
Download attempt 0/3 failed, retrying.
WARNING:download:URLError(gaierror(-2, 'Name or service not known'))
Download attempt 1/3 failed, retrying.
WARNING:root:Failed to download tophub package for cuda: <urlopen error [Errno -2) Name or service not known>
Running...
2022-08-11 16:33:13.053279847 LW:onnxruntijiie:DefauLt. onnxruntimejybind_state.cc:535 CreateExecutionProviderlnstancel Failed to create CI.OAExecutionProvider. Please reference https ://onnxruntie.ai/docs/reference/execution-providers/OLA-ExecutionProvider.h tmlsrequirements to ensure all, dependencies are met.
2022-08-11 16:33:13.348876189 [W:onnxruntuie:Default. onnxrunti.e_pybind_state.cc:535 CreateExecutionProviderlnstancel Failed to create CtLAExecutionProvider. Please reference https ://onnxrunti.ne.ai/docs/reference/execution-providers/OJ)A-ExecutionProvider.h tmlsrequirenients to ensure aU dependencies are met.
rm •rf ./lib/tpat_abs_O.so ./obj/*
if ( ! -d ./obj 1: then rkdir -p ./obj; fi
/opt/Lib/cuda-10.2//bin/nvcc -w -std—c++11 .M -MT tpat_abs_0.o -I. .I/opt/lib/cuda10.2//s.ples/common/inc -I/opt/lib/cuda-10.2/ /include -I/opt/l.ib/cuda-11.1/include -I/home/bitbrain/pzhu/third_package/tensorrt/TensorRT-7.0.0.11/include -I/usr/include -o tp at_abs_0. d s rc/tpat_abs_0 . cu
/opt/1.ib/cuda-10.2//bin/nvcc •w -std=c++11 -I. -I/opt/lib/cuda-10.2//samples/coon/inc -I/opt/Ub/cuda-10.2//include -1/opt/lib? cuda-li .1/include -I/ho.e/bitbrain/pzhu/thirdjackage/tensorrt/TensorRT-7.0.0. 11/include -I/usr/include .Xco.piler -fPIC -arch=sm _75 o tpat_abs_0.o -c src/tpat_abs_0.cu
a /opt/lib/cuda-10.2//bin/nvcc •w -std.c++11 -I. -I/opt/lib/cuda-10.2//samples/coonhinc .I/opt/tib/cuda.10.2//incl.ude -I/opt/li b/cuda-11.1/include -I/home/bitbrain/pzhu/thirdj,ackage/tensorrt/TensorRT-7.0.0.11/include -I/usr/include -Xca.piler -fPIC -arch= sm_75 -G -lineinfo -o tpat_abs_0.o -c src/tpat_abs_O.cu
g÷÷ -w -std=c÷+fl -shared -o tpat_abs_0.so tpat_abs_0.o -L/opt/lib/cuda-10.2//1ib64 -L/opt/lib/cuda-10.2//1ib64 -L/hooie/bitbrain/ pzhu/thirdjackage/tensorrt/TensorRT-7.0.0.11/lib -lnvinfer -lcudart -icuda -WL-rpath—/opt/lib/cuda-10.2//1ib64 -Wi. -rpath./opt /lib/cuda10.2//lib64 -WI. .rpath/ho.e/bitbrain/pzhu/thirdpackage/tensorrtfTensorRT-7.0.0.11/lib
if ( .d ./lib ); then mkdir p ./lib; fi
my *.o ./obj/
my *.d ./obj/
my .so ./lib/
0nnx_ne_mapping_trt_plugin: { ‘abs_O’: tpat_abs_0’)
(TensorRTi EOR: 3: getPluginCreator could not find plugin: tpat_abs_0 version: 1
In node 0 (importFaflbackPluginlmporter): UISIJPCRTED_N00E: Assertion failed: creator && Plugin not found, are the plugin ne. version. and namespace Correct?”
test_tpat.py:278: DeprecationWarning: Use build_serialized_network instead.
engine = builder.buiid_engine(network, builder_config)
[TensorRT] EFOR: 4: [network.cpp::validate::2411J Error Code 4: Internal. Error (Network must have at least one output) LERJ engine is None
PyOLA ER: The context stack was not enpty upon module cleanup.
A context was still active when the context stack was being cleaned up. At this point in our execution. GDA may already have been deinitialized. so there is no way we can finish cleanly. The progral will be aborted now.
Use Context.pop() to avoid this problem.
@buptqq
from tpat.
Related Issues (20)
- RandomNormal not supported for frontend ONNX HOT 1
- Support CUDA 11.5 and TensorRT 8.2.1.3? HOT 1
- 无法跑通 example HOT 1
- Support for dynamic shape ? HOT 2
- No radical Subgraph optimization for TensorRT HOT 1
- precision for one hot plugin is wrong HOT 2
- cuda kernel code generated by Ansor‘s search space will use shared memory optimization to auto tuning? HOT 1
- Is maintained of this repo? HOT 1
- Fail to run example test_onehot_dynamic_direct.py HOT 12
- Half model error HOT 8
- Error when running one_hot example HOT 6
- support for one hot plugin with dynamic axis other than batch_size dim HOT 4
- Is there a talk or article about of the implementation of this project? HOT 1
- unsupported ptx version error
- out of memeory HOT 2
- so build succeed, tensorrt run error HOT 6
- Could you provide simple tutorial on how to run onnx_to_plugin for simple operator? HOT 4
- KeyError int8 HOT 1
- so build succeed, tensorrt run error one hot example HOT 11
- 好久不维护了吗?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tpat.