Comments (13)
goldsborough
commented on August 14, 2024
30
This often occurs when you import the extension before import torch. Are you sure the order you are importing is:
import torch
import your_extension
Also, does this error occur when you import torch or import your_extension?
Or does it fail when compiling the extension?
from extension-cpp.
etoilestar
commented on August 14, 2024
7
This often occurs when you import the extension before
import torch. Are you sure the order you are importing is:import torch import your_extensionAlso, does this error occur when you
import torchorimport your_extension?
Or does it fail when compiling the extension?
hello， i meet the same problem, and i import torch before import _C, but it also occur, could you help me?
from extension-cpp.
goldsborough
commented on August 14, 2024
5
It says it in the tutorial -- there is a line saying
Just be sure to import torch first, as this will resolve some symbols that the dynamic linker must see
It doesn't have anything to do with setuptools, it's just a dynamic linking issue. The torch module is a shared (dynamic) library which defines certain symbols that are unresolved in the extension library. To make these symbols available, the library containing the symbols (torch) must be imported before the library using them (your_extension) so that the dynamic linker can match the symbols with those from the torch library.
from extension-cpp.
ezyang
commented on August 14, 2024
3
I helped another user who made the same mistake. Maybe we can figure out a good way to give a better error message.
from extension-cpp.
monajalal
commented on August 14, 2024
2
here is the code I am trying to run:
"""
Example 1. Drawing a teapot from multiple viewpoints.
"""
import os
import argparse
import torch
import numpy as np
import tqdm
import imageio
import neural_renderer as nr
not sure it throws this error
(base) mona@mona:~/research/3danimals/neural_renderer/examples$ python example1.py
Traceback (most recent call last):
File "example1.py", line 12, in <module>
import neural_renderer as nr
File "/home/mona/anaconda3/lib/python3.7/site-packages/neural_renderer/__init__.py", line 3, in <module>
from .load_obj import load_obj
File "/home/mona/anaconda3/lib/python3.7/site-packages/neural_renderer/load_obj.py", line 8, in <module>
import neural_renderer.cuda.load_textures as load_textures_cuda
ImportError: /home/mona/anaconda3/lib/python3.7/site-packages/neural_renderer/cuda/load_textures.cpython-37m-x86_64-linux-gnu.so: undefined symbol: THPVariableClass
daniilidis-group/neural_renderer#93
from extension-cpp.
jatentaki
commented on August 14, 2024
Ok, I won't be able to test on the same machine before tomorrow, but the fix works on my personal laptop. Perhaps this should be mentioned in the tutorial? Maybe it's common setuptools knowledge, but it caught me off guard.
from extension-cpp.
goldsborough
commented on August 14, 2024
@ezyang I'll think of something
from extension-cpp.
Spandan-Madan
commented on August 14, 2024
Having a similar error, and loading torch before the extension doesn't solve it. Here's the error stack:-
Version Info:
Pytorch version: 0.4.1
CUDA version: 8.0
GCC version: 5.2.0
Error stack:-
>>> import torch
>>> import modules
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/data/graphics/toyota-pytorch/inplace_abn/modules/__init__.py", line 2, in <module>
from .bn import ABN, InPlaceABN, InPlaceABNSync
File "/data/graphics/toyota-pytorch/inplace_abn/modules/bn.py", line 10, in <module>
from .functions import *
File "/data/graphics/toyota-pytorch/inplace_abn/modules/functions.py", line 17, in <module>
extra_cuda_cflags=["--expt-extended-lambda"])
File "/afs/csail.mit.edu/u/s/smadan/miniconda3/envs/test/lib/python3.6/site-packages/torch/utils/cpp_extension.py", line 494, in load
with_cuda=with_cuda)
File "/afs/csail.mit.edu/u/s/smadan/miniconda3/envs/test/lib/python3.6/site-packages/torch/utils/cpp_extension.py", line 670, in _jit_compile
return _import_module_from_library(name, build_directory)
File "/afs/csail.mit.edu/u/s/smadan/miniconda3/envs/test/lib/python3.6/site-packages/torch/utils/cpp_extension.py", line 753, in _import_module_from_library
return imp.load_module(module_name, file, path, description)
File "/afs/csail.mit.edu/u/s/smadan/miniconda3/envs/test/lib/python3.6/imp.py", line 243, in load_module
return load_dynamic(name, filename, file)
File "/afs/csail.mit.edu/u/s/smadan/miniconda3/envs/test/lib/python3.6/imp.py", line 343, in load_dynamic
return _load(spec)
ImportError: /tmp/torch_extensions/inplace_abn/inplace_abn.so: undefined symbol: _ZN2at5ErrorC1ENS_14SourceLocationENSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE
>>>
Code base which I'm trying to run when the error occurs:-
https://github.com/mapillary/inplace_abn
Any leads on what I should try?
from extension-cpp.
soumith
commented on August 14, 2024
@Spandan-Madan this is basically flaking on an ABI incompatibility. (gcc > 5.1 binaries have different std::string ABI than gccc <= 5.1 binaries).
For this, we (pytorch) have a patch in 0.4.1 that sets a flag to compile the cpp-extension with _GLIBCXX_USE_CXX11_ABI=0 (see pytorch/pytorch@f08f222 ).
Did you build the extension with pytorch-master and switch back to pytorch-0.4.1 (or something of that sort)?
from extension-cpp.
Spandan-Madan
commented on August 14, 2024
Thanks for the reply @soumith.
I am using an extension present in the folder modules here in this repo: https://github.com/mapillary/inplace_abn
I installed Pytorch using conda (both normal and your channel), but I get this error in both.
Any leads on what I should try would be helpful. I've tried running with GCC 4.8 and 5.2 both, error persists.
Thanks in advance :)
from extension-cpp.
ChujunWhu
commented on August 14, 2024
@Spandan-Madan Hi, have you solved the problem yet?
Met the same problem and tired gcc 4.8, gcc 4.9 and gcc 5.4 but all failed. The error still exists
My pytorch is 0.4.1.
from extension-cpp.
heiner
commented on August 14, 2024
I suspect the underlying error is pytorch/pytorch#38122.
from extension-cpp.
monajalal
commented on August 14, 2024
Could you please check
daniilidis-group/neural_renderer#92
and
daniilidis-group/neural_renderer#93
I was able to reproduce this error for two repos.
$ python
Python 3.7.6 (default, Jan 8 2020, 19:59:22)
[GCC 7.3.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import torch
>>> torch.__version__
'1.6.0'
>>> torch.version.cuda
'10.1'
>>> torch.cuda.is_available()
True
$ gcc --version
gcc (Ubuntu 9.3.0-10ubuntu2) 9.3.0
Copyright (C) 2019 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 20.04.1 LTS
Release: 20.04
Codename: focal
from extension-cpp.
Related Issues (20)
- www.facebook.com/rozi.khatun.961
- This repo can not compile using Pytorch 1.6.0 HOT 1
- This repo can not compile using Pytorch 1.6.0 HOT 1
- A question about backward propagation speed in cpp extension in tutorial
- Error when building cpp extension HOT 1
- AttributeError: module 'depthwise' has no attribute 'forward'
- cuda does not install HOT 17
- How does the layer of C++ extensions translate to TorchScript or onnx? HOT 1
- Cannot Unpack, Too Many Items
- How to debug in cuda-pytorch env?
- Writing a custom C++ extension with variants for both CPU and GPU? HOT 2
- Custom CUDA operator only work well on cuda:0 HOT 3
- How can I access data in cuda kernel like in pytorch?
- error LNK2001 undefined reference to `__cudaRegisterLinkedBinary
- Relation between at::Half and __half
- Deprecation warning
- Scikit-build-core / scikit-build support for binding
- `TORCH_LIBRARY` and `m.def` Not Working as Documented
- [feature request] Instruction on how to setup compile-env for Windows
- JIT-compiling the extension results in non-functional Python module.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from extension-cpp.