intel-analytics / bigdl-core Goto Github PK

View Code? Open in Web Editor NEW

33.0 33.0 36.0 642 KB

Core HW bindings and optimizations for BigDL

Java 14.77% C 24.23% Makefile 1.19% C++ 58.53% Shell 0.93% Python 0.35%

bigdl-core's People

Contributors

Stargazers

Watchers

bigdl-core's Issues

[Vulnerable] upgrade opencv

Issue Description
com.intel.analytics.bigdl:bigdl directly or transitively depends on 11 C libraries (.so). However, I noticed that some C libraries are vulnerable, containing the following CVEs:

libopencv_java320.sofrom C project opencv(version:3.2.0) exposed 18 vulnerabilities:
CVE-2019-15939, CVE-2019-14491, CVE-2019-14493, CVE-2019-14492, CVE-2017-1000450, CVE-2017-12863, CVE-2017-12862, CVE-2017-12864, CVE-2017-12604, CVE-2017-12597, CVE-2017-12606, CVE-2017-12605, CVE-2017-12598, CVE-2017-12600, CVE-2017-12599, CVE-2017-12602, CVE-2017-12601, CVE-2017-12603

Solution
Possible steps:

install opencv 4.2.0 wget https://github.com/opencv/opencv/archive/4.2.0.tar.gz on release environment
replace dependency in pom.xml https://github.com/intel-analytics/BigDL-core/blob/master/opencv/opencv-java-x86_64-linux/pom.xml#L17-L20
compile and mvn test UT
release bigdl-core 2.1.0-snapshot
Update bigdl-core version in BigDL-dllib. Finish the whole BigDL jenkins test

Release on mac when mac machine is recovered.

Rename MKL Class

Rename MKL class? https://github.com/intel-analytics/BigDL-core/blob/master/mkl2017-xeon-blas/src/main/java/com/intel/analytics/bigdl/mkl/MKL.java

mkl component need to be renamed

Unable to build BigDL-core on Mac OS Catalina 10.15

When I try to build BigDL-core on the latest Mac OS I get the following error:
`icc -I /Library/Java/JavaVirtualMachines/jdk1.8.0_231.jdk/Contents/Home/include/darwin -c -I /Library/Java/JavaVirtualMachines/jdk1.8.0_231.jdk/Contents/Home/include -std=c99 -fPIC -fstack-protector-all ../src/main/c/mkl.c -o target/c/mkl.o
../src/main/c/mkl.c(19): catastrophic error: cannot open source file "mkl.h"
#include <mkl.h>
^

compilation aborted for ../src/main/c/mkl.c (code 4)
make: *** [target/c/mkl.o] Error 4`

Any idea why this might be happening. I have Intel Parallel studio 2020 installed along with gcc7 as per the instructions here:
https://bigdl-project.github.io/0.10.0/#ScalaUserGuide/build-bigdl-core/

setNumThreads not working in maven distribution

Hi,

I am using this jar:
https://mvnrepository.com/artifact/com.intel.analytics.bigdl.native/mkl-java/0.2.0

When I run the (Kotlin) code below

println("${MKL.getMklNumThreads()}, ${MKL.getNumThreads()}")
MKL.setNumThreads(2)
println("${MKL.getMklNumThreads()}, ${MKL.getNumThreads()}")

my output is

1, 1
true
1, 1

I see that there is a libiomp5.so in the jar. Any idea why setNumThreads isn't working?

Thanks.

Migrate Zoo-Core TFNet to BigDL-Core

Need to remove zoo-core dependencies from BigDL.

@yangw1234 Please check if we still need tfnet.

If yes, we need to move it to BigDL-core

BigDL-core OpenCV4.2 has UnsatisfiedLinkError of *.so

UnsatisfiedLinkError on Ubuntu18.04:

librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 # this example can be found in /usr/lib/x86_64-linux-gnu 
libjpeg.so.62 => not found
libpng15.so.15 => not found
libjasper.so.1 => not found
libdc1394.so.22 => not found
libmkl_intel_lp64.so => not found
libmkl_sequential.so => not found
libmkl_core.so => not found
libimf.so => not found
libsvml.so => not found
libirng.so => not found
libintlc.so.5 => not found

The OS where builds OpenCV: Centos 7.

[INFO] Compiling 1 source file to /private/var/jenkins_home/workspace/BigDL-Core-Release-CORE-test-Mac/mkl2017-xeon-blas/mkl-java-mac/target/classes
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR : 
[INFO] -------------------------------------------------------------
[ERROR] Source option 5 is no longer supported. Use 7 or later.
[ERROR] Target option 5 is no longer supported. Use 7 or later.
[INFO] 2 errors 
[INFO] -------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for BigDL-core 2.1.0-SNAPSHOT:
[INFO] 
[INFO] BigDL-core ......................................... SUCCESS [  0.098 s]
[INFO] mkl-parent ......................................... SUCCESS [  0.467 s]
[INFO] mkl-java-mac ....................................... FAILURE [  0.330 s]
[INFO] dnn-parent ......................................... SKIPPED
[INFO] bigquant-parent .................................... SKIPPED
[INFO] bigquant-java-mac .................................. SKIPPED
[INFO] opencv-parent ...................................... SKIPPED
[INFO] opencv-java-mac .................................... SKIPPED
[INFO] dist-parent ........................................ SKIPPED
[INFO] mac ................................................ SKIPPED
[INFO] linux64 ............................................ SKIPPED
[INFO] rh5 ................................................ SKIPPED
[INFO] all ................................................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  1.350 s
[INFO] Finished at: 2022-04-07T16:49:58+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on project mkl-java-mac: Compilation failure: Compilation failure: 
[ERROR] Source option 5 is no longer supported. Use 7 or later.
[ERROR] Target option 5 is no longer supported. Use 7 or later.

jenkins link: http://10.112.231.51:18888/view/ZOO-Release/job/BigDL-Core-Release-CORE-test-Mac/11/console

java -version
java version "17.0.2" 2022-01-18 LTS
mvn -version
Apache Maven 3.8.1

Migrate Zoo-Core OpenVINO to BigDL-Core

Need to remove zoo-core dependencies from BigDL.

@Litchilitchy Please check if we still need OpenVINO.

If yes, we need to move it to BigDL-core

MKL path is hard cored "/opt/mklml/"

compile error

exec] /opt/binutils/bin/ld: cannot find -lmklml_intel
[exec] collect2: error: ld returned 1 exit status
[exec] make: *** [target/classes/libjdnn.so] Error 1

http://10.112.231.51:18889/view/BigDL-Release/job/BigDL-Core-Release-CORE/8/console

`GLIBCXX_3.xxx' can not found on ubuntu 16.04

/usr/lib/x86_64-linux-gnu/libstdc++.so.6: version GLIBCXX_3.4.21' not found ` on ubuntu 16.04

BigDL-core builds on Centos 7, check the GLIBC:

[root@sc12-bigdl bin]# strings /usr/lib64/libstdc++.so.6 | grep GLIBCXX
GLIBCXX_3.4
GLIBCXX_3.4.1
GLIBCXX_3.4.2
GLIBCXX_3.4.3
...
GLIBCXX_3.4.18
GLIBCXX_3.4.19
GLIBCXX_DEBUG_MESSAGE_LENGTH

intel-analytics / bigdl-core Goto Github PK

bigdl-core's People

Contributors

Stargazers

Watchers

Forkers

bigdl-core's Issues

Recommend Projects

Recommend Topics

Recommend Org