microsoft / cntk-docker Goto Github PK

View Code? Open in Web Editor NEW

26.0 15.0 13.0 104 KB

Microsoft Cognitive Toolkit (CNTK) Docker Images

Home Page: https://hub.docker.com/r/microsoft/cntk/

License: Other

Shell 65.04% Dockerfile 34.96%

cntk-docker's Issues

ipywidgets fail in Jupyter notebook in Docker CNTK image version 2.2

This repros using both 2.2-gpu-python3.5-cuda8.0-cudnn6.0 and 2.2-cpu-python3.5

Repro steps

Launch the container ( to see the run without error change 2.2 to 2.1 )

$ docker run -it --init --rm -p 80:80 microsoft/cntk:2.2-cpu-python3.5 bash

From the container run the following command

source /cntk/activate-cntk && jupyter-notebook --no-browser --port=80 --ip=* --notebook-dir=/cntk/Tutorials --allow-root

Create a new notebook page and paste and run the following code

import ipywidgets as widgets

widgets.Dropdown(
  options=['one','two','three'],
  description='Choice:',
  disabled=False,
)

According to the issue on Jupyter running the following before running 3 should fix the issue (but it doesn't)

jupyter nbextension enable --py --sys-prefix widgetsnbextension

Expected

Saw instead

Cannot import cntk on microsoft/cntk:2.2-cpu-python3.5

Hi,

when I try running CNTK on a CPU only machine (my laptop) I get:

ImportError: libnvidia-ml.so.1: cannot open shared object file: No such file or directory

To repro:

docker pull microsoft/cntk:2.2-cpu-python3.5
docker run -d -p 8888:8888 --name cntk2.2 -t microsoft/cntk:2.2-cpu-python3.5
docker exec -it cntk2.2 bash
jupyter-notebook --no-browser --port=8888 --ip=0.0.0.0 --notebook-dir=/cntk/Tutorials --allow-root
open up notebook url and execute cell #5

I've tried the same steps with microsoft/cntk:2.1-cpu-python3.5, and everything works fine on the very same machine.

Here's the full output from CNTK_101_LogisticRegression notebook:

# Import the relevant components
from __future__ import print_function
import numpy as np
import sys
import os

import cntk as C
import cntk.tests.test_utils
cntk.tests.test_utils.set_device_from_pytest_env() # (only needed for our build system)
C.cntk_py.set_fixed_random_seed(1) # fix the random seed so that LR examples are repeatable
---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
~/anaconda3/envs/cntk-py35/lib/python3.5/site-packages/cntk/cntk_py.py in swig_import_helper()
     17         try:
---> 18             return importlib.import_module(mname)
     19         except ImportError:

~/anaconda3/envs/cntk-py35/lib/python3.5/importlib/__init__.py in import_module(name, package)
    125             level += 1
--> 126     return _bootstrap._gcd_import(name[level:], package, level)
    127 

~/anaconda3/envs/cntk-py35/lib/python3.5/importlib/_bootstrap.py in _gcd_import(name, package, level)

~/anaconda3/envs/cntk-py35/lib/python3.5/importlib/_bootstrap.py in _find_and_load(name, import_)

~/anaconda3/envs/cntk-py35/lib/python3.5/importlib/_bootstrap.py in _find_and_load_unlocked(name, import_)

ImportError: No module named 'cntk._cntk_py'

During handling of the above exception, another exception occurred:

ImportError                               Traceback (most recent call last)
<ipython-input-1-fca1ad3d7715> in <module>()
      5 import os
      6 
----> 7 import cntk as C
      8 import cntk.tests.test_utils
      9 cntk.tests.test_utils.set_device_from_pytest_env() # (only needed for our build system)

~/anaconda3/envs/cntk-py35/lib/python3.5/site-packages/cntk/__init__.py in <module>()
      8 import numpy as np
      9 
---> 10 from . import cntk_py
     11 
     12 #

~/anaconda3/envs/cntk-py35/lib/python3.5/site-packages/cntk/cntk_py.py in <module>()
     19         except ImportError:
     20             return importlib.import_module('_cntk_py')
---> 21     _cntk_py = swig_import_helper()
     22     del swig_import_helper
     23 elif _swig_python_version_info >= (2, 6, 0):

~/anaconda3/envs/cntk-py35/lib/python3.5/site-packages/cntk/cntk_py.py in swig_import_helper()
     18             return importlib.import_module(mname)
     19         except ImportError:
---> 20             return importlib.import_module('_cntk_py')
     21     _cntk_py = swig_import_helper()
     22     del swig_import_helper

~/anaconda3/envs/cntk-py35/lib/python3.5/importlib/__init__.py in import_module(name, package)
    124                 break
    125             level += 1
--> 126     return _bootstrap._gcd_import(name[level:], package, level)
    127 
    128 

ImportError: libnvidia-ml.so.1: cannot open shared object file: No such file or directory

This repo is missing important files

There are important files that Microsoft projects should all have that are not present in this repository. A pull request has been opened to add the missing file(s). When the pr is merged this issue will be closed automatically.

Microsoft teams can learn more about this effort and share feedback within the open source guidance available internally.

Merge this pull request

ImportError: No module named 'cntk._cntk_py'

I think this issue was raised in other repositories, but even for docker, which should have included everything needed to run the example.

Steps I have taken

docker pull microsoft/cntk
docker run -d -p 8888:8888 --name cntk-jupyter-notebooks -t microsoft/cntk
docker exec -it cntk-jupyter-notebooks bash -c "source /cntk/activate-cntk && jupyter-notebook --no-browser --port=8888 --ip=0.0.0.0 --notebook-dir=/cntk/Tutorials --allow-root"
I run the tutorial 101, and when it comes to from cntk import *, it yields the following error

---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
/root/anaconda3/envs/cntk-py35/lib/python3.5/site-packages/cntk/cntk_py.py in swig_import_helper()
     17         try:
---> 18             return importlib.import_module(mname)
     19         except ImportError:

/root/anaconda3/envs/cntk-py35/lib/python3.5/importlib/__init__.py in import_module(name, package)
    125             level += 1
--> 126     return _bootstrap._gcd_import(name[level:], package, level)
    127 

/root/anaconda3/envs/cntk-py35/lib/python3.5/importlib/_bootstrap.py in _gcd_import(name, package, level)

/root/anaconda3/envs/cntk-py35/lib/python3.5/importlib/_bootstrap.py in _find_and_load(name, import_)

/root/anaconda3/envs/cntk-py35/lib/python3.5/importlib/_bootstrap.py in _find_and_load_unlocked(name, import_)

ImportError: No module named 'cntk._cntk_py'

During handling of the above exception, another exception occurred:

ImportError                               Traceback (most recent call last)
<ipython-input-13-8f864feac379> in <module>()
      4 import sys
      5 import os
----> 6 from cntk import *
      7 
      8 import cntk as C

/root/anaconda3/envs/cntk-py35/lib/python3.5/site-packages/cntk/__init__.py in <module>()
      8 import numpy as np
      9 
---> 10 from . import cntk_py
     11 
     12 #

/root/anaconda3/envs/cntk-py35/lib/python3.5/site-packages/cntk/cntk_py.py in <module>()
     19         except ImportError:
     20             return importlib.import_module('_cntk_py')
---> 21     _cntk_py = swig_import_helper()
     22     del swig_import_helper
     23 elif _swig_python_version_info >= (2, 6, 0):

/root/anaconda3/envs/cntk-py35/lib/python3.5/site-packages/cntk/cntk_py.py in swig_import_helper()
     18             return importlib.import_module(mname)
     19         except ImportError:
---> 20             return importlib.import_module('_cntk_py')
     21     _cntk_py = swig_import_helper()
     22     del swig_import_helper

/root/anaconda3/envs/cntk-py35/lib/python3.5/importlib/__init__.py in import_module(name, package)
    124                 break
    125             level += 1
--> 126     return _bootstrap._gcd_import(name[level:], package, level)
    127 
    128 

ImportError: libnvidia-ml.so.1: cannot open shared object file: No such file or directory

Background Info

Running this on docker for mac
docker version: Docker version 17.06.0-ce-rc2, build 402dd4a

Output from `set`

BASH=/bin/bash
BASHOPTS=checkwinsize:cmdhist:complete_fullquote:expand_aliases:extquote:force_fignore:histappend:hostcomplete:interactive_comments:progcomp:promptvars:sourcepath
BASH_ALIASES=()
BASH_ARGC=()
BASH_ARGV=()
BASH_CMDS=()
BASH_LINENO=()
BASH_SOURCE=()
BASH_VERSINFO=([0]="4" [1]="3" [2]="11" [3]="1" [4]="release" [5]="x86_64-pc-linux-gnu")
BASH_VERSION='4.3.11(1)-release'
CNTK_VERSION=2.0
COLUMNS=134
CONDA_DEFAULT_ENV=/root/anaconda3/envs/cntk-py35
CONDA_PATH_BACKUP=/cntk/cntk/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
CONDA_PREFIX=/root/anaconda3/envs/cntk-py35
CONDA_PS1_BACKUP='\[\e]0;\u@\h: \w\a\]${debian_chroot:+($debian_chroot)}\u@\h:\w\$ '
CUDA_PKG_VERSION=8-0=8.0.61-1
CUDA_VERSION=8.0.61
DIRSTACK=()
EUID=0
EXT=
GROUPS=()
HISTCONTROL=ignoredups:ignorespace
HISTFILE=/root/.bash_history
HISTFILESIZE=2000
HISTSIZE=1000
HOME=/root
HOSTNAME=7c348559765c
HOSTTYPE=x86_64
IFS=$' \t\n'
LD_LIBRARY_PATH=/cntk/cntk/lib:/cntk/cntk/dependencies/lib:/root/openmpi/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64
LESSCLOSE='/usr/bin/lesspipe %s %s'
LESSOPEN='| /usr/bin/lesspipe %s'
LINES=90
LS_COLORS='rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.axa=00;36:*.oga=00;36:*.spx=00;36:*.xspf=00;36:'
MACHTYPE=x86_64-pc-linux-gnu
MAILCHECK=60
OPTERR=1
OPTIND=1
OSTYPE=linux-gnu
PATH=/root/anaconda3/envs/cntk-py35/bin:/cntk/cntk/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
PIPESTATUS=([0]="0")
PPID=0
PS1='(/root/anaconda3/envs/cntk-py35) \[\e]0;\u@\h: \w\a\]${debian_chroot:+($debian_chroot)}\u@\h:\w\$ '
PS2='> '
PS4='+ '
PWD=/root
SHELL=bash
SHELLOPTS=braceexpand:emacs:hashall:histexpand:history:interactive-comments:monitor
SHLVL=1
TERM=xterm
UID=0
_=export
_CONDA_D=/root/anaconda3/envs/cntk-py35/etc/conda/activate.d
_CONDA_DIR=/root/anaconda3/bin
_NEW_PART=/root/anaconda3/envs/cntk-py35/bin
_SCRIPT_LOCATION=/root/anaconda3/bin/deactivate
args=/root/anaconda3/envs/cntk-py35
firstpath=/root/anaconda3/envs/cntk-py35/bin
key=/root/anaconda3/envs/cntk-py35

Output from `export`

declare -x CNTK_VERSION="2.0"
declare -x CONDA_DEFAULT_ENV="/root/anaconda3/envs/cntk-py35"
declare -x CONDA_PATH_BACKUP="/cntk/cntk/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
declare -x CONDA_PREFIX="/root/anaconda3/envs/cntk-py35"
declare -x CONDA_PS1_BACKUP="\\[\\e]0;\\u@\\h: \\w\\a\\]\${debian_chroot:+(\$debian_chroot)}\\u@\\h:\\w\\\$ "
declare -x CUDA_PKG_VERSION="8-0=8.0.61-1"
declare -x CUDA_VERSION="8.0.61"
declare -x HOME="/root"
declare -x HOSTNAME="7c348559765c"
declare -x LD_LIBRARY_PATH="/cntk/cntk/lib:/cntk/cntk/dependencies/lib:/root/openmpi/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64"
declare -x LESSCLOSE="/usr/bin/lesspipe %s %s"
declare -x LESSOPEN="| /usr/bin/lesspipe %s"
declare -x LS_COLORS="rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.bz=01;31:*.tbz=01;31:*.tbz2=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.war=01;31:*.ear=01;31:*.sar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.webm=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=00;36:*.au=00;36:*.flac=00;36:*.mid=00;36:*.midi=00;36:*.mka=00;36:*.mp3=00;36:*.mpc=00;36:*.ogg=00;36:*.ra=00;36:*.wav=00;36:*.axa=00;36:*.oga=00;36:*.spx=00;36:*.xspf=00;36:"
declare -x OLDPWD
declare -x PATH="/root/anaconda3/envs/cntk-py35/bin:/cntk/cntk/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
declare -x PS1="(/root/anaconda3/envs/cntk-py35) \\[\\e]0;\\u@\\h: \\w\\a\\]\${debian_chroot:+(\$debian_chroot)}\\u@\\h:\\w\\\$ "
declare -x PWD="/root"
declare -x SHLVL="1"
declare -x TERM="xterm"

is it possible to use theano / keras on mac with backend CNTK-docker container?

if it was possible without too much work - I think it would be useful.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.