Perhaps a package got removed from the memorious build that now needs to be added to opensanctions?
➜ opensanctions git:(master) git log | head
commit e1dae92b2cd22e2f6249b0f68cd88405719e3df7
Merge: acc4b55 8865880
Author: Friedrich Lindenberg <[email protected]>
Date: Thu Jul 11 15:59:38 2019 +0200
Merge pull request #39 from BusinessOptics/master
Cache installing dependencies in docker build
commit 886588022f1f3bb255411db0c124c8c5cb3fa7bd
➜ opensanctions git:(master) docker pull alephdata/memorious:latest
latest: Pulling from alephdata/memorious
Digest: sha256:355da68db845b9325213b612ddf3db1aba96eda1e4612d6e6eb8deba6ccaf0aa
Status: Image is up to date for alephdata/memorious:latest
➜ opensanctions git:(master) docker-compose build --no-cache ui
Building ui
Step 1/7 : FROM alephdata/memorious
---> 8768724c668a
Step 2/7 : RUN apk add --no-cache --virtual .build-deps gcc python3-dev postgresql-dev
---> Running in 931795a880d1
fetch http://dl-cdn.alpinelinux.org/alpine/v3.10/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.10/community/x86_64/APKINDEX.tar.gz
(1/13) Installing binutils (2.32-r0)
(2/13) Installing gmp (6.1.2-r1)
(3/13) Installing isl (0.18-r0)
(4/13) Installing libatomic (8.3.0-r0)
(5/13) Installing mpfr3 (3.1.5-r1)
(6/13) Installing mpc1 (1.1.0-r0)
(7/13) Installing gcc (8.3.0-r0)
(8/13) Installing pkgconf (1.6.1-r1)
(9/13) Installing python3-dev (3.7.3-r0)
(10/13) Installing openssl-dev (1.1.1c-r0)
(11/13) Installing postgresql-libs (11.4-r0)
(12/13) Installing postgresql-dev (11.4-r0)
(13/13) Installing .build-deps (20190715.092734)
Executing busybox-1.30.1-r2.trigger
OK: 338 MiB in 94 packages
Removing intermediate container 931795a880d1
---> fb44b610b36b
Step 3/7 : COPY setup.py /opensanctions/setup.py
---> 363c0fff12de
Step 4/7 : RUN pip install -e /opensanctions
---> Running in 5ea4957bf273
Obtaining file:///opensanctions
Collecting followthemoney>=1.9.2 (from opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/87/82/e2c866f9ee9aa9b1148361df4dabe040e6d3b27089f213e647874adf5509/followthemoney-1.14.1-py2.py3-none-any.whl (228kB)
Collecting balkhash[sql]>=0.3.0 (from opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/6d/68/97d981072a03cbd8f14416756ce5aaaf248e16be7f91e7fbb838c5d383e7/balkhash-1.0.0-py2.py3-none-any.whl
Requirement already satisfied: memorious>=0.8 in /memorious (from opensanctions==1.99) (0.14.2)
Collecting countrynames (from opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/ab/ee/4778c4c59c2a65fead8e77c28978c5f5819702acba2acbb677be3e882b51/countrynames-1.6.0-py3-none-any.whl (228kB)
Collecting xlrd (from opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/b0/16/63576a1a001752e34bf8ea62e367997530dc553b689356b9879339cf45a4/xlrd-1.2.0-py2.py3-none-any.whl (103kB)
Requirement already satisfied: sqlalchemy>=1.2.0 in /usr/lib/python3.7/site-packages (from followthemoney>=1.9.2->opensanctions==1.99) (1.3.5)
Requirement already satisfied: pytz>=2018.5 in /usr/lib/python3.7/site-packages (from followthemoney>=1.9.2->opensanctions==1.99) (2019.1)
Requirement already satisfied: normality>=1.0.0 in /usr/lib/python3.7/site-packages (from followthemoney>=1.9.2->opensanctions==1.99) (1.0.0)
Collecting python-levenshtein>=0.12.0 (from followthemoney>=1.9.2->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/42/a9/d1785c85ebf9b7dfacd08938dd028209c34a0ea3b1bcdb895208bd40a67d/python-Levenshtein-0.12.0.tar.gz (48kB)
Requirement already satisfied: stringcase>=1.2.0 in /usr/lib/python3.7/site-packages (from followthemoney>=1.9.2->opensanctions==1.99) (1.2.0)
Requirement already satisfied: pyyaml>=5.1 in /usr/lib/python3.7/site-packages (from followthemoney>=1.9.2->opensanctions==1.99) (5.1.1)
Collecting python-stdnum>=1.10 (from followthemoney>=1.9.2->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/ad/df/07a3d26fa0a7e02d98b1a207a684ec611af19b8e15a9a0d63a06472b590b/python_stdnum-1.11-py2.py3-none-any.whl (778kB)
Collecting pantomime>=0.3.2 (from followthemoney>=1.9.2->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/8a/0a/123fdbddc14f1cc316183f072d3444c454d170050eec9ec5c83b4fbf2135/pantomime-0.3.3-py2.py3-none-any.whl
Requirement already satisfied: requests[security]>=2.21.0 in /usr/lib/python3.7/site-packages (from followthemoney>=1.9.2->opensanctions==1.99) (2.22.0)
Requirement already satisfied: banal>=0.4.2 in /usr/lib/python3.7/site-packages (from followthemoney>=1.9.2->opensanctions==1.99) (0.4.2)
Requirement already satisfied: click>=7.0 in /usr/lib/python3.7/site-packages (from followthemoney>=1.9.2->opensanctions==1.99) (7.0)
Collecting openpyxl>=2.6.0 (from followthemoney>=1.9.2->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/ba/06/b899c8867518df19e242d8cbc82d4ba210f5ffbeebb7704c695e687ab59c/openpyxl-2.6.2.tar.gz (173kB)
Collecting phonenumbers>=8.9.11 (from followthemoney>=1.9.2->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/34/3f/ca2193d6e93074b78cebdbd73c31815c82a50c8975d0517a7ff0b0337430/phonenumbers-8.10.14-py2.py3-none-any.whl (2.6MB)
Requirement already satisfied: urlnormalizer>=1.2.0 in /usr/lib/python3.7/site-packages (from followthemoney>=1.9.2->opensanctions==1.99) (1.2.3)
Collecting rdflib>=4.2.2 (from followthemoney>=1.9.2->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/3c/fe/630bacb652680f6d481b9febbb3e2c3869194a1a5fc3401a4a41195a2f8f/rdflib-4.2.2-py3-none-any.whl (344kB)
Collecting languagecodes>=1.0.4 (from followthemoney>=1.9.2->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/d7/82/0273d2d101ca48fa6f3db0b9a9b83a1b8b8f73a3f243877cc1dc06696e23/languagecodes-1.0.4-py3-none-any.whl (88kB)
Requirement already satisfied: babel in /usr/lib/python3.7/site-packages (from followthemoney>=1.9.2->opensanctions==1.99) (2.7.0)
Collecting networkx>=2.3 (from followthemoney>=1.9.2->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/85/08/f20aef11d4c343b557e5de6b9548761811eb16e438cee3d32b1c66c8566b/networkx-2.3.zip (1.7MB)
Collecting psycopg2-binary>=2.7; extra == "sql" (from balkhash[sql]>=0.3.0->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/80/91/91911be01869fa877135946f928ed0004e62044bdd876c1e0f12e1b5fb90/psycopg2-binary-2.8.3.tar.gz (378kB)
Requirement already satisfied: requests_ftp in /usr/lib/python3.7/site-packages (from memorious>=0.8->opensanctions==1.99) (0.3.1)
Requirement already satisfied: lxml>=3 in /usr/lib/python3.7/site-packages (from memorious>=0.8->opensanctions==1.99) (4.3.4)
Requirement already satisfied: tabulate in /usr/lib/python3.7/site-packages (from memorious>=0.8->opensanctions==1.99) (0.8.3)
Requirement already satisfied: dataset>=1.0.8 in /usr/lib/python3.7/site-packages (from memorious>=0.8->opensanctions==1.99) (1.1.2)
Requirement already satisfied: servicelayer>=1.5.3 in /usr/lib/python3.7/site-packages (from memorious>=0.8->opensanctions==1.99) (1.5.3)
Requirement already satisfied: celestial>=0.2.0 in /usr/lib/python3.7/site-packages (from memorious>=0.8->opensanctions==1.99) (0.2.3)
Requirement already satisfied: dateparser in /usr/lib/python3.7/site-packages (from memorious>=0.8->opensanctions==1.99) (0.7.1)
Requirement already satisfied: python-redis-rate-limit>=0.0.5 in /usr/lib/python3.7/site-packages (from memorious>=0.8->opensanctions==1.99) (0.0.7)
Requirement already satisfied: blinker>=1.4 in /usr/lib/python3.7/site-packages (from memorious>=0.8->opensanctions==1.99) (1.4)
Requirement already satisfied: flask in /usr/lib/python3.7/site-packages (from memorious>=0.8->opensanctions==1.99) (1.1.1)
Requirement already satisfied: six in /usr/lib/python3.7/site-packages (from countrynames->opensanctions==1.99) (1.12.0)
Requirement already satisfied: chardet in /usr/lib/python3.7/site-packages (from normality>=1.0.0->followthemoney>=1.9.2->opensanctions==1.99) (3.0.4)
Requirement already satisfied: pyicu>=1.9.3 in /usr/lib/python3.7/site-packages (from normality>=1.0.0->followthemoney>=1.9.2->opensanctions==1.99) (2.3.1)
Requirement already satisfied: setuptools in /usr/lib/python3.7/site-packages (from python-levenshtein>=0.12.0->followthemoney>=1.9.2->opensanctions==1.99) (41.0.1)
Requirement already satisfied: idna<2.9,>=2.5 in /usr/lib/python3.7/site-packages (from requests[security]>=2.21.0->followthemoney>=1.9.2->opensanctions==1.99) (2.8)
Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python3.7/site-packages (from requests[security]>=2.21.0->followthemoney>=1.9.2->opensanctions==1.99) (2019.6.16)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/lib/python3.7/site-packages (from requests[security]>=2.21.0->followthemoney>=1.9.2->opensanctions==1.99) (1.25.3)
Requirement already satisfied: cryptography>=1.3.4; extra == "security" in /usr/lib/python3.7/site-packages (from requests[security]>=2.21.0->followthemoney>=1.9.2->opensanctions==1.99) (2.6.1)
Requirement already satisfied: pyOpenSSL>=0.14; extra == "security" in /usr/lib/python3.7/site-packages (from requests[security]>=2.21.0->followthemoney>=1.9.2->opensanctions==1.99) (19.0.0)
Collecting jdcal (from openpyxl>=2.6.0->followthemoney>=1.9.2->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/f0/da/572cbc0bc582390480bbd7c4e93d14dc46079778ed915b505dc494b37c57/jdcal-1.4.1-py2.py3-none-any.whl
Collecting et_xmlfile (from openpyxl>=2.6.0->followthemoney>=1.9.2->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/22/28/a99c42aea746e18382ad9fb36f64c1c1f04216f41797f2f0fa567da11388/et_xmlfile-1.0.1.tar.gz
Collecting pyparsing (from rdflib>=4.2.2->followthemoney>=1.9.2->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/dd/d9/3ec19e966301a6e25769976999bd7bbe552016f0d32b577dc9d63d2e0c49/pyparsing-2.4.0-py2.py3-none-any.whl (62kB)
Collecting isodate (from rdflib>=4.2.2->followthemoney>=1.9.2->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl (45kB)
Collecting decorator>=4.3.0 (from networkx>=2.3->followthemoney>=1.9.2->opensanctions==1.99)
Downloading https://files.pythonhosted.org/packages/5f/88/0075e461560a1e750a0dcbf77f1d9de775028c37a19a346a6c565a257399/decorator-4.4.0-py2.py3-none-any.whl
Requirement already satisfied: alembic>=0.6.2 in /usr/lib/python3.7/site-packages (from dataset>=1.0.8->memorious>=0.8->opensanctions==1.99) (1.0.11)
Requirement already satisfied: redis>=3.2.1 in /usr/lib/python3.7/site-packages (from servicelayer>=1.5.3->memorious>=0.8->opensanctions==1.99) (3.2.1)
Requirement already satisfied: fakeredis>=1.0.3 in /usr/lib/python3.7/site-packages (from servicelayer>=1.5.3->memorious>=0.8->opensanctions==1.99) (1.0.3)
Requirement already satisfied: regex in /usr/lib/python3.7/site-packages (from dateparser->memorious>=0.8->opensanctions==1.99) (2019.6.8)
Requirement already satisfied: python-dateutil in /usr/lib/python3.7/site-packages (from dateparser->memorious>=0.8->opensanctions==1.99) (2.8.0)
Requirement already satisfied: tzlocal in /usr/lib/python3.7/site-packages (from dateparser->memorious>=0.8->opensanctions==1.99) (1.5.1)
Requirement already satisfied: Jinja2>=2.10.1 in /usr/lib/python3.7/site-packages (from flask->memorious>=0.8->opensanctions==1.99) (2.10.1)
Requirement already satisfied: Werkzeug>=0.15 in /usr/lib/python3.7/site-packages (from flask->memorious>=0.8->opensanctions==1.99) (0.15.4)
Requirement already satisfied: itsdangerous>=0.24 in /usr/lib/python3.7/site-packages (from flask->memorious>=0.8->opensanctions==1.99) (1.1.0)
Requirement already satisfied: asn1crypto>=0.21.0 in /usr/lib/python3.7/site-packages (from cryptography>=1.3.4; extra == "security"->requests[security]>=2.21.0->followthemoney>=1.9.2->opensanctions==1.99) (0.24.0)
Requirement already satisfied: cffi!=1.11.3,>=1.8 in /usr/lib/python3.7/site-packages (from cryptography>=1.3.4; extra == "security"->requests[security]>=2.21.0->followthemoney>=1.9.2->opensanctions==1.99) (1.11.5)
Requirement already satisfied: Mako in /usr/lib/python3.7/site-packages (from alembic>=0.6.2->dataset>=1.0.8->memorious>=0.8->opensanctions==1.99) (1.0.13)
Requirement already satisfied: python-editor>=0.3 in /usr/lib/python3.7/site-packages (from alembic>=0.6.2->dataset>=1.0.8->memorious>=0.8->opensanctions==1.99) (1.0.4)
Requirement already satisfied: sortedcontainers in /usr/lib/python3.7/site-packages (from fakeredis>=1.0.3->servicelayer>=1.5.3->memorious>=0.8->opensanctions==1.99) (2.1.0)
Requirement already satisfied: MarkupSafe>=0.23 in /usr/lib/python3.7/site-packages (from Jinja2>=2.10.1->flask->memorious>=0.8->opensanctions==1.99) (1.1.1)
Requirement already satisfied: pycparser in /usr/lib/python3.7/site-packages (from cffi!=1.11.3,>=1.8->cryptography>=1.3.4; extra == "security"->requests[security]>=2.21.0->followthemoney>=1.9.2->opensanctions==1.99) (2.19)
Installing collected packages: python-levenshtein, python-stdnum, pantomime, jdcal, et-xmlfile, openpyxl, phonenumbers, countrynames, pyparsing, isodate, rdflib, languagecodes, decorator, networkx, followthemoney, psycopg2-binary, balkhash, xlrd, opensanctions
Running setup.py install for python-levenshtein: started
Running setup.py install for python-levenshtein: finished with status 'error'
ERROR: Complete output from command /usr/bin/python3.7 -u -c 'import setuptools, tokenize;__file__='"'"'/tmp/pip-install-pwxewkfe/python-levenshtein/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-zgzbi8nq/install-record.txt --single-version-externally-managed --compile:
ERROR: running install
running build
running build_py
creating build
creating build/lib.linux-x86_64-3.7
creating build/lib.linux-x86_64-3.7/Levenshtein
copying Levenshtein/__init__.py -> build/lib.linux-x86_64-3.7/Levenshtein
copying Levenshtein/StringMatcher.py -> build/lib.linux-x86_64-3.7/Levenshtein
running egg_info
writing python_Levenshtein.egg-info/PKG-INFO
writing dependency_links to python_Levenshtein.egg-info/dependency_links.txt
writing entry points to python_Levenshtein.egg-info/entry_points.txt
writing namespace_packages to python_Levenshtein.egg-info/namespace_packages.txt
writing requirements to python_Levenshtein.egg-info/requires.txt
writing top-level names to python_Levenshtein.egg-info/top_level.txt
reading manifest file 'python_Levenshtein.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no previously-included files matching '*pyc' found anywhere in distribution
warning: no previously-included files matching '*so' found anywhere in distribution
warning: no previously-included files matching '.project' found anywhere in distribution
warning: no previously-included files matching '.pydevproject' found anywhere in distribution
writing manifest file 'python_Levenshtein.egg-info/SOURCES.txt'
copying Levenshtein/_levenshtein.c -> build/lib.linux-x86_64-3.7/Levenshtein
copying Levenshtein/_levenshtein.h -> build/lib.linux-x86_64-3.7/Levenshtein
running build_ext
building 'Levenshtein._levenshtein' extension
creating build/temp.linux-x86_64-3.7
creating build/temp.linux-x86_64-3.7/Levenshtein
gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Os -fomit-frame-pointer -g -Os -fomit-frame-pointer -g -Os -fomit-frame-pointer -g -DTHREAD_STACK_SIZE=0x100000 -fPIC -I/usr/include/python3.7m -c Levenshtein/_levenshtein.c -o build/temp.linux-x86_64-3.7/Levenshtein/_levenshtein.o
In file included from Levenshtein/_levenshtein.c:99:
/usr/include/python3.7m/Python.h:11:10: fatal error: limits.h: No such file or directory
#include <limits.h>
^~~~~~~~~~
compilation terminated.
error: command 'gcc' failed with exit status 1
----------------------------------------
ERROR: Command "/usr/bin/python3.7 -u -c 'import setuptools, tokenize;__file__='"'"'/tmp/pip-install-pwxewkfe/python-levenshtein/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-zgzbi8nq/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-install-pwxewkfe/python-levenshtein/
ERROR: Service 'ui' failed to build: The command '/bin/sh -c pip install -e /opensanctions' returned a non-zero code: 1