conda-forge / botocore-feedstock Goto Github PK

View Code? Open in Web Editor NEW

2.0 4.0 17.0 1.19 MB

A conda-smithy repository for botocore.

License: BSD 3-Clause "New" or "Revised" License

botocore-feedstock's Introduction

About botocore-feedstock

Feedstock license: BSD-3-Clause

Home: http://aws.amazon.com/sdk-for-python/

Package license: Apache-2.0

Summary: Low-level, data-driven core of boto 3.

Development: https://github.com/boto/botocore

Documentation: https://botocore.readthedocs.io/en/latest/

Provides the core functionality of Boto3, the AWS SDK for Python

Current build status

All platforms:

Current release info

Name	Downloads	Version	Platforms

Installing botocore

Installing botocore from the conda-forge channel can be achieved by adding conda-forge to your channels with:

conda config --add channels conda-forge
conda config --set channel_priority strict

Once the conda-forge channel has been enabled, botocore can be installed with conda:

conda install botocore

or with mamba:

mamba install botocore

It is possible to list all of the versions of botocore available on your platform with conda:

conda search botocore --channel conda-forge

or with mamba:

mamba search botocore --channel conda-forge

Alternatively, mamba repoquery may provide more information:

# Search all versions available on your platform:
mamba repoquery search botocore --channel conda-forge

# List packages depending on `botocore`:
mamba repoquery whoneeds botocore --channel conda-forge

# List dependencies of `botocore`:
mamba repoquery depends botocore --channel conda-forge

About conda-forge

conda-forge is a community-led conda channel of installable packages. In order to provide high-quality builds, the process has been automated into the conda-forge GitHub organization. The conda-forge organization contains one repository for each of the installable packages. Such a repository is known as a feedstock.

A feedstock is made up of a conda recipe (the instructions on what and how to build the package) and the necessary configurations for automatic building using freely available continuous integration services. Thanks to the awesome service provided by Azure, GitHub, CircleCI, AppVeyor, Drone, and TravisCI it is possible to build and upload installable packages to the conda-forge anaconda.org channel for Linux, Windows and OSX respectively.

To manage the continuous integration and simplify feedstock maintenance conda-smithy has been developed. Using the conda-forge.yml within this repository, it is possible to re-render all of this feedstock's supporting files (e.g. the CI configuration files) with conda smithy rerender.

For more information please check the conda-forge documentation.

Terminology

feedstock - the conda recipe (raw material), supporting scripts and CI configuration.

conda-smithy - the tool which helps orchestrate the feedstock. Its primary use is in the construction of the CI .yml files and simplify the management of many feedstocks.

conda-forge - the place where the feedstock and smithy live and work to produce the finished article (built conda distributions)

Updating botocore-feedstock

If you would like to improve the botocore recipe or build a new package version, please fork this repository and submit a PR. Upon submission, your changes will be run on the appropriate platforms to give the reviewer an opportunity to confirm that the changes result in a successful build. Once merged, the recipe will be re-built and uploaded automatically to the conda-forge channel, whereupon the built conda packages will be available for everybody to install and use from the conda-forge channel. Note that all branches in the conda-forge/botocore-feedstock are immediately built and any created packages are uploaded, so PRs should be based on branches in forks and branches in the main repository should only be used to build distinct package versions.

In order to produce a uniquely identifiable distribution:

If the version of a package is not being increased, please add or increase the build/number.
If the version of a package is being increased, please remember to return the build/number back to 0.

Feedstock Maintainers

botocore-feedstock's People

Contributors

Stargazers

Watchers

Forkers

conda-forge-admin hajapy lexual anacondarecipes regro-cf-autotick-bot ocefpaf tkelman manics pmlandwehr anaconda-community heavytony2 0xbe7a pavelzw

botocore-feedstock's Issues

@conda-forge-admin, please update circle

Issue with the urllib3 dependancy

I'm currently unable to get the updated recipe for the resdk package, except if I decide to sacrifice python 3.10 and 3.11. conda-forge/resdk-feedstock#9

For example, if I remove the noarch and list the deps

    - urllib3  >=2  # [py>=310]
    - urllib3 >=1.25.4,<1.27  # [py<310]

I get this result for a.10 and 3.11 :

- urllib3 >=2
 - openpyxl
 - python >=3.11,<3.12.0a0
 - importlib-metadata
 - tzlocal >=1.5.1
 - pandas >=1.0.0
 - mypy-boto3-s3
 - tqdm
 - slumber >=0.7.1
 - boto3-stubs >=1.24,<2.dev0
 - wrapt
 - requests >=2.6.0
 - xlrd
 - boto3 >=1.24,<2.dev0
 - pytz >=2018.4
 - aiohttp >=3.8.5,<3.9.dev0

with channels:

The reported errors are:
- Encountered problems while solving:
-   - package boto3-1.24.0-pyhd8ed1ab_0 requires botocore >=1.27.0,<1.28.0, but none of the providers can be installed

If I had botocore to the deps

    - urllib3  >=2  # [py>=310]
    - urllib3 >=1.25.4,<1.27  # [py<310]
    - botocore

Here's the result:
The reported errors are:

- Encountered problems while solving:
-   - package botocore-1.27.0-pyhd8ed1ab_0 requires urllib3 >=1.25.4,<1.27, but none of the providers can be installed

So basically, the botocore package is set to get the wrong urllib3 versions for python 3.10 higher.

Please update version to the latest release

https://github.com/boto/botocore/releases

update version to 1.5.22

Installing s3fs on Python 3.10 installs old incompatible botocore

Solution to issue cannot be found in the documentation.

I checked the documentation.

Issue

Using mamba, if you install python and s3fs you will get an environment with Python 3.10.4 and botocore 1.10.58. This wouldn't be a huge issue if that version did everything you want, but that version isn't compatible with Python 3.10 and trying to import botocore produces:

$ python -c "import botocore.credentials"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/davidh/miniconda3/envs/s3fs/lib/python3.10/site-packages/botocore/credentials.py", line 30, in <module>
    import botocore.configloader
  File "/home/davidh/miniconda3/envs/s3fs/lib/python3.10/site-packages/botocore/configloader.py", line 19, in <module>
    from botocore.compat import six
  File "/home/davidh/miniconda3/envs/s3fs/lib/python3.10/site-packages/botocore/compat.py", line 25, in <module>
    from botocore.exceptions import MD5UnavailableError
  File "/home/davidh/miniconda3/envs/s3fs/lib/python3.10/site-packages/botocore/exceptions.py", line 15, in <module>
    from botocore.vendored.requests.exceptions import ConnectionError
  File "/home/davidh/miniconda3/envs/s3fs/lib/python3.10/site-packages/botocore/vendored/requests/__init__.py", line 58, in <module>
    from . import utils
  File "/home/davidh/miniconda3/envs/s3fs/lib/python3.10/site-packages/botocore/vendored/requests/utils.py", line 26, in <module>
    from .compat import parse_http_list as _parse_list_header
  File "/home/davidh/miniconda3/envs/s3fs/lib/python3.10/site-packages/botocore/vendored/requests/compat.py", line 7, in <module>
    from .packages import chardet
  File "/home/davidh/miniconda3/envs/s3fs/lib/python3.10/site-packages/botocore/vendored/requests/packages/__init__.py", line 3, in <module>
    from . import urllib3
  File "/home/davidh/miniconda3/envs/s3fs/lib/python3.10/site-packages/botocore/vendored/requests/packages/urllib3/__init__.py", line 10, in <module>
    from .connectionpool import (
  File "/home/davidh/miniconda3/envs/s3fs/lib/python3.10/site-packages/botocore/vendored/requests/packages/urllib3/connectionpool.py", line 38, in <module>
    from .response import HTTPResponse
  File "/home/davidh/miniconda3/envs/s3fs/lib/python3.10/site-packages/botocore/vendored/requests/packages/urllib3/response.py", line 9, in <module>
    from ._collections import HTTPHeaderDict
  File "/home/davidh/miniconda3/envs/s3fs/lib/python3.10/site-packages/botocore/vendored/requests/packages/urllib3/_collections.py", line 1, in <module>
    from collections import Mapping, MutableMapping
ImportError: cannot import name 'Mapping' from 'collections' (/home/davidh/miniconda3/envs/s3fs/lib/python3.10/collections/__init__.py)

$ mamba --version
mamba 0.23.0
conda 4.12.0

I'm not sure if this should be filed here or with mamba so I'm starting here.

Installed packages

# packages in environment at /home/davidh/miniconda3/envs/s3fs:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       2_gnu    conda-forge
aiobotocore               0.10.0                     py_0    conda-forge
aiohttp                   3.8.1           py310h5764c6d_1    conda-forge
aiosignal                 1.2.0              pyhd8ed1ab_0    conda-forge
async-timeout             4.0.2              pyhd8ed1ab_0    conda-forge
attrs                     21.4.0             pyhd8ed1ab_0    conda-forge
botocore                  1.10.58                    py_0    conda-forge
bzip2                     1.0.8                h7f98852_4    conda-forge
ca-certificates           2021.10.8            ha878542_0    conda-forge
charset-normalizer        2.0.12             pyhd8ed1ab_0    conda-forge
docutils                  0.18.1          py310hff52083_1    conda-forge
frozenlist                1.3.0           py310h5764c6d_1    conda-forge
fsspec                    2021.7.0           pyhd8ed1ab_0    conda-forge
idna                      3.3                pyhd8ed1ab_0    conda-forge
jmespath                  0.10.0             pyh9f0ad1d_0    conda-forge
ld_impl_linux-64          2.36.1               hea4e1c9_2    conda-forge
libffi                    3.4.2                h7f98852_5    conda-forge
libgcc-ng                 11.2.0              h1d223b6_16    conda-forge
libgomp                   11.2.0              h1d223b6_16    conda-forge
libnsl                    2.0.0                h7f98852_0    conda-forge
libuuid                   2.32.1            h7f98852_1000    conda-forge
libzlib                   1.2.11            h166bdaf_1014    conda-forge
multidict                 6.0.2           py310h5764c6d_1    conda-forge
ncurses                   6.3                  h27087fc_1    conda-forge
openssl                   3.0.3                h166bdaf_0    conda-forge
pip                       22.0.4             pyhd8ed1ab_0    conda-forge
python                    3.10.4          h2660328_0_cpython    conda-forge
python-dateutil           2.8.2              pyhd8ed1ab_0    conda-forge
python_abi                3.10                    2_cp310    conda-forge
readline                  8.1                  h46c0cb4_0    conda-forge
s3fs                      2021.7.0           pyhd8ed1ab_0    conda-forge
setuptools                62.1.0          py310hff52083_0    conda-forge
six                       1.16.0             pyh6c4a22f_0    conda-forge
sqlite                    3.38.4               h4ff8645_0    conda-forge
tk                        8.6.12               h27826a3_0    conda-forge
typing-extensions         4.2.0                hd8ed1ab_1    conda-forge
typing_extensions         4.2.0              pyha770c72_1    conda-forge
tzdata                    2022a                h191b570_0    conda-forge
wheel                     0.37.1             pyhd8ed1ab_0    conda-forge
wrapt                     1.14.1          py310h5764c6d_0    conda-forge
xz                        5.2.5                h516909a_1    conda-forge
yarl                      1.7.2           py310h5764c6d_2    conda-forge
zlib                      1.2.11            h166bdaf_1014    conda-forge

Environment info

active environment : s3fs
    active env location : /home/davidh/miniconda3/envs/s3fs
            shell level : 2
       user config file : /home/davidh/.condarc
 populated config files : /home/davidh/.condarc
          conda version : 4.12.0
    conda-build version : not installed
         python version : 3.7.3.final.0
       virtual packages : __cuda=11.4=0
                          __linux=5.16.19=0
                          __glibc=2.34=0
                          __unix=0=0
                          __archspec=1=x86_64
       base environment : /home/davidh/miniconda3  (writable)
      conda av data dir : /home/davidh/miniconda3/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/conda-forge/linux-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /home/davidh/miniconda3/pkgs
                          /home/davidh/.conda/pkgs
       envs directories : /home/davidh/miniconda3/envs
                          /home/davidh/.conda/envs
               platform : linux-64
             user-agent : conda/4.12.0 requests/2.27.1 CPython/3.7.3 Linux/5.16.19-76051619-generic pop/21.10 glibc/2.34
                UID:GID : 53807:1000
             netrc file : None
           offline mode : False

[warning] failed package validation and/or copy for commit 4e5be7e296f938e912907240d5f9a16509a69724

Hi @conda-forge/botocore! This is the friendly automated conda-forge-webservice!

It appears that one or more of your feedstock's outputs did not copy from the
staging channel (cf-staging) to the production channel (conda-forge). :(

This failure can happen for a lot of reasons, including an outdated feedstock
token. Below we have put some information about the failure to help you debug it.

Rerendering the feedstock will usually fix these problems.

If you have any issues or questions, you can find us on gitter in the
community chat room or you can bump us right here.

error messages:

invalid feedstock token