pip install of boto3 is incompatible with botocore 2 (required by awscli 2)

[rngadam]

Is your feature request related to a problem? Please describe.

Would preferring installing from pip instead of the awscli package so we can insulate version change to a virtualenv

Our Python virtualenv both uses awscli and boto3, and both depend on botocore.

Describe the solution you'd like

Having a version of this:

pip install git+https://github.com/boto/botocore.git@eb474f3fc2c329c9799ebb2a56ceeee72f87d678#egg=botocore git+https://github.com/aws/[email protected]#egg=awscli boto3

that doesn't fail with this error:

ERROR: boto3 1.14.53 has requirement botocore<1.18.0,>=1.17.53, but you'll have botocore 2.0.0.dev49 which is incompatible.

Is boto3 deprecated? I find it strange that there's a botocore v2 but no other version of higher level abstraction boto3.

[rngadam]

If I do manage to get it installed, the lower level API does seem to be incompatible:

Traceback (most recent call last):
  File "/ota/deploy.py", line 12, in <module>
    s3_client = boto3.client('s3')
  File "/venv/lib/python3.8/site-packages/boto3/__init__.py", line 91, in client
    return _get_default_session().client(*args, **kwargs)
  File "/venv/lib/python3.8/site-packages/boto3/session.py", line 258, in client
    return self._session.create_client(
TypeError: create_client() got an unexpected keyword argument 'api_version'

[rngadam]

I guess the simplest way to resolve this is actually have a separate venv 1) for awscli v2 and 2) my code that depends on boto3.

[davideagen]

Having the same problem when using ansible with the aws_ec2 plugin on a system with botocore 2 installed for aws-cli 2.

[kdaily]

Hi @rngadam,

botocore v2 is for use with the AWS CLI v2, not for boto3. Using both boto3 and awscli in the same virtual environment is not recommended, as botocore and aws-cli are released in tandem, bot not boto3.

[kdaily]

@rngadam, I'm going to close this issue as there isn't anything that can currently be done for your issue. I am going to open a separate tracking issue to better document the Python SDK and tools dependencies and release scheduling as a recurring issue for users. Thanks again for your comments!

@davideagen - I'm not familiar with this plugin, can you open a new issue with more details if this does not help you? Thanks!

[github-actions]

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please either tag a team member or open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.

[rngadam]

@kdaily thanks Kenneth!

[kdaily]

Tracking issue: boto/botocore#2295