Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue building 2.3.3 and 2.3.4 with dill library #524

Open
erdos2n opened this issue Aug 31, 2022 · 0 comments
Open

Issue building 2.3.3 and 2.3.4 with dill library #524

erdos2n opened this issue Aug 31, 2022 · 0 comments
Labels
bug Something isn't working help wanted Extra attention is needed

Comments

@erdos2n
Copy link

erdos2n commented Aug 31, 2022

Some customers are having issues with their builds when running astro deploy and astro dev start. The error is.

Here is the ticket to these issues on Zendesk

WARNING: Requested dill>=0.2.2 from https://files.pythonhosted.org/packages/3e/ad/31932a4e2804897e6fd2f946d53df51dd9b4aa55e152b5404395d00354d1/dill-0.3.1.tar.gz#sha256=d3ddddf2806a7bc9858b20c02dc174396795545e9d62f243b34481fd26eb3e2c (from apache-airflow>=2.2.0->apache-airflow-providers-opsgenie==4.0.0->-r requirements.txt (line 3)), but installing version 0.3.1.dev0
WARNING: Discarding https://files.pythonhosted.org/packages/3e/ad/31932a4e2804897e6fd2f946d53df51dd9b4aa55e152b5404395d00354d1/dill-0.3.1.tar.gz#sha256=d3ddddf2806a7bc9858b20c02dc174396795545e9d62f243b34481fd26eb3e2c (from https://pypi.org/simple/dill/) (requires-python:>=2.6, !=3.0.*). Requested dill>=0.2.2 from https://files.pythonhosted.org/packages/3e/ad/31932a4e2804897e6fd2f946d53df51dd9b4aa55e152b5404395d00354d1/dill-0.3.1.tar.gz#sha256=d3ddddf2806a7bc9858b20c02dc174396795545e9d62f243b34481fd26eb3e2c (from apache-airflow>=2.2.0->apache-airflow-providers-opsgenie==4.0.0->-r requirements.txt (line 3)) has inconsistent version: filename has '0.3.1', but metadata has '0.3.1.dev0'

Another customer has said that it is stalling with this message

[#12](https://astronomer.zendesk.com/agent/tickets/12) 97.08 Collecting dill>=0.2.2
[#12](https://astronomer.zendesk.com/agent/tickets/12) 97.09   Downloading dill-0.3.5.1-py2.py3-none-any.whl (95 kB)
[#12](https://astronomer.zendesk.com/agent/tickets/12) 173.8 INFO: pip is looking at multiple versions of distro to determine which version is compatible with other requirements. This could take a while.
[#12](https://astronomer.zendesk.com/agent/tickets/12) 173.8   Downloading dill-0.3.5-py2.py3-none-any.whl (95 kB)
[#12](https://astronomer.zendesk.com/agent/tickets/12) 249.8   Downloading dill-0.3.4-py2.py3-none-any.whl (86 kB)
[#12](https://astronomer.zendesk.com/agent/tickets/12) 268.8 INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. If you want to abort this run, you can press Ctrl + C to do so. To improve how pip performs, tell us what happened here: https://pip.pypa.io/surveys/backtracking
[#12](https://astronomer.zendesk.com/agent/tickets/12) 325.8   Downloading dill-0.3.3-py2.py3-none-any.whl (81 kB)
[#12](https://astronomer.zendesk.com/agent/tickets/12) 400.2   Downloading dill-0.3.2.zip (177 kB)
[#12](https://astronomer.zendesk.com/agent/tickets/12) 474.7   Downloading dill-0.3.1.1.tar.gz (151 kB)
[#12](https://astronomer.zendesk.com/agent/tickets/12) 550.5   Downloading dill-0.3.1.tar.gz (151 kB)

Here are the respective requirements.txt files and Dockerfiles

First Customer

FROM quay.io/astronomer/ap-airflow:2.3.4-onbuild
# first error
--extra-index-url https://pip.astronomer.io/simple

apache-airflow-providers-opsgenie==4.0.0
apache-airflow-providers-snowflake==2.7.0
memory-profiler>=0.55.0
numpy>=1.17.4
pycurl>=7.43.0.2
jinja2==2.11.3
sqlalchemy==1.4.9
snowflake-sqlalchemy==1.2.4
packaging==21.0
pyyaml==5.4.1
colorlog==4.0.2
pyparsing==2.4.7
google-auth==1.34.0
types-python-dateutil==2.8.3
types-pytz==2021.3.3
types-PyYAML==6.0.1
types-croniter==1.0.3
types-requests==2.26.2
types-pycurl==7.44.6

Second Customer

FROM quay.io/astronomer/ap-airflow:2.3.4-onbuild
# stalling
apache-airflow-providers-hashicorp==3.1.0
apache-airflow-providers-sftp==4.0.0
apache-airflow-providers-microsoft-mssql==3.2.0
black==22.6.0
mandrill==1.0.60
python-gnupg==0.5.0
slackclient==2.9.4
user-agents==2.2.0
spectacles==2.2.0
dbt-core==1.2.1
dbt-snowflake==1.2.0
snowflake-connector-python[pandas]==2.7.12

One customer tested with Docker build and verified that worked, but could not get it working with astro deploy or astro dev start.

@erdos2n erdos2n added bug Something isn't working help wanted Extra attention is needed labels Aug 31, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant