Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🎉 New source: Breezometer [low-code cdk] #18650

Merged

Conversation

sarafonseca-123
Copy link
Contributor

@sarafonseca-123 sarafonseca-123 commented Oct 29, 2022

What

A new source, Breezometer.

How

Using airbyte's low-code SDK.

Recommended reading order

  1. airbyte-integrations/connectors/source-breezometer/source_breezometer/breezometer.yaml
  2. airbyte-integrations/connectors/source-breezometer/source_breezometer/spec.yaml

Pre-merge Checklist

Expand the relevant checklist and delete the others.

New Connector

Community member or Airbyter

  • Community member? Grant edit access to maintainers (instructions)
  • Secrets in the connector's spec are annotated with airbyte_secret
  • Unit & integration tests added and passing. Community members, please provide proof of success locally e.g: screenshot or copy-paste unit, integration, and acceptance test output. To run acceptance tests for a Python connector, follow instructions in the README. For java connectors run ./gradlew :airbyte-integrations:connectors:<name>:integrationTest.
  • Code reviews completed
  • Documentation updated
    • Connector's README.md
    • Connector's bootstrap.md. See description and examples
    • docs/integrations/<source or destination>/<name>.md including changelog. See changelog example
    • docs/integrations/README.md
    • airbyte-integrations/builds.md
  • PR name follows PR naming conventions

Airbyter

If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.

  • Create a non-forked branch based on this PR and test the below items on it
  • Build is successful
  • If new credentials are required for use in CI, add them to GSM. Instructions.
  • /test connector=connectors/<name> command is passing
  • New Connector version released on Dockerhub by running the /publish command described here
  • After the connector is published, connector added to connector index as described here
  • Seed specs have been re-generated by building the platform and committing the changes to the seed spec files, as described here

Tests

Integration image
Acceptance

Building all of Airbyte.
/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors
Type-safe dependency accessors is an incubating feature.

Configure project :
configuring docker task for airbyte-bootloader
configuring docker task for airbyte-cli
configuring docker task for airbyte-container-orchestrator
configuring docker task for airbyte-cron
configuring docker task for airbyte-server
configuring docker task for airbyte-temporal
configuring docker task for airbyte-webapp
configuring docker task for airbyte-workers
configuring docker task for init
configuring docker task for db-lib
configuring docker task for reporter

Task :airbyte-integrations:bases:source-acceptance-test:checkPython
Using python 3.10.8 from /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test/.venv (.venv/bin/python)
Using pip 21.3.1 from /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test/.venv/lib/python3.10/site-packages/pip (python 3.10)

Task :airbyte-integrations:connectors:source-breezometer-pollen:checkPython
Using python 3.10.8 from /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-breezometer-pollen/.venv (.venv/bin/python)
Using pip 21.3.1 from /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-breezometer-pollen/.venv/lib/python3.10/site-packages/pip (python 3.10)

Task :airbyte-integrations:bases:base-normalization:checkPython
Using python 3.10.8 from /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/base-normalization/.venv (.venv/bin/python)
Using pip 21.3.1 from /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/base-normalization/.venv/lib/python3.10/site-packages/pip (python 3.10)

Task :airbyte-integrations:connectors:source-breezometer-pollen:pipInstall
[python] .venv/bin/python -m pip install pip==21.3.1
Requirement already satisfied: pip==21.3.1 in ./.venv/lib/python3.10/site-packages (21.3.1)
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-breezometer-pollen/.venv/bin/python -m pip install --upgrade pip' command.
[python] .venv/bin/python -m pip list --format=columns
Package Version Editable project location
------------------------- --------- -----------------------------------------------------------------------------------------
airbyte-cdk 0.1.104
attrs 22.1.0
backoff 2.2.1
black 22.3.0
certifi 2022.9.24
charset-normalizer 2.1.1
click 8.1.3
coverage 6.3.1
dataclasses-jsonschema 2.15.1
deepdiff 5.8.1
Deprecated 1.2.13
docker 5.0.3
dpath 2.0.6
exceptiongroup 1.0.0
fancycompleter 0.9.1
flake8 4.0.1
hypothesis 6.54.6
hypothesis-jsonschema 0.20.1
icdiff 1.9.1
idna 3.4
inflection 0.5.1
iniconfig 1.1.1
isort 5.6.4
Jinja2 3.1.2
jsonref 0.2
jsonschema 3.2.0
MarkupSafe 2.1.1
mccabe 0.6.1
multidict 6.0.2
mypy 0.930
mypy-extensions 0.4.3
ordered-set 4.1.0
packaging 21.3
pathspec 0.10.1
pdbpp 0.10.3
pendulum 2.1.2
pip 21.3.1
platformdirs 2.5.2
pluggy 0.13.1
pprintpp 0.4.0
py 1.11.0
pycodestyle 2.8.0
pydantic 1.9.2
pyflakes 2.4.0
Pygments 2.13.0
pyparsing 3.0.9
pyproject-flake8 0.0.1a2
pyrepl 0.9.0
pyrsistent 0.18.1
pytest 6.1.2
pytest-cov 3.0.0
pytest-mock 3.6.1
pytest-sugar 0.9.5
pytest-timeout 1.4.2
python-dateutil 2.8.2
pytzdata 2020.1
PyYAML 5.4.1
requests 2.28.1
requests-mock 1.9.3
setuptools 65.4.1
six 1.16.0
sortedcontainers 2.4.0
source-acceptance-test 0.0.0 /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test
source-breezometer-pollen 0.0.0
termcolor 2.0.1
toml 0.10.2
tomli 2.0.1
typing_extensions 4.4.0
urllib3 1.26.12
vcrpy 4.2.1
websocket-client 1.4.1
wmctrl 0.4
wrapt 1.14.1
yarl 1.8.1
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-breezometer-pollen/.venv/bin/python -m pip install --upgrade pip' command.

Task :airbyte-integrations:bases:source-acceptance-test:pipInstall
[python] .venv/bin/python -m pip install pip==21.3.1
Requirement already satisfied: pip==21.3.1 in ./.venv/lib/python3.10/site-packages (21.3.1)
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test/.venv/bin/python -m pip install --upgrade pip' command.
[python] .venv/bin/python -m pip list --format=columns
Package Version Editable project location
--------------------------- --------- ---------------------------------------------------------------------------------------------------
airbyte-cdk 0.1.104
appdirs 1.4.4
attrs 22.1.0
backoff 2.2.1
black 22.3.0
cattrs 22.2.0
certifi 2022.9.24
charset-normalizer 2.1.1
click 8.1.3
coverage 6.3.1
dataclasses-jsonschema 2.15.1
deepdiff 5.8.1
Deprecated 1.2.13
docker 5.0.3
dpath 2.0.6
exceptiongroup 1.0.0rc9
fancycompleter 0.9.1
flake8 4.0.1
hypothesis 6.54.6
hypothesis-jsonschema 0.20.1
icdiff 1.9.1
idna 3.4
inflection 0.5.1
iniconfig 1.1.1
isort 5.6.4
Jinja2 3.1.2
jsonref 0.2
jsonschema 3.2.0
MarkupSafe 2.1.1
mccabe 0.6.1
multidict 6.0.2
mypy 0.930
mypy-extensions 0.4.3
ordered-set 4.1.0
packaging 21.3
pathspec 0.10.1
pdbpp 0.10.3
pendulum 2.1.2
pip 21.3.1
platformdirs 2.5.2
pluggy 0.13.1
pprintpp 0.4.0
py 1.11.0
pycodestyle 2.8.0
pydantic 1.9.2
pyflakes 2.4.0
Pygments 2.13.0
pyparsing 3.0.9
pyproject-flake8 0.0.1a2
pyrepl 0.9.0
pyrsistent 0.18.1
pytest 6.1.2
pytest-cov 3.0.0
pytest-mock 3.6.1
pytest-sugar 0.9.5
pytest-timeout 1.4.2
python-dateutil 2.8.2
pytzdata 2020.1
PyYAML 5.4.1
requests 2.28.1
requests-cache 0.9.6
requests-mock 1.9.3
responses 0.13.4
setuptools 63.4.3
six 1.16.0
sortedcontainers 2.4.0
source-acceptance-test 0.0.0
source-rd-station 0.0.0
source-rd-station-marketing 0.0.0 /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing
termcolor 2.0.1
toml 0.10.2
tomli 2.0.1
typing_extensions 4.4.0
url-normalize 1.4.3
urllib3 1.26.12
vcrpy 4.2.1
websocket-client 1.4.1
wmctrl 0.4
wrapt 1.14.1
yarl 1.8.1
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test/.venv/bin/python -m pip install --upgrade pip' command.

Task :airbyte-integrations:bases:base-normalization:pipInstall
[python] .venv/bin/python -m pip install pip==21.3.1
Requirement already satisfied: pip==21.3.1 in ./.venv/lib/python3.10/site-packages (21.3.1)
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/base-normalization/.venv/bin/python -m pip install --upgrade pip' command.
[python] .venv/bin/python -m pip list --format=columns
Package Version Editable project location
--------------------------- --------- ---------------------------------------------------------------------------------------------------
airbyte-cdk 0.2.3
appdirs 1.4.4
attrs 22.1.0
backoff 2.2.1
black 22.3.0
cattrs 22.2.0
certifi 2022.9.24
charset-normalizer 2.1.1
click 8.1.3
coverage 6.3.1
dataclasses-jsonschema 2.15.1
deepdiff 5.8.1
Deprecated 1.2.13
docker 5.0.3
dpath 2.0.6
exceptiongroup 1.0.0rc9
fancycompleter 0.9.1
flake8 4.0.1
hypothesis 6.54.6
hypothesis-jsonschema 0.20.1
icdiff 1.9.1
idna 3.4
inflection 0.5.1
iniconfig 1.1.1
isort 5.6.4
Jinja2 3.1.2
jsonref 0.2
jsonschema 3.2.0
MarkupSafe 2.1.1
mccabe 0.6.1
multidict 6.0.2
mypy 0.930
mypy-extensions 0.4.3
normalization 0.0.0
ordered-set 4.1.0
packaging 21.3
pathspec 0.10.1
pdbpp 0.10.3
pendulum 2.1.2
pip 21.3.1
platformdirs 2.5.2
pluggy 0.13.1
pprintpp 0.4.0
py 1.11.0
pycodestyle 2.8.0
pydantic 1.9.2
pyflakes 2.4.0
Pygments 2.13.0
pyparsing 3.0.9
pyproject-flake8 0.0.1a2
pyrepl 0.9.0
pyrsistent 0.18.1
pytest 6.1.2
pytest-cov 3.0.0
pytest-mock 3.6.1
pytest-sugar 0.9.5
pytest-timeout 1.4.2
python-dateutil 2.8.2
pytzdata 2020.1
PyYAML 5.4.1
requests 2.28.1
requests-cache 0.9.6
requests-mock 1.9.3
responses 0.13.4
setuptools 63.4.3
six 1.16.0
sortedcontainers 2.4.0
source-acceptance-test 0.0.0 /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test
source-rd-station 0.0.0
source-rd-station-marketing 0.0.0 /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-rd-station-marketing
termcolor 2.0.1
toml 0.10.2
tomli 2.0.1
types-PyYAML 6.0.12.1
typing_extensions 4.4.0
url-normalize 1.4.3
urllib3 1.26.12
vcrpy 4.2.1
websocket-client 1.4.1
wmctrl 0.4
wrapt 1.14.1
yarl 1.8.1
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/base-normalization/.venv/bin/python -m pip install --upgrade pip' command.

Task :airbyte-integrations:connectors:source-breezometer-pollen:isortFormat
[python] .venv/bin/python -m isort --settings-file=/Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./
Skipped 7 files

Task :airbyte-integrations:connectors:source-breezometer-pollen:blackFormat
[python] .venv/bin/python -m black --config /Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./
All done! ✨ 🍰 ✨
7 files left unchanged.

Task :airbyte-integrations:connectors:source-breezometer-pollen:flakeCheck
[python] .venv/bin/python -m pflake8 --config /Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./

Task :airbyte-integrations:bases:source-acceptance-test:isortFormat
[python] .venv/bin/python -m isort --settings-file=/Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./
Skipped 6 files

Task :airbyte-integrations:bases:source-acceptance-test:blackFormat
[python] .venv/bin/python -m black --config /Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./
All done! ✨ 🍰 ✨
28 files left unchanged.

Task :airbyte-integrations:bases:base-normalization:isortFormat
[python] .venv/bin/python -m isort --settings-file=/Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./

Task :airbyte-integrations:bases:source-acceptance-test:flakeCheck
[python] .venv/bin/python -m pflake8 --config /Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./

Task :airbyte-integrations:bases:source-acceptance-test:installLocalReqs
[python] .venv/bin/python -m pip install .[dev,tests]
Processing /Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
WARNING: source-acceptance-test 0.0.0 does not provide the extra 'dev'
WARNING: source-acceptance-test 0.0.0 does not provide the extra 'tests'
Requirement already satisfied: airbyte-cdk~=0.1.56 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.1.104)
Requirement already satisfied: docker~=5.0.3 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (5.0.3)
Requirement already satisfied: PyYAML~=5.4 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (5.4.1)
Requirement already satisfied: icdiff~=1.9 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (1.9.1)
Requirement already satisfied: inflection~=0.5 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.5.1)
Requirement already satisfied: pdbpp~=0.10 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.10.3)
Requirement already satisfied: pydantic~=1.6 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (1.9.2)
Requirement already satisfied: pytest~=6.1 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (6.1.2)
Requirement already satisfied: pytest-sugar~=0.9 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.9.5)
Requirement already satisfied: pytest-timeout~=1.4 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (1.4.2)
Requirement already satisfied: pprintpp~=0.4 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.4.0)
Requirement already satisfied: dpath~=2.0.1 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (2.0.6)
Requirement already satisfied: jsonschema~=3.2.0 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (3.2.0)
Requirement already satisfied: jsonref==0.2 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.2)
Requirement already satisfied: deepdiff~=5.8.0 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (5.8.1)
Requirement already satisfied: requests-mock~=1.9.3 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (1.9.3)
Requirement already satisfied: pytest-mock~=3.6.1 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (3.6.1)
Requirement already satisfied: pytest-cov~=3.0.0 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (3.0.0)
Requirement already satisfied: hypothesis~=6.54.1 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (6.54.6)
Requirement already satisfied: hypothesis-jsonschema~=0.20.1 in ./.venv/lib/python3.10/site-packages (from source-acceptance-test==0.0.0) (0.20.1)
Requirement already satisfied: requests in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (2.28.1)
Requirement already satisfied: pendulum in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (2.1.2)
Requirement already satisfied: Jinja2~=3.1.2 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (3.1.2)
Requirement already satisfied: vcrpy in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (4.2.1)
Requirement already satisfied: Deprecated~=1.2 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (1.2.13)
Requirement already satisfied: backoff in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (2.2.1)
Requirement already satisfied: dataclasses-jsonschema==2.15.1 in ./.venv/lib/python3.10/site-packages (from airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (2.15.1)
Requirement already satisfied: python-dateutil in ./.venv/lib/python3.10/site-packages (from dataclasses-jsonschema==2.15.1->airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (2.8.2)
Requirement already satisfied: ordered-set<4.2.0,>=4.1.0 in ./.venv/lib/python3.10/site-packages (from deepdiff~=5.8.0->source-acceptance-test==0.0.0) (4.1.0)
Requirement already satisfied: websocket-client>=0.32.0 in ./.venv/lib/python3.10/site-packages (from docker~=5.0.3->source-acceptance-test==0.0.0) (1.4.1)
Requirement already satisfied: attrs>=19.2.0 in ./.venv/lib/python3.10/site-packages (from hypothesis~=6.54.1->source-acceptance-test==0.0.0) (22.1.0)
Requirement already satisfied: exceptiongroup>=1.0.0rc8 in ./.venv/lib/python3.10/site-packages (from hypothesis~=6.54.1->source-acceptance-test==0.0.0) (1.0.0rc9)
Requirement already satisfied: sortedcontainers<3.0.0,>=2.1.0 in ./.venv/lib/python3.10/site-packages (from hypothesis~=6.54.1->source-acceptance-test==0.0.0) (2.4.0)
Requirement already satisfied: six>=1.11.0 in ./.venv/lib/python3.10/site-packages (from jsonschema~=3.2.0->source-acceptance-test==0.0.0) (1.16.0)
Requirement already satisfied: setuptools in ./.venv/lib/python3.10/site-packages (from jsonschema~=3.2.0->source-acceptance-test==0.0.0) (63.4.3)
Requirement already satisfied: pyrsistent>=0.14.0 in ./.venv/lib/python3.10/site-packages (from jsonschema~=3.2.0->source-acceptance-test==0.0.0) (0.18.1)
Requirement already satisfied: wmctrl in ./.venv/lib/python3.10/site-packages (from pdbpp~=0.10->source-acceptance-test==0.0.0) (0.4)
Requirement already satisfied: pygments in ./.venv/lib/python3.10/site-packages (from pdbpp~=0.10->source-acceptance-test==0.0.0) (2.13.0)
Requirement already satisfied: fancycompleter>=0.8 in ./.venv/lib/python3.10/site-packages (from pdbpp~=0.10->source-acceptance-test==0.0.0) (0.9.1)
Requirement already satisfied: typing-extensions>=3.7.4.3 in ./.venv/lib/python3.10/site-packages (from pydantic~=1.6->source-acceptance-test==0.0.0) (4.4.0)
Requirement already satisfied: packaging in ./.venv/lib/python3.10/site-packages (from pytest~=6.1->source-acceptance-test==0.0.0) (21.3)
Requirement already satisfied: py>=1.8.2 in ./.venv/lib/python3.10/site-packages (from pytest~=6.1->source-acceptance-test==0.0.0) (1.11.0)
Requirement already satisfied: toml in ./.venv/lib/python3.10/site-packages (from pytest~=6.1->source-acceptance-test==0.0.0) (0.10.2)
Requirement already satisfied: pluggy<1.0,>=0.12 in ./.venv/lib/python3.10/site-packages (from pytest~=6.1->source-acceptance-test==0.0.0) (0.13.1)
Requirement already satisfied: iniconfig in ./.venv/lib/python3.10/site-packages (from pytest~=6.1->source-acceptance-test==0.0.0) (1.1.1)
Requirement already satisfied: coverage[toml]>=5.2.1 in ./.venv/lib/python3.10/site-packages (from pytest-cov~=3.0.0->source-acceptance-test==0.0.0) (6.3.1)
Requirement already satisfied: termcolor>=1.1.0 in ./.venv/lib/python3.10/site-packages (from pytest-sugar~=0.9->source-acceptance-test==0.0.0) (2.0.1)
Requirement already satisfied: tomli in ./.venv/lib/python3.10/site-packages (from coverage[toml]>=5.2.1->pytest-cov~=3.0.0->source-acceptance-test==0.0.0) (2.0.1)
Requirement already satisfied: wrapt<2,>=1.10 in ./.venv/lib/python3.10/site-packages (from Deprecated~=1.2->airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (1.14.1)
Requirement already satisfied: pyrepl>=0.8.2 in ./.venv/lib/python3.10/site-packages (from fancycompleter>=0.8->pdbpp~=0.10->source-acceptance-test==0.0.0) (0.9.0)
Requirement already satisfied: MarkupSafe>=2.0 in ./.venv/lib/python3.10/site-packages (from Jinja2~=3.1.2->airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (2.1.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in ./.venv/lib/python3.10/site-packages (from packaging->pytest~=6.1->source-acceptance-test==0.0.0) (3.0.9)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (1.26.12)
Requirement already satisfied: charset-normalizer<3,>=2 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (2.1.1)
Requirement already satisfied: certifi>=2017.4.17 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (2022.9.24)
Requirement already satisfied: idna<4,>=2.5 in ./.venv/lib/python3.10/site-packages (from requests->airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (3.4)
Requirement already satisfied: pytzdata>=2020.1 in ./.venv/lib/python3.10/site-packages (from pendulum->airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (2020.1)
Requirement already satisfied: yarl in ./.venv/lib/python3.10/site-packages (from vcrpy->airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (1.8.1)
Requirement already satisfied: multidict>=4.0 in ./.venv/lib/python3.10/site-packages (from yarl->vcrpy->airbyte-cdk~=0.1.56->source-acceptance-test==0.0.0) (6.0.2)
Using legacy 'setup.py install' for source-acceptance-test, since package 'wheel' is not installed.
Installing collected packages: source-acceptance-test
Attempting uninstall: source-acceptance-test
Found existing installation: source-acceptance-test 0.0.0
Uninstalling source-acceptance-test-0.0.0:
Successfully uninstalled source-acceptance-test-0.0.0
Running setup.py install for source-acceptance-test: started
Running setup.py install for source-acceptance-test: finished with status 'done'
Successfully installed source-acceptance-test-0.0.0
WARNING: You are using pip version 21.3.1; however, version 22.3 is available.
You should consider upgrading via the '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/bases/source-acceptance-test/.venv/bin/python -m pip install --upgrade pip' command.

Task :airbyte-integrations:bases:base-normalization:isortFormat
Skipped 4 files

Task :airbyte-integrations:bases:base-normalization:blackFormat
[python] .venv/bin/python -m black --config /Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./
All done! ✨ 🍰 ✨
24 files left unchanged.

Task :airbyte-integrations:bases:base-normalization:flakeCheck
[python] .venv/bin/python -m pflake8 --config /Users/sarasantos/git-jusbrasil/airbyte/pyproject.toml ./

Task :airbyte-integrations:connectors:source-breezometer-pollen:airbyteDocker
Execution optimizations have been disabled for task ':airbyte-integrations:connectors:source-breezometer-pollen:airbyteDocker' to ensure correctness due to the following reasons:

  • Gradle detected a problem with the following location: '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-breezometer-pollen'. Reason: Task ':airbyte-integrations:connectors:source-breezometer-pollen:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:source-breezometer-pollen:compileTestJava' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  • Gradle detected a problem with the following location: '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-breezometer-pollen'. Reason: Task ':airbyte-integrations:connectors:source-breezometer-pollen:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:source-breezometer-pollen:pmdMain' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  • Gradle detected a problem with the following location: '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-breezometer-pollen'. Reason: Task ':airbyte-integrations:connectors:source-breezometer-pollen:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:source-breezometer-pollen:pmdTest' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  • Gradle detected a problem with the following location: '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-breezometer-pollen'. Reason: Task ':airbyte-integrations:connectors:source-breezometer-pollen:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:source-breezometer-pollen:processTestResources' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  • Gradle detected a problem with the following location: '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-breezometer-pollen'. Reason: Task ':airbyte-integrations:connectors:source-breezometer-pollen:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:source-breezometer-pollen:spotbugsMain' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  • Gradle detected a problem with the following location: '/Users/sarasantos/git-jusbrasil/airbyte/airbyte-integrations/connectors/source-breezometer-pollen'. Reason: Task ':airbyte-integrations:connectors:source-breezometer-pollen:airbyteDocker' uses this output of task ':airbyte-integrations:connectors:source-breezometer-pollen:spotbugsTest' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
    checkin catalogs #1 [internal] load build definition from Dockerfile
    checkin catalogs #1 sha256:756811b706f0278ff33ec9688789988d7277b7fc23e915ad42bc9cc62dd24eab
    checkin catalogs #1 transferring dockerfile: 92B done
    checkin catalogs #1 DONE 0.0s

#2 [internal] load .dockerignore
#2 sha256:1b26137ecadda6394ef5d17188b089a7e77486ea15ce182e0de8448fa0abe774
#2 transferring context: 34B done
#2 DONE 0.0s

#3 [internal] load metadata for docker.io/library/python:3.9.11-alpine3.15
#3 sha256:615609793cad3a170d91fb8a37323caa348ca31e0a749e824da4c8c1d8da2aa4
#3 DONE 0.9s

#4 [base 1/1] FROM docker.io/library/python:3.9.11-alpine3.15@sha256:45ddd216e6b4efee0617e15d541e9148ffd6898203fcbe86a9f5bf906ce7837f
#4 sha256:4c436ac5d39299d948ef79080102d272b18d64395fbed9cc821104f1e2bd7d93
#4 DONE 0.0s

#7 [internal] load build context
#7 sha256:1390dcea4f76ae534fb78db4714384dc58421d53714c56a5c8638dfc75239979
#7 transferring context: 1.17kB done
#7 DONE 0.0s

#13 [stage-2 5/7] RUN apk --no-cache add bash
#13 sha256:3c00a3e0618cea688f6d63ed976ea082a3ec87eee72f23af6b791a4e7afad615
#13 CACHED

#10 [stage-2 2/7] COPY --from=builder /install /usr/local
#10 sha256:1bb9985ea05c258a836f12fdcf5b288899093ce51fd67e72a1f7a3ebc8ab0daf
#10 CACHED

#5 [builder 1/4] WORKDIR /airbyte/integration_code
#5 sha256:736c564b6c0d634b064a8145fffebbf56c57a10eea338e59977586dee56a7251
#5 CACHED

#8 [builder 3/4] COPY setup.py ./
#8 sha256:d4a2db75281aa991eb9efc73ce96391d7f1f934cd1aa7f5cfaadeb9157728833
#8 CACHED

#12 [stage-2 4/7] RUN echo "Etc/UTC" > /etc/timezone
#12 sha256:5f15ba230b676f634108ef56cafa737375ae26ce7330712663b1dd78243ffb6d
#12 CACHED

#14 [stage-2 6/7] COPY main.py ./
#14 sha256:54825553f4dccb4ac9fa13dcefb6463727dcb0f8e75574ace5f48a20aaf5b4a0
#14 CACHED

#9 [builder 4/4] RUN pip install --prefix=/install .
#9 sha256:9710e742a1f666627da43f025536405c524ac01ff518a5cf01aefe2937f43b67
#9 CACHED

#6 [builder 2/4] RUN apk --no-cache upgrade && pip install --upgrade pip && apk --no-cache add tzdata build-base
#6 sha256:fddd1028d4c855a19a9d12c308b03a65954965cf7ce3303f4d640a7d59aba08d
#6 CACHED

#11 [stage-2 3/7] COPY --from=builder /usr/share/zoneinfo/Etc/UTC /etc/localtime
#11 sha256:54cdf7ce25ee3daeb3bcfe1f949f8553785aae03ac8550f7cd57d0b9fee31f9f
#11 CACHED

#15 [stage-2 7/7] COPY source_breezometer_pollen ./source_breezometer_pollen
#15 sha256:0f621752ca5cca7dff5e34efc792fdc2e34e919b0d07184c35d6069ce1d363d5
#15 CACHED

#16 exporting to image
#16 sha256:e8c613e07b0b7ff33893b694f7759a10d42e180f2b4dc349fb57dc6b71dcab00
#16 exporting layers done
#16 writing image sha256:69290d6a3e7c1a37d5535a25de41256796e86226a9ca28908f1c956521c99936 done
#16 naming to docker.io/airbyte/source-breezometer-pollen:dev done
#16 DONE 0.0s

Use 'docker scan' to run Snyk tests against images to find vulnerabilities and learn how to fix them

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD SUCCESSFUL in 25s
40 actionable tasks: 17 executed, 23 up-to-date

@sarafonseca-123
Copy link
Contributor Author

I have a test account that I can share via Slack!

@marcosmarxm
Copy link
Member

Hello @sarafonseca-123 , Marcos from Airbyte here 👋 . We received more than 25 new contributions along the weekend. One is yours 🎉 thank so much for! Our team is limited and maybe the review process can take longer than expected. As described in the Airbyte's Hacktoberfest your contribution was submitted before November 2nd and it is eligible to win the prize. The review process will validate other requirements. I ask to you patience until someone from the team review it.

Because I reviewed some contributions for Hacktoberfest so far I saw some common patterns you can check in advance:

  • Make sure you have added connector documentation to /docs/integrations/
  • Remove the file catalog from /integration_tests
  • Edit the sample_config.json inside /integration_tests
  • For the configured_catalog you can use only json_schema: {}
  • Add title to all properties in the spec.yaml
  • Make sure the documentationUrl in the spec.yaml redirect to Airbyte's future connector page, eg: connector Airtable the documentationUrl: https://docs.airbyte.com/integrations/sources/airtable
  • Review now new line at EOF (end-of-file) for all files.

If possible send to me a DM in Slack with the tests credentials, this process will make easier to us run integration tests and publish your connector. If you only has production keys, make sure to create a bootstrap.md explaining how to get the keys.

@marcosmarxm marcosmarxm changed the title 🎉 New source: Breezometer Pollen [low-code SDK] 🎉 New source: Breezometer Pollen [low-code cdk] Oct 31, 2022
Copy link
Member

@marcosmarxm marcosmarxm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sarafonseca-123 are you plannign to add other endpoints like air quality, wildfire and weather?

@sarafonseca-123
Copy link
Contributor Author

@marcosmarxm yes, I'm gonna do this tonight! until then I will change this PR to draft

@sarafonseca-123 sarafonseca-123 marked this pull request as draft October 31, 2022 20:51
@sarafonseca-123 sarafonseca-123 changed the title 🎉 New source: Breezometer Pollen [low-code cdk] 🎉 New source: Breezometer [low-code cdk] Nov 2, 2022
@sarafonseca-123 sarafonseca-123 marked this pull request as ready for review November 2, 2022 18:11
@marcosmarxm
Copy link
Member

Hello! I'm going to be out of the office this Friday and won't be able to review your contribution again today, I return next Monday. So far, most contributions look solid and are almost done to be approved. As said in Chris' comment all contributions made before 2-November are eligible to receive the prize and have 2 weeks to merge the contributions. But I ensure next week we're going to have your contribution merged. If you have questions about the implementation you can send them in #hacktoberfest-2022 in Airbyte's Slack.

Sorry the inconvenience and see you again next week, thank you so much for your contribution!

@marcosmarxm
Copy link
Member

marcosmarxm commented Nov 8, 2022

/test connector=connectors/source-breezometer

🕑 connectors/source-breezometer https://github.com/airbytehq/airbyte/actions/runs/3415407766
✅ connectors/source-breezometer https://github.com/airbytehq/airbyte/actions/runs/3415407766
Python tests coverage:

	 Name                                                 Stmts   Miss  Cover   Missing
	 ----------------------------------------------------------------------------------
	 source_acceptance_test/base.py                          12      4    67%   16-19
	 source_acceptance_test/config.py                       133      3    98%   87, 93, 230
	 source_acceptance_test/conftest.py                     196     92    53%   35, 41-43, 48, 54, 60, 66, 72-74, 93, 98-100, 106-108, 114-115, 120-121, 126, 132, 141-150, 156-161, 176, 200, 231, 237, 243-248, 256-261, 269-282, 287-293, 300-311, 318-334
	 source_acceptance_test/plugin.py                        69     25    64%   22-23, 31, 36, 120-140, 144-148
	 source_acceptance_test/tests/test_core.py              345    110    68%   53, 64-72, 77-84, 88-89, 93-94, 178, 216-233, 242-250, 254-259, 265, 298-303, 341-348, 391-393, 396, 461-469, 481-484, 489, 545-546, 552, 555, 591-601, 614-639
	 source_acceptance_test/tests/test_incremental.py       145     20    86%   21-23, 29-31, 36-43, 48-61, 224
	 source_acceptance_test/utils/asserts.py                 37      2    95%   57-58
	 source_acceptance_test/utils/common.py                  94     10    89%   16-17, 32-38, 72, 75
	 source_acceptance_test/utils/compare.py                 62     23    63%   21-51, 68, 97-99
	 source_acceptance_test/utils/config_migration.py        23     23     0%   5-37
	 source_acceptance_test/utils/connector_runner.py       112     50    55%   23-26, 32, 36, 39-68, 71-73, 76-78, 81-83, 86-88, 91-93, 96-114, 148-150
	 source_acceptance_test/utils/json_schema_helper.py     105     13    88%   30-31, 38, 41, 65-68, 96, 120, 190-192
	 ----------------------------------------------------------------------------------
	 TOTAL                                                 1512    375    75%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/plugin.py:63: Skipping TestIncremental.test_two_sequential_reads: not found in the config.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/tests/test_core.py:65: The previous connector image could not be retrieved.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/source_acceptance_test/tests/test_core.py:243: The previous connector image could not be retrieved.
================= 24 passed, 3 skipped, 27 warnings in 50.50s ==================

@marcosmarxm
Copy link
Member

marcosmarxm commented Nov 8, 2022

/publish connector=connectors/source-breezometer

🕑 Publishing the following connectors:
connectors/source-breezometer
https://github.com/airbytehq/airbyte/actions/runs/3415494212


Connector Did it publish? Were definitions generated?
connectors/source-breezometer

if you have connectors that successfully published but failed definition generation, follow step 4 here ▶️

Copy link
Member

@marcosmarxm marcosmarxm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the contribution @sarafonseca-123

@marcosmarxm marcosmarxm merged commit 665474f into airbytehq:master Nov 8, 2022
letiescanciano added a commit that referenced this pull request Nov 8, 2022
…nent

* master:
  🪟 🎉 Enable frontend validation for <1hr syncs (cloud) #19028
  Stream returns AirbyteMessages (#18572)
  🎉 New Source - Recruitee [low-code SDK] (#18671)
  🎉 New source: Breezometer [low-code cdk] (#18650)
  Check disabled connections after protocol update (#18990)
  Simple default replication worker refactor (#19002)
  🎉 New Source: Visma e-conomic (#18595)
  🎉 New Source: Fastbill (#18593)
  Bmoric/extract state api (#18980)
  🎉 New Source: Zapier Supported Storage (#18442)
  🎉 New source: Klarna (#18385)
  `AirbyteEstimateTraceMessage` (#18875)
  Extract source definition api (#18977)
  [low-code cdk] Allow for spec file to be defined in the yaml manifest instead of an external file (#18411)
  🐛 Source HubSpot: fix property scopes (#18624)
  Ensure that only 6-character hex values are passed to monaco editor (#18943)
@sarafonseca-123 sarafonseca-123 deleted the source-breezometer-pollen branch November 8, 2022 15:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Development

Successfully merging this pull request may close these issues.

6 participants