Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Github Connector: Syncs are consuming the whole API quota #5669

Closed
jgtvares opened this issue Aug 26, 2021 · 10 comments · Fixed by #5788
Closed

Github Connector: Syncs are consuming the whole API quota #5669

jgtvares opened this issue Aug 26, 2021 · 10 comments · Fixed by #5788
Assignees
@yevhenii-ldv
Labels
area/connectors Connector related issues connectors/source/github connectors/sources-api lang/python type/bug Something isn't working
Milestone
Connectors, Septe...

Comments

@jgtvares
Copy link

Enviroment

  • Airbyte version: 0.28.0-alpha
  • OS Version / Instance: AWS EC2
  • Deployment: Docker
  • Source Connector and version: Github 0.1.6
  • Destination Connector and version: Postgres 0.3.9
  • Severity: High
  • Step where error happened: Sync job

Current Behavior

I'm trying to sync all the repos in our organization (about 500 repos) using only commits and pull_requests streams. But the problem is that syncs are failing in all three attempts and I realized that Airbyte is using all the API quota (which for us is 5000).

Expected Behavior

Syncs shouldn't use the whole quota. Maybe you could add a field for us to input a quota use percentage by sync.
A curious thing is that this wasn't happening in version 0.1.4. I rolledback to that version and syncs are okay!

Logs

If applicable, please upload the logs from the failing operation.
For sync jobs, you can download the full logs from the UI by going to the sync attempt page and
clicking the download logs button at the top right of the logs display window.

First attempt LOG 

2021-08-18 13:47:49 INFO () WorkerRun(call):62 - Executing worker wrapper. Airbyte version: 0.28.2-alpha
2021-08-18 13:47:49 INFO () TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.28.2-alpha
2021-08-18 13:47:49 INFO () DefaultReplicationWorker(run):102 - start sync worker. job id: 696 attempt id: 0
2021-08-18 13:47:49 INFO () DefaultReplicationWorker(run):111 - configured sync modes: {null.pull_requests=full_refresh - append, null.commits=full_refresh - append, null.projects=full_refresh - append}
2021-08-18 13:47:49 INFO () DefaultAirbyteDestination(start):78 - Running destination...
2021-08-18 13:47:49 INFO () LineGobbler(voidCall):85 - Checking if airbyte/destination-postgres:0.3.9 exists...
2021-08-18 13:47:49 INFO () EnvConfigs(getEnvOrDefault):302 - WORKER_ENVIRONMENT not found or empty, defaulting to DOCKER
2021-08-18 13:47:49 INFO () LineGobbler(voidCall):85 - airbyte/destination-postgres:0.3.9 was found locally.
2021-08-18 13:47:49 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/696/0 --network host --log-driver none airbyte/destination-postgres:0.3.9 write --config destination_config.json --catalog destination_catalog.json
2021-08-18 13:47:49 INFO () EnvConfigs(getEnvOrDefault):302 - WORKER_ENVIRONMENT not found or empty, defaulting to DOCKER
2021-08-18 13:47:49 INFO () LineGobbler(voidCall):85 - Checking if airbyte/source-github:0.1.5 exists...
2021-08-18 13:47:49 INFO () LineGobbler(voidCall):85 - airbyte/source-github:0.1.5 was found locally.
2021-08-18 13:47:49 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/696/0 --network host --log-driver none airbyte/source-github:0.1.5 read --config source_config.json --catalog source_catalog.json
2021-08-18 13:47:49 INFO () DefaultReplicationWorker(run):139 - Waiting for source thread to join.
2021-08-18 13:47:49 INFO () DefaultReplicationWorker(lambda$getDestinationOutputRunnable$3):246 - Destination output thread started.
2021-08-18 13:47:49 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):210 - Replication thread started.
2021-08-18 13:47:50 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:50 �[32mINFO�[m i.a.i.d.p.PostgresDestination(main):83 - {} - starting destination: class io.airbyte.integrations.destination.postgres.PostgresDestination
2021-08-18 13:47:50 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:50 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):96 - {} - Running integration: io.airbyte.integrations.destination.postgres.PostgresDestination
2021-08-18 13:47:50 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:50 �[32mINFO�[m i.a.i.b.IntegrationCliParser(parseOptions):135 - {} - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2021-08-18 13:47:50 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:50 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):100 - {} - Command: WRITE
2021-08-18 13:47:50 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:50 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):101 - {} - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2021-08-18 13:47:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:51 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 13:47:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:51 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 13:47:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:51 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 13:47:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:51 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=git-testcommits, namespace=null, outputSchemaName=github, tmpTableName=_airbyte_tmp_tnb_git_testcommits, outputTableName=_airbyte_raw_git_testcommits, syncMode=append}
2021-08-18 13:47:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:51 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=git-testprojects, namespace=null, outputSchemaName=github, tmpTableName=_airbyte_tmp_xgo_git_testprojects, outputTableName=_airbyte_raw_git_testprojects, syncMode=append}
2021-08-18 13:47:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:51 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=git-testpull_requests, namespace=null, outputSchemaName=github, tmpTableName=_airbyte_tmp_tag_git_testpull_requests, outputTableName=_airbyte_raw_git_testpull_requests, syncMode=append}
2021-08-18 13:47:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:51 �[32mINFO�[m i.a.i.d.b.BufferedStreamConsumer(startTracked):142 - {} - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2021-08-18 13:47:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:51 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):139 - {} - Preparing tmp tables in destination started for 3 streams
2021-08-18 13:47:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:51 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream git-testcommits. schema: github, tmp table name: _airbyte_tmp_tnb_git_testcommits
2021-08-18 13:47:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:51 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream git-testprojects. schema: github, tmp table name: _airbyte_tmp_xgo_git_testprojects
2021-08-18 13:47:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:51 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream git-testpull_requests. schema: github, tmp table name: _airbyte_tmp_tag_git_testpull_requests
2021-08-18 13:47:51 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:47:51 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):149 - {} - Preparing tables in destination completed.
2021-08-18 13:48:00 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Starting syncing SourceGithub
2021-08-18 13:48:00 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: commits 
2021-08-18 13:48:04 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 1000
2021-08-18 13:48:07 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 2000
2021-08-18 13:48:11 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 3000
2021-08-18 13:48:15 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 4000
2021-08-18 13:48:19 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 5000
2021-08-18 13:48:23 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 6000
2021-08-18 13:48:26 ERROR () DefaultAirbyteStreamFactory(internalLog):108 - Undefined error while reading records: 409 Client Error: Conflict for url: https://api.github.com/repos/PasseiDireto/last-student-session-job/commits?per_page=100&since=2017-01-01T00%3A00%3A00Z
2021-08-18 13:48:26 ERROR () DefaultAirbyteStreamFactory(internalLog):108 - Encountered an exception while reading stream SourceGithub
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 110, in read
    logger=logger, stream_instance=stream_instance, configured_stream=configured_stream, connector_state=connector_state
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 135, in _read_stream
    for record in record_iterator:
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 181, in _read_full_refresh
    for record in records:
  File "/airbyte/integration_code/source_github/streams.py", line 258, in read_records
    sync_mode=sync_mode, cursor_field=cursor_field, stream_slice=stream_slice, stream_state=stream_state
  File "/airbyte/integration_code/source_github/streams.py", line 132, in read_records
    raise e
  File "/airbyte/integration_code/source_github/streams.py", line 110, in read_records
    yield from super().read_records(stream_slice=stream_slice, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/streams/http/http.py", line 267, in read_records
    response = self._send_request(request, request_kwargs)
  File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry
    ret = target(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry
    ret = target(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/streams/http/http.py", line 242, in _send_request
    response.raise_for_status()
  File "/usr/local/lib/python3.7/site-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 409 Client Error: Conflict for url: https://api.github.com/repos/PasseiDireto/last-student-session-job/commits?per_page=100&since=2017-01-01T00%3A00%3A00Z

2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 - Traceback (most recent call last):
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/airbyte/integration_code/main.py", line 33, in <module>
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     launch(source, sys.argv[1:])
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 117, in launch
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     for message in source_entrypoint.run(parsed_args):
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 108, in run
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     for message in generator:
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     raise e
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 110, in read
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     logger=logger, stream_instance=stream_instance, configured_stream=configured_stream, connector_state=connector_state
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 135, in _read_stream
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     for record in record_iterator:
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 181, in _read_full_refresh
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     for record in records:
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/airbyte/integration_code/source_github/streams.py", line 258, in read_records
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     sync_mode=sync_mode, cursor_field=cursor_field, stream_slice=stream_slice, stream_state=stream_state
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/airbyte/integration_code/source_github/streams.py", line 132, in read_records
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     raise e
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/airbyte/integration_code/source_github/streams.py", line 110, in read_records
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     yield from super().read_records(stream_slice=stream_slice, **kwargs)
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/streams/http/http.py", line 267, in read_records
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     response = self._send_request(request, request_kwargs)
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     ret = target(*args, **kwargs)
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     ret = target(*args, **kwargs)
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/streams/http/http.py", line 242, in _send_request
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     response.raise_for_status()
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/requests/models.py", line 953, in raise_for_status
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 -     raise HTTPError(http_error_msg, response=self)
2021-08-18 13:48:26 ERROR () LineGobbler(voidCall):85 - requests.exceptions.HTTPError: 409 Client Error: Conflict for url: https://api.github.com/repos/PasseiDireto/last-student-session-job/commits?per_page=100&since=2017-01-01T00%3A00%3A00Z
2021-08-18 13:48:26 INFO () DefaultReplicationWorker(run):141 - Source thread complete.
2021-08-18 13:48:26 INFO () DefaultReplicationWorker(run):142 - Waiting for destination thread to join.
2021-08-18 13:48:26 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:26 �[32mINFO�[m i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 - {} - Airbyte message consumer: succeeded.
2021-08-18 13:48:26 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:26 �[32mINFO�[m i.a.i.d.b.BufferedStreamConsumer(close):212 - {} - executing on success close procedure.
2021-08-18 13:48:27 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:27 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):176 - {} - Finalizing tables in destination started for 3 streams
2021-08-18 13:48:27 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:27 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream git-testcommits. schema github, tmp table _airbyte_tmp_tnb_git_testcommits, final table _airbyte_raw_git_testcommits
2021-08-18 13:48:27 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:27 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream git-testprojects. schema github, tmp table _airbyte_tmp_xgo_git_testprojects, final table _airbyte_raw_git_testprojects
2021-08-18 13:48:27 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:27 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream git-testpull_requests. schema github, tmp table _airbyte_tmp_tag_git_testpull_requests, final table _airbyte_raw_git_testpull_requests
2021-08-18 13:48:27 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:27 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):194 - {} - Executing finalization of tables.
2021-08-18 13:48:28 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:28 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):196 - {} - Finalizing tables in destination completed.
2021-08-18 13:48:28 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:28 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):199 - {} - Cleaning tmp tables in destination started for 3 streams
2021-08-18 13:48:28 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:28 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream git-testcommits. schema github, tmp table name: _airbyte_tmp_tnb_git_testcommits
2021-08-18 13:48:28 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:28 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream git-testprojects. schema github, tmp table name: _airbyte_tmp_xgo_git_testprojects
2021-08-18 13:48:28 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:28 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream git-testpull_requests. schema github, tmp table name: _airbyte_tmp_tag_git_testpull_requests
2021-08-18 13:48:28 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:28 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):208 - {} - Cleaning tmp tables in destination completed.
2021-08-18 13:48:28 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:28 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):153 - {} - Completed integration: io.airbyte.integrations.destination.postgres.PostgresDestination
2021-08-18 13:48:28 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:28 �[32mINFO�[m i.a.i.d.p.PostgresDestination(main):85 - {} - completed destination: class io.airbyte.integrations.destination.postgres.PostgresDestination
2021-08-18 13:48:28 INFO () DefaultReplicationWorker(run):144 - Destination thread complete.
2021-08-18 13:48:28 INFO () EnvConfigs(getEnvOrDefault):302 - WORKER_ENVIRONMENT not found or empty, defaulting to DOCKER
2021-08-18 13:48:28 ERROR () DefaultReplicationWorker(run):148 - Sync worker failed.
io.airbyte.workers.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled.
	at io.airbyte.workers.protocols.airbyte.DefaultAirbyteSource.close(DefaultAirbyteSource.java:135) ~[io.airbyte-airbyte-workers-0.28.2-alpha.jar:?]
	at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:146) ~[io.airbyte-airbyte-workers-0.28.2-alpha.jar:?]
	at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:52) ~[io.airbyte-airbyte-workers-0.28.2-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:146) ~[io.airbyte-airbyte-workers-0.28.2-alpha.jar:?]
	at java.lang.Thread.run(Thread.java:832) [?:?]
2021-08-18 13:48:28 INFO () DefaultReplicationWorker(run):172 - sync summary: io.airbyte.config.ReplicationAttemptSummary@1503be92[status=failed,recordsSynced=6679,bytesSynced=11657106,startTime=1629294469254,endTime=1629294508256]
2021-08-18 13:48:28 INFO () DefaultReplicationWorker(run):181 - Source did not output any state messages
2021-08-18 13:48:28 WARN () DefaultReplicationWorker(run):192 - State capture: No state retained.
2021-08-18 13:48:28 INFO () TemporalAttemptExecution(get):133 - Stopping cancellation check scheduling...
2021-08-18 13:48:28 INFO () RetryingTemporalAttemptExecution(get):118 - Last output present: true. Should attempt again: true
2021-08-18 13:48:28 INFO () RetryingTemporalAttemptExecution(get):123 - Starting attempt: 1 of 3
2021-08-18 13:48:28 INFO () TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.28.2-alpha
2021-08-18 13:48:28 INFO () DefaultReplicationWorker(run):102 - start sync worker. job id: 696 attempt id: 0
2021-08-18 13:48:28 INFO () DefaultReplicationWorker(run):111 - configured sync modes: {null.pull_requests=full_refresh - append, null.commits=full_refresh - append, null.projects=full_refresh - append}
2021-08-18 13:48:28 INFO () DefaultAirbyteDestination(start):78 - Running destination...
2021-08-18 13:48:28 INFO () EnvConfigs(getEnvOrDefault):302 - WORKER_ENVIRONMENT not found or empty, defaulting to DOCKER
2021-08-18 13:48:28 INFO () LineGobbler(voidCall):85 - Checking if airbyte/destination-postgres:0.3.9 exists...
2021-08-18 13:48:28 INFO () LineGobbler(voidCall):85 - airbyte/destination-postgres:0.3.9 was found locally.
2021-08-18 13:48:28 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/696/0 --network host --log-driver none airbyte/destination-postgres:0.3.9 write --config destination_config.json --catalog destination_catalog.json
2021-08-18 13:48:28 INFO () LineGobbler(voidCall):85 - Checking if airbyte/source-github:0.1.5 exists...
2021-08-18 13:48:28 INFO () EnvConfigs(getEnvOrDefault):302 - WORKER_ENVIRONMENT not found or empty, defaulting to DOCKER
2021-08-18 13:48:28 INFO () LineGobbler(voidCall):85 - airbyte/source-github:0.1.5 was found locally.
2021-08-18 13:48:28 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/696/0 --network host --log-driver none airbyte/source-github:0.1.5 read --config source_config.json --catalog source_catalog.json
2021-08-18 13:48:28 INFO () DefaultReplicationWorker(run):139 - Waiting for source thread to join.
2021-08-18 13:48:28 INFO () DefaultReplicationWorker(lambda$getDestinationOutputRunnable$3):246 - Destination output thread started.
2021-08-18 13:48:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):210 - Replication thread started.
2021-08-18 13:48:29 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:29 �[32mINFO�[m i.a.i.d.p.PostgresDestination(main):83 - {} - starting destination: class io.airbyte.integrations.destination.postgres.PostgresDestination
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):96 - {} - Running integration: io.airbyte.integrations.destination.postgres.PostgresDestination
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[32mINFO�[m i.a.i.b.IntegrationCliParser(parseOptions):135 - {} - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):100 - {} - Command: WRITE
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):101 - {} - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=git-testcommits, namespace=null, outputSchemaName=github, tmpTableName=_airbyte_tmp_lnt_git_testcommits, outputTableName=_airbyte_raw_git_testcommits, syncMode=append}
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=git-testprojects, namespace=null, outputSchemaName=github, tmpTableName=_airbyte_tmp_pwo_git_testprojects, outputTableName=_airbyte_raw_git_testprojects, syncMode=append}
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=git-testpull_requests, namespace=null, outputSchemaName=github, tmpTableName=_airbyte_tmp_rgc_git_testpull_requests, outputTableName=_airbyte_raw_git_testpull_requests, syncMode=append}
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[32mINFO�[m i.a.i.d.b.BufferedStreamConsumer(startTracked):142 - {} - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):139 - {} - Preparing tmp tables in destination started for 3 streams
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream git-testcommits. schema: github, tmp table name: _airbyte_tmp_lnt_git_testcommits
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream git-testprojects. schema: github, tmp table name: _airbyte_tmp_pwo_git_testprojects
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream git-testpull_requests. schema: github, tmp table name: _airbyte_tmp_rgc_git_testpull_requests
2021-08-18 13:48:30 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:30 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):149 - {} - Preparing tables in destination completed.
2021-08-18 13:48:40 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Starting syncing SourceGithub
2021-08-18 13:48:40 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: commits 
2021-08-18 13:48:45 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 1000
2021-08-18 13:48:49 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 2000
2021-08-18 13:48:52 ERROR () DefaultAirbyteStreamFactory(internalLog):108 - Undefined error while reading records: 409 Client Error: Conflict for url: https://api.github.com/repos/PasseiDireto/pd-xray-daemon/commits?per_page=100&since=2017-01-01T00%3A00%3A00Z
2021-08-18 13:48:52 ERROR () DefaultAirbyteStreamFactory(internalLog):108 - Encountered an exception while reading stream SourceGithub
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 110, in read
    logger=logger, stream_instance=stream_instance, configured_stream=configured_stream, connector_state=connector_state
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 135, in _read_stream
    for record in record_iterator:
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 181, in _read_full_refresh
    for record in records:
  File "/airbyte/integration_code/source_github/streams.py", line 258, in read_records
    sync_mode=sync_mode, cursor_field=cursor_field, stream_slice=stream_slice, stream_state=stream_state
  File "/airbyte/integration_code/source_github/streams.py", line 132, in read_records
    raise e
  File "/airbyte/integration_code/source_github/streams.py", line 110, in read_records
    yield from super().read_records(stream_slice=stream_slice, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/streams/http/http.py", line 267, in read_records
    response = self._send_request(request, request_kwargs)
  File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry
    ret = target(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry
    ret = target(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/streams/http/http.py", line 242, in _send_request
    response.raise_for_status()
  File "/usr/local/lib/python3.7/site-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 409 Client Error: Conflict for url: https://api.github.com/repos/PasseiDireto/pd-xray-daemon/commits?per_page=100&since=2017-01-01T00%3A00%3A00Z

2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 - Traceback (most recent call last):
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/airbyte/integration_code/main.py", line 33, in <module>
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     launch(source, sys.argv[1:])
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 117, in launch
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     for message in source_entrypoint.run(parsed_args):
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 108, in run
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     for message in generator:
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     raise e
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 110, in read
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     logger=logger, stream_instance=stream_instance, configured_stream=configured_stream, connector_state=connector_state
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 135, in _read_stream
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     for record in record_iterator:
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 181, in _read_full_refresh
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     for record in records:
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/airbyte/integration_code/source_github/streams.py", line 258, in read_records
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     sync_mode=sync_mode, cursor_field=cursor_field, stream_slice=stream_slice, stream_state=stream_state
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/airbyte/integration_code/source_github/streams.py", line 132, in read_records
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     raise e
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/airbyte/integration_code/source_github/streams.py", line 110, in read_records
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     yield from super().read_records(stream_slice=stream_slice, **kwargs)
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/streams/http/http.py", line 267, in read_records
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     response = self._send_request(request, request_kwargs)
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     ret = target(*args, **kwargs)
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     ret = target(*args, **kwargs)
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/streams/http/http.py", line 242, in _send_request
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     response.raise_for_status()
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/requests/models.py", line 953, in raise_for_status
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 -     raise HTTPError(http_error_msg, response=self)
2021-08-18 13:48:52 ERROR () LineGobbler(voidCall):85 - requests.exceptions.HTTPError: 409 Client Error: Conflict for url: https://api.github.com/repos/PasseiDireto/pd-xray-daemon/commits?per_page=100&since=2017-01-01T00%3A00%3A00Z
2021-08-18 13:48:52 INFO () DefaultReplicationWorker(run):141 - Source thread complete.
2021-08-18 13:48:52 INFO () DefaultReplicationWorker(run):142 - Waiting for destination thread to join.
2021-08-18 13:48:52 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:52 �[32mINFO�[m i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 - {} - Airbyte message consumer: succeeded.
2021-08-18 13:48:52 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:52 �[32mINFO�[m i.a.i.d.b.BufferedStreamConsumer(close):212 - {} - executing on success close procedure.
2021-08-18 13:48:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:53 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):176 - {} - Finalizing tables in destination started for 3 streams
2021-08-18 13:48:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:53 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream git-testcommits. schema github, tmp table _airbyte_tmp_lnt_git_testcommits, final table _airbyte_raw_git_testcommits
2021-08-18 13:48:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:53 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream git-testprojects. schema github, tmp table _airbyte_tmp_pwo_git_testprojects, final table _airbyte_raw_git_testprojects
2021-08-18 13:48:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:53 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream git-testpull_requests. schema github, tmp table _airbyte_tmp_rgc_git_testpull_requests, final table _airbyte_raw_git_testpull_requests
2021-08-18 13:48:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:53 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):194 - {} - Executing finalization of tables.
2021-08-18 13:48:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:53 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):196 - {} - Finalizing tables in destination completed.
2021-08-18 13:48:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:53 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):199 - {} - Cleaning tmp tables in destination started for 3 streams
2021-08-18 13:48:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:53 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream git-testcommits. schema github, tmp table name: _airbyte_tmp_lnt_git_testcommits
2021-08-18 13:48:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:53 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream git-testprojects. schema github, tmp table name: _airbyte_tmp_pwo_git_testprojects
2021-08-18 13:48:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:53 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream git-testpull_requests. schema github, tmp table name: _airbyte_tmp_rgc_git_testpull_requests
2021-08-18 13:48:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:53 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):208 - {} - Cleaning tmp tables in destination completed.
2021-08-18 13:48:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:53 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):153 - {} - Completed integration: io.airbyte.integrations.destination.postgres.PostgresDestination
2021-08-18 13:48:53 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:53 �[32mINFO�[m i.a.i.d.p.PostgresDestination(main):85 - {} - completed destination: class io.airbyte.integrations.destination.postgres.PostgresDestination
2021-08-18 13:48:53 INFO () DefaultReplicationWorker(run):144 - Destination thread complete.
2021-08-18 13:48:53 INFO () EnvConfigs(getEnvOrDefault):302 - WORKER_ENVIRONMENT not found or empty, defaulting to DOCKER
2021-08-18 13:48:53 ERROR () DefaultReplicationWorker(run):148 - Sync worker failed.
io.airbyte.workers.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled.
	at io.airbyte.workers.protocols.airbyte.DefaultAirbyteSource.close(DefaultAirbyteSource.java:135) ~[io.airbyte-airbyte-workers-0.28.2-alpha.jar:?]
	at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:146) ~[io.airbyte-airbyte-workers-0.28.2-alpha.jar:?]
	at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:52) ~[io.airbyte-airbyte-workers-0.28.2-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:146) ~[io.airbyte-airbyte-workers-0.28.2-alpha.jar:?]
	at java.lang.Thread.run(Thread.java:832) [?:?]
2021-08-18 13:48:53 INFO () DefaultReplicationWorker(run):172 - sync summary: io.airbyte.config.ReplicationAttemptSummary@1e8ae5a0[status=failed,recordsSynced=2811,bytesSynced=5290964,startTime=1629294508276,endTime=1629294533854]
2021-08-18 13:48:53 INFO () DefaultReplicationWorker(run):181 - Source did not output any state messages
2021-08-18 13:48:53 WARN () DefaultReplicationWorker(run):192 - State capture: No state retained.
2021-08-18 13:48:53 INFO () TemporalAttemptExecution(get):133 - Stopping cancellation check scheduling...
2021-08-18 13:48:53 INFO () RetryingTemporalAttemptExecution(get):118 - Last output present: true. Should attempt again: true
2021-08-18 13:48:53 INFO () RetryingTemporalAttemptExecution(get):123 - Starting attempt: 2 of 3
2021-08-18 13:48:53 INFO () TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.28.2-alpha
2021-08-18 13:48:53 INFO () DefaultReplicationWorker(run):102 - start sync worker. job id: 696 attempt id: 0
2021-08-18 13:48:53 INFO () DefaultReplicationWorker(run):111 - configured sync modes: {null.pull_requests=full_refresh - append, null.commits=full_refresh - append, null.projects=full_refresh - append}
2021-08-18 13:48:53 INFO () DefaultAirbyteDestination(start):78 - Running destination...
2021-08-18 13:48:53 INFO () EnvConfigs(getEnvOrDefault):302 - WORKER_ENVIRONMENT not found or empty, defaulting to DOCKER
2021-08-18 13:48:53 INFO () LineGobbler(voidCall):85 - Checking if airbyte/destination-postgres:0.3.9 exists...
2021-08-18 13:48:53 INFO () LineGobbler(voidCall):85 - airbyte/destination-postgres:0.3.9 was found locally.
2021-08-18 13:48:53 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/696/0 --network host --log-driver none airbyte/destination-postgres:0.3.9 write --config destination_config.json --catalog destination_catalog.json
2021-08-18 13:48:53 INFO () EnvConfigs(getEnvOrDefault):302 - WORKER_ENVIRONMENT not found or empty, defaulting to DOCKER
2021-08-18 13:48:53 INFO () LineGobbler(voidCall):85 - Checking if airbyte/source-github:0.1.5 exists...
2021-08-18 13:48:54 INFO () LineGobbler(voidCall):85 - airbyte/source-github:0.1.5 was found locally.
2021-08-18 13:48:54 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/696/0 --network host --log-driver none airbyte/source-github:0.1.5 read --config source_config.json --catalog source_catalog.json
2021-08-18 13:48:54 INFO () DefaultReplicationWorker(lambda$getDestinationOutputRunnable$3):246 - Destination output thread started.
2021-08-18 13:48:54 INFO () DefaultReplicationWorker(run):139 - Waiting for source thread to join.
2021-08-18 13:48:54 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):210 - Replication thread started.
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[32mINFO�[m i.a.i.d.p.PostgresDestination(main):83 - {} - starting destination: class io.airbyte.integrations.destination.postgres.PostgresDestination
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):96 - {} - Running integration: io.airbyte.integrations.destination.postgres.PostgresDestination
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[32mINFO�[m i.a.i.b.IntegrationCliParser(parseOptions):135 - {} - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):100 - {} - Command: WRITE
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):101 - {} - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[33mWARN�[m c.n.s.JsonMetaSchema(newValidator):338 - {} - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=git-testcommits, namespace=null, outputSchemaName=github, tmpTableName=_airbyte_tmp_jvi_git_testcommits, outputTableName=_airbyte_raw_git_testcommits, syncMode=append}
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=git-testprojects, namespace=null, outputSchemaName=github, tmpTableName=_airbyte_tmp_dfo_git_testprojects, outputTableName=_airbyte_raw_git_testprojects, syncMode=append}
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):116 - {} - Write config: WriteConfig{streamName=git-testpull_requests, namespace=null, outputSchemaName=github, tmpTableName=_airbyte_tmp_aih_git_testpull_requests, outputTableName=_airbyte_raw_git_testpull_requests, syncMode=append}
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[32mINFO�[m i.a.i.d.b.BufferedStreamConsumer(startTracked):142 - {} - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):139 - {} - Preparing tmp tables in destination started for 3 streams
2021-08-18 13:48:55 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:55 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream git-testcommits. schema: github, tmp table name: _airbyte_tmp_jvi_git_testcommits
2021-08-18 13:48:56 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:56 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream git-testprojects. schema: github, tmp table name: _airbyte_tmp_dfo_git_testprojects
2021-08-18 13:48:56 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:56 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):143 - {} - Preparing tmp table in destination started for stream git-testpull_requests. schema: github, tmp table name: _airbyte_tmp_aih_git_testpull_requests
2021-08-18 13:48:56 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:48:56 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):149 - {} - Preparing tables in destination completed.
2021-08-18 13:49:06 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Starting syncing SourceGithub
2021-08-18 13:49:06 INFO () DefaultAirbyteStreamFactory(internalLog):110 - Syncing stream: commits 
2021-08-18 13:49:10 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 1000
2021-08-18 13:49:13 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 2000
2021-08-18 13:49:16 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 3000
2021-08-18 13:49:19 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 4000
2021-08-18 13:49:21 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 5000
2021-08-18 13:49:24 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 6000
2021-08-18 13:49:28 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 7000
2021-08-18 13:49:34 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 8000
2021-08-18 13:49:39 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 9000
2021-08-18 13:49:43 INFO () DefaultReplicationWorker(lambda$getReplicationRunnable$2):223 - Records read: 10000
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 - Traceback (most recent call last):
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/airbyte/integration_code/main.py", line 33, in <module>
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     launch(source, sys.argv[1:])
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 117, in launch
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     for message in source_entrypoint.run(parsed_args):
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 108, in run
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     for message in generator:
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     raise e
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 110, in read
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     logger=logger, stream_instance=stream_instance, configured_stream=configured_stream, connector_state=connector_state
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 135, in _read_stream
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     for record in record_iterator:
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 181, in _read_full_refresh
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     for record in records:
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/airbyte/integration_code/source_github/streams.py", line 258, in read_records
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     sync_mode=sync_mode, cursor_field=cursor_field, stream_slice=stream_slice, stream_state=stream_state
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/airbyte/integration_code/source_github/streams.py", line 132, in read_records
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     raise e
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/airbyte/integration_code/source_github/streams.py", line 110, in read_records
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     yield from super().read_records(stream_slice=stream_slice, **kwargs)
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/streams/http/http.py", line 267, in read_records
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     response = self._send_request(request, request_kwargs)
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     ret = target(*args, **kwargs)
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry
2021-08-18 13:49:44 ERROR () DefaultAirbyteStreamFactory(internalLog):108 - Undefined error while reading records: 409 Client Error: Conflict for url: https://api.github.com/repos/PasseiDireto/poc-test-mobile-detox/commits?per_page=100&since=2017-01-01T00%3A00%3A00Z
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     ret = target(*args, **kwargs)
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/streams/http/http.py", line 242, in _send_request
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     response.raise_for_status()
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/requests/models.py", line 953, in raise_for_status
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 -     raise HTTPError(http_error_msg, response=self)
2021-08-18 13:49:44 ERROR () LineGobbler(voidCall):85 - requests.exceptions.HTTPError: 409 Client Error: Conflict for url: https://api.github.com/repos/PasseiDireto/poc-test-mobile-detox/commits?per_page=100&since=2017-01-01T00%3A00%3A00Z
2021-08-18 13:49:44 ERROR () DefaultAirbyteStreamFactory(internalLog):108 - Encountered an exception while reading stream SourceGithub
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 110, in read
    logger=logger, stream_instance=stream_instance, configured_stream=configured_stream, connector_state=connector_state
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 135, in _read_stream
    for record in record_iterator:
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 181, in _read_full_refresh
    for record in records:
  File "/airbyte/integration_code/source_github/streams.py", line 258, in read_records
    sync_mode=sync_mode, cursor_field=cursor_field, stream_slice=stream_slice, stream_state=stream_state
  File "/airbyte/integration_code/source_github/streams.py", line 132, in read_records
    raise e
  File "/airbyte/integration_code/source_github/streams.py", line 110, in read_records
    yield from super().read_records(stream_slice=stream_slice, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/streams/http/http.py", line 267, in read_records
    response = self._send_request(request, request_kwargs)
  File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry
    ret = target(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry
    ret = target(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/streams/http/http.py", line 242, in _send_request
    response.raise_for_status()
  File "/usr/local/lib/python3.7/site-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 409 Client Error: Conflict for url: https://api.github.com/repos/PasseiDireto/poc-test-mobile-detox/commits?per_page=100&since=2017-01-01T00%3A00%3A00Z

2021-08-18 13:49:44 INFO () DefaultReplicationWorker(run):141 - Source thread complete.
2021-08-18 13:49:44 INFO () DefaultReplicationWorker(run):142 - Waiting for destination thread to join.
2021-08-18 13:49:44 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:44 �[32mINFO�[m i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 - {} - Airbyte message consumer: succeeded.
2021-08-18 13:49:44 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:44 �[32mINFO�[m i.a.i.d.b.BufferedStreamConsumer(close):212 - {} - executing on success close procedure.
2021-08-18 13:49:44 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:44 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):176 - {} - Finalizing tables in destination started for 3 streams
2021-08-18 13:49:44 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:44 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream git-testcommits. schema github, tmp table _airbyte_tmp_jvi_git_testcommits, final table _airbyte_raw_git_testcommits
2021-08-18 13:49:44 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:44 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream git-testprojects. schema github, tmp table _airbyte_tmp_dfo_git_testprojects, final table _airbyte_raw_git_testprojects
2021-08-18 13:49:44 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:44 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - {} - Finalizing stream git-testpull_requests. schema github, tmp table _airbyte_tmp_aih_git_testpull_requests, final table _airbyte_raw_git_testpull_requests
2021-08-18 13:49:44 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:44 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):194 - {} - Executing finalization of tables.
2021-08-18 13:49:45 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:45 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):196 - {} - Finalizing tables in destination completed.
2021-08-18 13:49:45 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:45 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):199 - {} - Cleaning tmp tables in destination started for 3 streams
2021-08-18 13:49:45 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:45 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream git-testcommits. schema github, tmp table name: _airbyte_tmp_jvi_git_testcommits
2021-08-18 13:49:45 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:45 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream git-testprojects. schema github, tmp table name: _airbyte_tmp_dfo_git_testprojects
2021-08-18 13:49:45 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:45 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):203 - {} - Cleaning tmp table in destination started for stream git-testpull_requests. schema github, tmp table name: _airbyte_tmp_aih_git_testpull_requests
2021-08-18 13:49:45 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:45 �[32mINFO�[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):208 - {} - Cleaning tmp tables in destination completed.
2021-08-18 13:49:45 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:45 �[32mINFO�[m i.a.i.b.IntegrationRunner(run):153 - {} - Completed integration: io.airbyte.integrations.destination.postgres.PostgresDestination
2021-08-18 13:49:45 INFO () DefaultAirbyteStreamFactory(lambda$create$0):73 - 2021-08-18 13:49:45 �[32mINFO�[m i.a.i.d.p.PostgresDestination(main):85 - {} - completed destination: class io.airbyte.integrations.destination.postgres.PostgresDestination
2021-08-18 13:49:45 INFO () DefaultReplicationWorker(run):144 - Destination thread complete.
2021-08-18 13:49:45 INFO () EnvConfigs(getEnvOrDefault):302 - WORKER_ENVIRONMENT not found or empty, defaulting to DOCKER
2021-08-18 13:49:45 ERROR () DefaultReplicationWorker(run):148 - Sync worker failed.
io.airbyte.workers.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled.
	at io.airbyte.workers.protocols.airbyte.DefaultAirbyteSource.close(DefaultAirbyteSource.java:135) ~[io.airbyte-airbyte-workers-0.28.2-alpha.jar:?]
	at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:146) ~[io.airbyte-airbyte-workers-0.28.2-alpha.jar:?]
	at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:52) ~[io.airbyte-airbyte-workers-0.28.2-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:146) ~[io.airbyte-airbyte-workers-0.28.2-alpha.jar:?]
	at java.lang.Thread.run(Thread.java:832) [?:?]
2021-08-18 13:49:45 INFO () DefaultReplicationWorker(run):172 - sync summary: io.airbyte.config.ReplicationAttemptSummary@6552a110[status=failed,recordsSynced=10294,bytesSynced=16811755,startTime=1629294533899,endTime=1629294585360]
2021-08-18 13:49:45 INFO () DefaultReplicationWorker(run):181 - Source did not output any state messages
2021-08-18 13:49:45 WARN () DefaultReplicationWorker(run):192 - State capture: No state retained.
2021-08-18 13:49:45 INFO () TemporalAttemptExecution(get):133 - Stopping cancellation check scheduling...
2021-08-18 13:49:45 INFO () RetryingTemporalAttemptExecution(get):112 - Max retries reached: 3
2021-08-18 13:49:45 INFO () SyncWorkflow$ReplicationActivityImpl(replicate):202 - attempt summaries: [io.airbyte.config.ReplicationOutput@5560ac5c[replicationAttemptSummary=io.airbyte.config.ReplicationAttemptSummary@1503be92[status=failed,recordsSynced=6679,bytesSynced=11657106,startTime=1629294469254,endTime=1629294508256],state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@3a366556[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@1d76755d[stream=io.airbyte.protocol.models.AirbyteStream@72395361[name=git-testcommits,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]},"commit":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"tree":{"type":["null","object"],"properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]}}},"author":{"type":["null","object"],"properties":{"date":{"type":["null","string"],"format":"date-time"},"name":{"type":["null","string"]},"email":{"type":["null","string"]}}},"message":{"type":["null","string"]},"committer":{"type":["null","object"],"properties":{"date":{"type":["null","string"],"format":"date-time"},"name":{"type":["null","string"]},"email":{"type":["null","string"]}}},"verification":{"type":["null","object"],"properties":{"reason":{"type":["null","string"]},"payload":{"type":["null","string"]},"verified":{"type":["null","boolean"]},"signature":{"type":["null","string"]}}},"comment_count":{"type":["null","integer"]}}},"node_id":{"type":["null","string"]},"parents":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]},"html_url":{"type":["null","string"]}}}},"html_url":{"type":["null","string"]},"author_id":{"type":["null","integer"]},"created_at":{"type":["null","string"],"format":"date-time"},"repository":{"type":["string"]},"comments_url":{"type":["null","string"]},"committer_id":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[created_at],sourceDefinedPrimaryKey=[[sha]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[created_at],destinationSyncMode=append,primaryKey=[[sha]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@22eb1336[stream=io.airbyte.protocol.models.AirbyteStream@2bfecee8[name=git-testprojects,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"name":{"type":["null","string"]},"state":{"type":["null","string"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"owner_url":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"creator_id":{"type":["null","integer"]},"repository":{"type":["string"]},"updated_at":{"type":["null","string"],"format":"date-time"},"columns_url":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@58c9a57[stream=io.airbyte.protocol.models.AirbyteStream@3d9663dc[name=git-testpull_requests,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"base":{"type":["null","object"],"properties":{"ref":{"type":["null","string"]},"sha":{"type":["null","string"]},"label":{"type":["null","string"]},"repo_id":{"type":["null","integer"]},"user_id":{"type":["null","integer"]}}},"body":{"type":["null","string"]},"head":{"type":["null","object"],"properties":{"ref":{"type":["null","string"]},"sha":{"type":["null","string"]},"label":{"type":["null","string"]},"repo_id":{"type":["null","integer"]},"user_id":{"type":["null","integer"]}}},"user":{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]},"login":{"type":["null","string"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"gists_url":{"type":["null","string"]},"repos_url":{"type":["null","string"]},"avatar_url":{"type":["null","string"]},"events_url":{"type":["null","string"]},"site_admin":{"type":["null","boolean"]},"gravatar_id":{"type":["null","string"]},"starred_url":{"type":["null","string"]},"followers_url":{"type":["null","string"]},"following_url":{"type":["null","string"]},"organizations_url":{"type":["null","string"]},"subscriptions_url":{"type":["null","string"]},"received_events_url":{"type":["null","string"]}}},"draft":{"type":["null","boolean"]},"state":{"type":["null","string"]},"title":{"type":["null","string"]},"_links":{"type":["null","object"],"properties":{"html":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"self":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"issue":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"commits":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"comments":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"statuses":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"review_comment":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"review_comments":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}}},"labels":{"type":["null","array"],"items":{"type":["null","integer"]}},"locked":{"type":["null","boolean"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"diff_url":{"type":["null","string"]},"html_url":{"type":["null","string"]},"assignees":{"type":["null","array"],"items":{"type":["null","integer"]}},"closed_at":{"type":["null","string"],"format":"date-time"},"issue_url":{"type":["null","string"]},"merged_at":{"type":["null","string"],"format":"date-time"},"patch_url":{"type":["null","string"]},"auto_merge":{"type":["null","boolean"]},"created_at":{"type":["null","string"],"format":"date-time"},"repository":{"type":["string"]},"updated_at":{"type":["null","string"],"format":"date-time"},"assignee_id":{"type":["null","integer"]},"commits_url":{"type":["null","string"]},"comments_url":{"type":["null","string"]},"milestone_id":{"type":["null","integer"]},"statuses_url":{"type":["null","string"]},"requested_teams":{"type":["null","array"],"items":{"type":["null","integer"]}},"merge_commit_sha":{"type":["null","string"]},"active_lock_reason":{"type":["null","string"]},"author_association":{"type":["null","string"]},"review_comment_url":{"type":["null","string"]},"requested_reviewers":{"type":["null","array"],"items":{"type":["null","integer"]}},"review_comments_url":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}]], io.airbyte.config.ReplicationOutput@471ea5fb[replicationAttemptSummary=io.airbyte.config.ReplicationAttemptSummary@1e8ae5a0[status=failed,recordsSynced=2811,bytesSynced=5290964,startTime=1629294508276,endTime=1629294533854],state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@1acaaa7e[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@7bf5d552[stream=io.airbyte.protocol.models.AirbyteStream@7573d173[name=git-testcommits,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]},"commit":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"tree":{"type":["null","object"],"properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]}}},"author":{"type":["null","object"],"properties":{"date":{"type":["null","string"],"format":"date-time"},"name":{"type":["null","string"]},"email":{"type":["null","string"]}}},"message":{"type":["null","string"]},"committer":{"type":["null","object"],"properties":{"date":{"type":["null","string"],"format":"date-time"},"name":{"type":["null","string"]},"email":{"type":["null","string"]}}},"verification":{"type":["null","object"],"properties":{"reason":{"type":["null","string"]},"payload":{"type":["null","string"]},"verified":{"type":["null","boolean"]},"signature":{"type":["null","string"]}}},"comment_count":{"type":["null","integer"]}}},"node_id":{"type":["null","string"]},"parents":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]},"html_url":{"type":["null","string"]}}}},"html_url":{"type":["null","string"]},"author_id":{"type":["null","integer"]},"created_at":{"type":["null","string"],"format":"date-time"},"repository":{"type":["string"]},"comments_url":{"type":["null","string"]},"committer_id":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[created_at],sourceDefinedPrimaryKey=[[sha]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[created_at],destinationSyncMode=append,primaryKey=[[sha]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@47f0935b[stream=io.airbyte.protocol.models.AirbyteStream@8264881[name=git-testprojects,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"name":{"type":["null","string"]},"state":{"type":["null","string"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"owner_url":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"creator_id":{"type":["null","integer"]},"repository":{"type":["string"]},"updated_at":{"type":["null","string"],"format":"date-time"},"columns_url":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5dac4392[stream=io.airbyte.protocol.models.AirbyteStream@36bff91d[name=git-testpull_requests,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"base":{"type":["null","object"],"properties":{"ref":{"type":["null","string"]},"sha":{"type":["null","string"]},"label":{"type":["null","string"]},"repo_id":{"type":["null","integer"]},"user_id":{"type":["null","integer"]}}},"body":{"type":["null","string"]},"head":{"type":["null","object"],"properties":{"ref":{"type":["null","string"]},"sha":{"type":["null","string"]},"label":{"type":["null","string"]},"repo_id":{"type":["null","integer"]},"user_id":{"type":["null","integer"]}}},"user":{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]},"login":{"type":["null","string"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"gists_url":{"type":["null","string"]},"repos_url":{"type":["null","string"]},"avatar_url":{"type":["null","string"]},"events_url":{"type":["null","string"]},"site_admin":{"type":["null","boolean"]},"gravatar_id":{"type":["null","string"]},"starred_url":{"type":["null","string"]},"followers_url":{"type":["null","string"]},"following_url":{"type":["null","string"]},"organizations_url":{"type":["null","string"]},"subscriptions_url":{"type":["null","string"]},"received_events_url":{"type":["null","string"]}}},"draft":{"type":["null","boolean"]},"state":{"type":["null","string"]},"title":{"type":["null","string"]},"_links":{"type":["null","object"],"properties":{"html":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"self":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"issue":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"commits":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"comments":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"statuses":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"review_comment":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"review_comments":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}}},"labels":{"type":["null","array"],"items":{"type":["null","integer"]}},"locked":{"type":["null","boolean"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"diff_url":{"type":["null","string"]},"html_url":{"type":["null","string"]},"assignees":{"type":["null","array"],"items":{"type":["null","integer"]}},"closed_at":{"type":["null","string"],"format":"date-time"},"issue_url":{"type":["null","string"]},"merged_at":{"type":["null","string"],"format":"date-time"},"patch_url":{"type":["null","string"]},"auto_merge":{"type":["null","boolean"]},"created_at":{"type":["null","string"],"format":"date-time"},"repository":{"type":["string"]},"updated_at":{"type":["null","string"],"format":"date-time"},"assignee_id":{"type":["null","integer"]},"commits_url":{"type":["null","string"]},"comments_url":{"type":["null","string"]},"milestone_id":{"type":["null","integer"]},"statuses_url":{"type":["null","string"]},"requested_teams":{"type":["null","array"],"items":{"type":["null","integer"]}},"merge_commit_sha":{"type":["null","string"]},"active_lock_reason":{"type":["null","string"]},"author_association":{"type":["null","string"]},"review_comment_url":{"type":["null","string"]},"requested_reviewers":{"type":["null","array"],"items":{"type":["null","integer"]}},"review_comments_url":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}]], io.airbyte.config.ReplicationOutput@7596ceda[replicationAttemptSummary=io.airbyte.config.ReplicationAttemptSummary@6552a110[status=failed,recordsSynced=10294,bytesSynced=16811755,startTime=1629294533899,endTime=1629294585360],state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@4f4ef2a9[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@70c19801[stream=io.airbyte.protocol.models.AirbyteStream@39fff015[name=git-testcommits,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]},"commit":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"tree":{"type":["null","object"],"properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]}}},"author":{"type":["null","object"],"properties":{"date":{"type":["null","string"],"format":"date-time"},"name":{"type":["null","string"]},"email":{"type":["null","string"]}}},"message":{"type":["null","string"]},"committer":{"type":["null","object"],"properties":{"date":{"type":["null","string"],"format":"date-time"},"name":{"type":["null","string"]},"email":{"type":["null","string"]}}},"verification":{"type":["null","object"],"properties":{"reason":{"type":["null","string"]},"payload":{"type":["null","string"]},"verified":{"type":["null","boolean"]},"signature":{"type":["null","string"]}}},"comment_count":{"type":["null","integer"]}}},"node_id":{"type":["null","string"]},"parents":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]},"html_url":{"type":["null","string"]}}}},"html_url":{"type":["null","string"]},"author_id":{"type":["null","integer"]},"created_at":{"type":["null","string"],"format":"date-time"},"repository":{"type":["string"]},"comments_url":{"type":["null","string"]},"committer_id":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[created_at],sourceDefinedPrimaryKey=[[sha]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[created_at],destinationSyncMode=append,primaryKey=[[sha]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@7a5c09ee[stream=io.airbyte.protocol.models.AirbyteStream@42bf67b6[name=git-testprojects,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"name":{"type":["null","string"]},"state":{"type":["null","string"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"owner_url":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"creator_id":{"type":["null","integer"]},"repository":{"type":["string"]},"updated_at":{"type":["null","string"],"format":"date-time"},"columns_url":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3ec2fe70[stream=io.airbyte.protocol.models.AirbyteStream@787bdee5[name=git-testpull_requests,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"base":{"type":["null","object"],"properties":{"ref":{"type":["null","string"]},"sha":{"type":["null","string"]},"label":{"type":["null","string"]},"repo_id":{"type":["null","integer"]},"user_id":{"type":["null","integer"]}}},"body":{"type":["null","string"]},"head":{"type":["null","object"],"properties":{"ref":{"type":["null","string"]},"sha":{"type":["null","string"]},"label":{"type":["null","string"]},"repo_id":{"type":["null","integer"]},"user_id":{"type":["null","integer"]}}},"user":{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]},"login":{"type":["null","string"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"gists_url":{"type":["null","string"]},"repos_url":{"type":["null","string"]},"avatar_url":{"type":["null","string"]},"events_url":{"type":["null","string"]},"site_admin":{"type":["null","boolean"]},"gravatar_id":{"type":["null","string"]},"starred_url":{"type":["null","string"]},"followers_url":{"type":["null","string"]},"following_url":{"type":["null","string"]},"organizations_url":{"type":["null","string"]},"subscriptions_url":{"type":["null","string"]},"received_events_url":{"type":["null","string"]}}},"draft":{"type":["null","boolean"]},"state":{"type":["null","string"]},"title":{"type":["null","string"]},"_links":{"type":["null","object"],"properties":{"html":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"self":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"issue":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"commits":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"comments":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"statuses":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"review_comment":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"review_comments":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}}},"labels":{"type":["null","array"],"items":{"type":["null","integer"]}},"locked":{"type":["null","boolean"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"diff_url":{"type":["null","string"]},"html_url":{"type":["null","string"]},"assignees":{"type":["null","array"],"items":{"type":["null","integer"]}},"closed_at":{"type":["null","string"],"format":"date-time"},"issue_url":{"type":["null","string"]},"merged_at":{"type":["null","string"],"format":"date-time"},"patch_url":{"type":["null","string"]},"auto_merge":{"type":["null","boolean"]},"created_at":{"type":["null","string"],"format":"date-time"},"repository":{"type":["string"]},"updated_at":{"type":["null","string"],"format":"date-time"},"assignee_id":{"type":["null","integer"]},"commits_url":{"type":["null","string"]},"comments_url":{"type":["null","string"]},"milestone_id":{"type":["null","integer"]},"statuses_url":{"type":["null","string"]},"requested_teams":{"type":["null","array"],"items":{"type":["null","integer"]}},"merge_commit_sha":{"type":["null","string"]},"active_lock_reason":{"type":["null","string"]},"author_association":{"type":["null","string"]},"review_comment_url":{"type":["null","string"]},"requested_reviewers":{"type":["null","array"],"items":{"type":["null","integer"]}},"review_comments_url":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}]]]
2021-08-18 13:49:45 INFO () SyncWorkflow$ReplicationActivityImpl(replicate):203 - sync summary: io.airbyte.config.StandardSyncOutput@72d1a635[standardSyncSummary=io.airbyte.config.StandardSyncSummary@547bc27c[status=failed,recordsSynced=19784,bytesSynced=33759825,startTime=1629294469254,endTime=1629294585360],state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@4f4ef2a9[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@70c19801[stream=io.airbyte.protocol.models.AirbyteStream@39fff015[name=git-testcommits,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]},"commit":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"tree":{"type":["null","object"],"properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]}}},"author":{"type":["null","object"],"properties":{"date":{"type":["null","string"],"format":"date-time"},"name":{"type":["null","string"]},"email":{"type":["null","string"]}}},"message":{"type":["null","string"]},"committer":{"type":["null","object"],"properties":{"date":{"type":["null","string"],"format":"date-time"},"name":{"type":["null","string"]},"email":{"type":["null","string"]}}},"verification":{"type":["null","object"],"properties":{"reason":{"type":["null","string"]},"payload":{"type":["null","string"]},"verified":{"type":["null","boolean"]},"signature":{"type":["null","string"]}}},"comment_count":{"type":["null","integer"]}}},"node_id":{"type":["null","string"]},"parents":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"sha":{"type":["null","string"]},"url":{"type":["null","string"]},"html_url":{"type":["null","string"]}}}},"html_url":{"type":["null","string"]},"author_id":{"type":["null","integer"]},"created_at":{"type":["null","string"],"format":"date-time"},"repository":{"type":["string"]},"comments_url":{"type":["null","string"]},"committer_id":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[created_at],sourceDefinedPrimaryKey=[[sha]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[created_at],destinationSyncMode=append,primaryKey=[[sha]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@7a5c09ee[stream=io.airbyte.protocol.models.AirbyteStream@42bf67b6[name=git-testprojects,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"body":{"type":["null","string"]},"name":{"type":["null","string"]},"state":{"type":["null","string"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"owner_url":{"type":["null","string"]},"created_at":{"type":["null","string"],"format":"date-time"},"creator_id":{"type":["null","integer"]},"repository":{"type":["string"]},"updated_at":{"type":["null","string"],"format":"date-time"},"columns_url":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3ec2fe70[stream=io.airbyte.protocol.models.AirbyteStream@787bdee5[name=git-testpull_requests,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"base":{"type":["null","object"],"properties":{"ref":{"type":["null","string"]},"sha":{"type":["null","string"]},"label":{"type":["null","string"]},"repo_id":{"type":["null","integer"]},"user_id":{"type":["null","integer"]}}},"body":{"type":["null","string"]},"head":{"type":["null","object"],"properties":{"ref":{"type":["null","string"]},"sha":{"type":["null","string"]},"label":{"type":["null","string"]},"repo_id":{"type":["null","integer"]},"user_id":{"type":["null","integer"]}}},"user":{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]},"login":{"type":["null","string"]},"node_id":{"type":["null","string"]},"html_url":{"type":["null","string"]},"gists_url":{"type":["null","string"]},"repos_url":{"type":["null","string"]},"avatar_url":{"type":["null","string"]},"events_url":{"type":["null","string"]},"site_admin":{"type":["null","boolean"]},"gravatar_id":{"type":["null","string"]},"starred_url":{"type":["null","string"]},"followers_url":{"type":["null","string"]},"following_url":{"type":["null","string"]},"organizations_url":{"type":["null","string"]},"subscriptions_url":{"type":["null","string"]},"received_events_url":{"type":["null","string"]}}},"draft":{"type":["null","boolean"]},"state":{"type":["null","string"]},"title":{"type":["null","string"]},"_links":{"type":["null","object"],"properties":{"html":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"self":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"issue":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"commits":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"comments":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"statuses":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"review_comment":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}},"review_comments":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}}},"labels":{"type":["null","array"],"items":{"type":["null","integer"]}},"locked":{"type":["null","boolean"]},"number":{"type":["null","integer"]},"node_id":{"type":["null","string"]},"diff_url":{"type":["null","string"]},"html_url":{"type":["null","string"]},"assignees":{"type":["null","array"],"items":{"type":["null","integer"]}},"closed_at":{"type":["null","string"],"format":"date-time"},"issue_url":{"type":["null","string"]},"merged_at":{"type":["null","string"],"format":"date-time"},"patch_url":{"type":["null","string"]},"auto_merge":{"type":["null","boolean"]},"created_at":{"type":["null","string"],"format":"date-time"},"repository":{"type":["string"]},"updated_at":{"type":["null","string"],"format":"date-time"},"assignee_id":{"type":["null","integer"]},"commits_url":{"type":["null","string"]},"comments_url":{"type":["null","string"]},"milestone_id":{"type":["null","integer"]},"statuses_url":{"type":["null","string"]},"requested_teams":{"type":["null","array"],"items":{"type":["null","integer"]}},"merge_commit_sha":{"type":["null","string"]},"active_lock_reason":{"type":["null","string"]},"author_association":{"type":["null","string"]},"review_comment_url":{"type":["null","string"]},"requested_reviewers":{"type":["null","array"],"items":{"type":["null","integer"]}},"review_comments_url":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}]]
2021-08-18 13:49:45 INFO () TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.28.2-alpha
2021-08-18 13:49:45 INFO () DefaultNormalizationWorker(run):61 - Running normalization.
2021-08-18 13:49:45 INFO () EnvConfigs(getEnvOrDefault):302 - WORKER_ENVIRONMENT not found or empty, defaulting to DOCKER
2021-08-18 13:49:45 INFO () LineGobbler(voidCall):85 - Checking if airbyte/normalization:0.1.38 exists...
2021-08-18 13:49:45 INFO () LineGobbler(voidCall):85 - airbyte/normalization:0.1.38 was found locally.
2021-08-18 13:49:45 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/696/0/normalize --network host --log-driver none airbyte/normalization:0.1.38 run --integration-type postgres --config destination_config.json --catalog destination_catalog.json
2021-08-18 13:49:45 INFO () LineGobbler(voidCall):85 - Running: transform-config --config destination_config.json --integration-type postgres --out /data/696/0/normalize
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 - Namespace(config='destination_config.json', integration_type=<DestinationType.postgres: 'postgres'>, out='/data/696/0/normalize')
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 - transform_postgres
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 - Running: transform-catalog --integration-type postgres --profile-config-dir /data/696/0/normalize --catalog destination_catalog.json --out /data/696/0/normalize/models/generated/ --json-column _airbyte_data
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 - Processing destination_catalog.json...
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 - Truncating git_testpull_requests__links_review_comments (#44) to git_testpull_request__links_review_comments (#43)
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_ab1.sql from git-testcommits
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_ab2.sql from git-testcommits
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_ab3.sql from git-testcommits
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testcommits.sql from git-testcommits
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testprojects_ab1.sql from git-testprojects
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testprojects_ab2.sql from git-testprojects
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testprojects_ab3.sql from git-testprojects
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testprojects.sql from git-testprojects
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests_ab1.sql from git-testpull_requests
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests_ab2.sql from git-testpull_requests
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests_ab3.sql from git-testpull_requests
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testpull_requests.sql from git-testpull_requests
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_ab1.sql from git-testcommits/commit
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_ab2.sql from git-testcommits/commit
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_ab3.sql from git-testcommits/commit
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testcommits_commit.sql from git-testcommits/commit
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_parents_ab1.sql from git-testcommits/parents
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_parents_ab2.sql from git-testcommits/parents
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_parents_ab3.sql from git-testcommits/parents
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testcommits_parents.sql from git-testcommits/parents
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests_base_ab1.sql from git-testpull_requests/base
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests_base_ab2.sql from git-testpull_requests/base
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests_base_ab3.sql from git-testpull_requests/base
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testpull_requests_base.sql from git-testpull_requests/base
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests_head_ab1.sql from git-testpull_requests/head
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests_head_ab2.sql from git-testpull_requests/head
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests_head_ab3.sql from git-testpull_requests/head
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testpull_requests_head.sql from git-testpull_requests/head
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests_user_ab1.sql from git-testpull_requests/user
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests_user_ab2.sql from git-testpull_requests/user
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests_user_ab3.sql from git-testpull_requests/user
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testpull_requests_user.sql from git-testpull_requests/user
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_ab1.sql from git-testpull_requests/_links
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_ab2.sql from git-testpull_requests/_links
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_ab3.sql from git-testpull_requests/_links
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testpull_requests__links.sql from git-testpull_requests/_links
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Ignoring stream 'labels' from git-testpull_requests/labels because properties list is empty
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Ignoring stream 'assignees' from git-testpull_requests/assignees because properties list is empty
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Ignoring stream 'requested_teams' from git-testpull_requests/requested_teams because properties list is empty
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Ignoring stream 'requested_reviewers' from git-testpull_requests/requested_reviewers because properties list is empty
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_tree_ab1.sql from git-testcommits/commit/tree
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_tree_ab2.sql from git-testcommits/commit/tree
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_tree_ab3.sql from git-testcommits/commit/tree
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testcommits_commit_tree.sql from git-testcommits/commit/tree
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_author_ab1.sql from git-testcommits/commit/author
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_author_ab2.sql from git-testcommits/commit/author
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_author_ab3.sql from git-testcommits/commit/author
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testcommits_commit_author.sql from git-testcommits/commit/author
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_committer_ab1.sql from git-testcommits/commit/committer
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_committer_ab2.sql from git-testcommits/commit/committer
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_committer_ab3.sql from git-testcommits/commit/committer
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testcommits_commit_committer.sql from git-testcommits/commit/committer
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_verification_ab1.sql from git-testcommits/commit/verification
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_verification_ab2.sql from git-testcommits/commit/verification
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testcommits_commit_verification_ab3.sql from git-testcommits/commit/verification
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testcommits_commit_verification.sql from git-testcommits/commit/verification
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_html_ab1.sql from git-testpull_requests/_links/html
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_html_ab2.sql from git-testpull_requests/_links/html
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_html_ab3.sql from git-testpull_requests/_links/html
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testpull_requests__links_html.sql from git-testpull_requests/_links/html
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_self_ab1.sql from git-testpull_requests/_links/self
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_self_ab2.sql from git-testpull_requests/_links/self
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_self_ab3.sql from git-testpull_requests/_links/self
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testpull_requests__links_self.sql from git-testpull_requests/_links/self
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_issue_ab1.sql from git-testpull_requests/_links/issue
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_issue_ab2.sql from git-testpull_requests/_links/issue
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_issue_ab3.sql from git-testpull_requests/_links/issue
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testpull_requests__links_issue.sql from git-testpull_requests/_links/issue
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_commits_ab1.sql from git-testpull_requests/_links/commits
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_commits_ab2.sql from git-testpull_requests/_links/commits
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_commits_ab3.sql from git-testpull_requests/_links/commits
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testpull_requests__links_commits.sql from git-testpull_requests/_links/commits
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_comments_ab1.sql from git-testpull_requests/_links/comments
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_comments_ab2.sql from git-testpull_requests/_links/comments
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_comments_ab3.sql from git-testpull_requests/_links/comments
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testpull_requests__links_comments.sql from git-testpull_requests/_links/comments
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_statuses_ab1.sql from git-testpull_requests/_links/statuses
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_statuses_ab2.sql from git-testpull_requests/_links/statuses
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_statuses_ab3.sql from git-testpull_requests/_links/statuses
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testpull_requests__links_statuses.sql from git-testpull_requests/_links/statuses
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_review_comment_ab1.sql from git-testpull_requests/_links/review_comment
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_review_comment_ab2.sql from git-testpull_requests/_links/review_comment
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_requests__links_review_comment_ab3.sql from git-testpull_requests/_links/review_comment
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testpull_requests__links_review_comment.sql from git-testpull_requests/_links/review_comment
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_request__links_review_comments_ab1.sql from git-testpull_requests/_links/review_comments
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_request__links_review_comments_ab2.sql from git-testpull_requests/_links/review_comments
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_ctes/github/git_testpull_request__links_review_comments_ab3.sql from git-testpull_requests/_links/review_comments
2021-08-18 13:49:46 INFO () LineGobbler(voidCall):85 -   Generating airbyte_tables/github/git_testpull_request__links_review_comments.sql from git-testpull_requests/_links/review_comments
2021-08-18 13:49:47 INFO () LineGobbler(voidCall):85 - Running with dbt=0.19.0
2021-08-18 13:49:49 INFO () LineGobbler(voidCall):85 - [�[33mWARNING�[0m]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
2021-08-18 13:49:49 INFO () LineGobbler(voidCall):85 - There are 1 unused configuration paths:
2021-08-18 13:49:49 INFO () LineGobbler(voidCall):85 - - models.airbyte_utils.generated.airbyte_views
2021-08-18 13:49:49 INFO () LineGobbler(voidCall):85 - 
2021-08-18 13:49:50 INFO () LineGobbler(voidCall):85 - Found 84 models, 0 tests, 0 snapshots, 0 analyses, 381 macros, 0 operations, 0 seed files, 3 sources, 0 exposures
2021-08-18 13:49:50 INFO () LineGobbler(voidCall):85 - 
2021-08-18 13:49:52 INFO () LineGobbler(voidCall):85 - 13:49:52 | Concurrency: 32 threads (target='prod')
2021-08-18 13:49:52 INFO () LineGobbler(voidCall):85 - 13:49:52 | 
2021-08-18 13:49:52 INFO () LineGobbler(voidCall):85 - 13:49:52 | 1 of 21 START table model github.git_testprojects............................................................ [RUN]
2021-08-18 13:49:52 INFO () LineGobbler(voidCall):85 - 13:49:52 | 2 of 21 START table model github.git_testcommits............................................................. [RUN]
2021-08-18 13:49:52 INFO () LineGobbler(voidCall):85 - 13:49:52 | 3 of 21 START table model github.git_testpull_requests....................................................... [RUN]
2021-08-18 13:49:52 INFO () LineGobbler(voidCall):85 - 13:49:52 | 1 of 21 OK created table model github.git_testprojects....................................................... [�[32mSELECT 0�[0m in 0.33s]
2021-08-18 13:49:52 INFO () LineGobbler(voidCall):85 - 13:49:52 | 3 of 21 OK created table model github.git_testpull_requests.................................................. [�[32mSELECT 0�[0m in 0.30s]
2021-08-18 13:49:52 INFO () LineGobbler(voidCall):85 - 13:49:52 | 4 of 21 START table model github.git_testpull_requests_base.................................................. [RUN]
2021-08-18 13:49:52 INFO () LineGobbler(voidCall):85 - 13:49:52 | 5 of 21 START table model github.git_testpull_requests__links................................................ [RUN]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:52 | 6 of 21 START table model github.git_testpull_requests_head.................................................. [RUN]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 7 of 21 START table model github.git_testpull_requests_user.................................................. [RUN]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 4 of 21 OK created table model github.git_testpull_requests_base............................................. [�[32mSELECT 0�[0m in 0.30s]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 5 of 21 OK created table model github.git_testpull_requests__links........................................... [�[32mSELECT 0�[0m in 0.30s]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 7 of 21 OK created table model github.git_testpull_requests_user............................................. [�[32mSELECT 0�[0m in 0.37s]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 6 of 21 OK created table model github.git_testpull_requests_head............................................. [�[32mSELECT 0�[0m in 0.39s]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 8 of 21 START table model github.git_testpull_request__links_review_comments................................. [RUN]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 9 of 21 START table model github.git_testpull_requests__links_commits........................................ [RUN]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 10 of 21 START table model github.git_testpull_requests__links_comments...................................... [RUN]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 11 of 21 START table model github.git_testpull_requests__links_html.......................................... [RUN]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 2 of 21 OK created table model github.git_testcommits........................................................ [�[32mSELECT 19784�[0m in 1.29s]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 12 of 21 START table model github.git_testpull_requests__links_issue......................................... [RUN]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 13 of 21 START table model github.git_testpull_requests__links_review_comment................................ [RUN]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 14 of 21 START table model github.git_testpull_requests__links_self.......................................... [RUN]
2021-08-18 13:49:53 INFO () LineGobbler(voidCall):85 - 13:49:53 | 15 of 21 START table model github.git_testpull_requests__links_statuses...................................... [RUN]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 16 of 21 START table model github.git_testcommits_parents.................................................... [RUN]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 17 of 21 START table model github.git_testcommits_commit..................................................... [RUN]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 8 of 21 OK created table model github.git_testpull_request__links_review_comments............................ [�[32mSELECT 0�[0m in 0.57s]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 9 of 21 OK created table model github.git_testpull_requests__links_commits................................... [�[32mSELECT 0�[0m in 0.57s]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 10 of 21 OK created table model github.git_testpull_requests__links_comments................................. [�[32mSELECT 0�[0m in 0.56s]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 12 of 21 OK created table model github.git_testpull_requests__links_issue.................................... [�[32mSELECT 0�[0m in 0.55s]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 11 of 21 OK created table model github.git_testpull_requests__links_html..................................... [�[32mSELECT 0�[0m in 0.57s]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 14 of 21 OK created table model github.git_testpull_requests__links_self..................................... [�[32mSELECT 0�[0m in 0.53s]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 13 of 21 OK created table model github.git_testpull_requests__links_review_comment........................... [�[32mSELECT 0�[0m in 0.54s]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 15 of 21 OK created table model github.git_testpull_requests__links_statuses................................. [�[32mSELECT 0�[0m in 0.53s]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 16 of 21 OK created table model github.git_testcommits_parents............................................... [�[32mSELECT 23257�[0m in 0.39s]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 17 of 21 OK created table model github.git_testcommits_commit................................................ [�[32mSELECT 19784�[0m in 0.58s]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 18 of 21 START table model github.git_testcommits_commit_author.............................................. [RUN]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 19 of 21 START table model github.git_testcommits_commit_committer........................................... [RUN]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 20 of 21 START table model github.git_testcommits_commit_tree................................................ [RUN]
2021-08-18 13:49:54 INFO () LineGobbler(voidCall):85 - 13:49:54 | 21 of 21 START table model github.git_testcommits_commit_verification........................................ [RUN]
2021-08-18 13:49:55 INFO () LineGobbler(voidCall):85 - 13:49:55 | 20 of 21 OK created table model github.git_testcommits_commit_tree........................................... [�[32mSELECT 19784�[0m in 0.63s]
2021-08-18 13:49:55 INFO () LineGobbler(voidCall):85 - 13:49:55 | 18 of 21 OK created table model github.git_testcommits_commit_author......................................... [�[32mSELECT 19784�[0m in 0.71s]
2021-08-18 13:49:55 INFO () LineGobbler(voidCall):85 - 13:49:55 | 21 of 21 OK created table model github.git_testcommits_commit_verification................................... [�[32mSELECT 19784�[0m in 0.68s]
2021-08-18 13:49:55 INFO () LineGobbler(voidCall):85 - 13:49:55 | 19 of 21 OK created table model github.git_testcommits_commit_committer...................................... [�[32mSELECT 19784�[0m in 0.72s]
2021-08-18 13:49:55 INFO () LineGobbler(voidCall):85 - 13:49:55 | 
2021-08-18 13:49:55 INFO () LineGobbler(voidCall):85 - 13:49:55 | Finished running 21 table models in 5.34s.
2021-08-18 13:49:55 INFO () LineGobbler(voidCall):85 - 
2021-08-18 13:49:55 INFO () LineGobbler(voidCall):85 - �[32mCompleted successfully�[0m
2021-08-18 13:49:55 INFO () LineGobbler(voidCall):85 - 
2021-08-18 13:49:55 INFO () LineGobbler(voidCall):85 - Done. PASS=21 WARN=0 ERROR=0 SKIP=0 TOTAL=21
2021-08-18 13:49:56 INFO () EnvConfigs(getEnvOrDefault):302 - WORKER_ENVIRONMENT not found or empty, defaulting to DOCKER
2021-08-18 13:49:56 INFO () DefaultNormalizationWorker(run):77 - Normalization executed in 0.
2021-08-18 13:49:56 INFO () TemporalAttemptExecution(get):133 - Stopping cancellation check scheduling...

Steps to Reproduce

  1. Set up a connection with 500 repos or more
  2. Select commits and pull_requests streams
  3. Try to sync

Are you willing to submit a PR?

No.
@jgtvares jgtvares added the type/bug Something isn't working label Aug 26, 2021
@marcosmarxm
Copy link
Member

This is very strange @jgtvares the only change from 0.1.4 to 0.1.6 was how extract the organization/repositories.

@jgtvares this is happening if you try to sync all the organization right? could you test with a few repos?

@jgtvares
Copy link
Author

Okay @marcosmarxm, I'll give it a try and get back to you!

@danieldiamond
Copy link
Contributor

i think i ran into the same thing. where the UI required the organization (even though i was looking to sync one repo) and by adding the organization, it then sync the entire org (all repos etc.)

@jgtvares
Copy link
Author

@danieldiamond I actually intend to sync the whole organization, this is a feature I've been asking for, but after version 0.1.4 it is failing.
@marcosmarxm Sync works fine with a few repos, but I really want to get all of them. As I mentioned, in version 0.1.4 I can sync the entire organization with no errors.

@sherifnada sherifnada added lang/python area/connectors Connector related issues labels Aug 31, 2021
@sherifnada sherifnada added this to the Connectors, September 3rd milestone Aug 31, 2021
@sherifnada
Copy link
Contributor

@yevhenii-ldv any ideas?

@yevhenii-ldv
Copy link
Contributor

Hello @jgtvares
In your logs, I saw the only error (which is repeated for several repositories) - this is a 409 error.
It is repeated for the following repositories:

  • PasseiDireto/last-student-session-job
  • PasseiDireto/pd-xray-daemon
  • PasseiDireto/poc-test-mobile-detox

I suspect that these repositories may be causing the error, which may very well be empty or somehow incorrect.
Can I ask you to try to create a new Githaub connection and synchronize only one of the above repositories, and tell me about the result of your check?

@yevhenii-ldv yevhenii-ldv self-assigned this Aug 31, 2021
@jgtvares
Copy link
Author

jgtvares commented Aug 31, 2021 •
edited
Loading

@yevhenii-ldv You're right! Those repos are really empty and syncing them alone is raising the same error.
I guess erasing them would do the trick, but I think Airbyte should be able to ignore empty repos.
In a large organization is really easy to forget empty repos here and there. Even if I erase those, the same thing can happen in a few weeks if a new repo is created.
How come version 0.1.4 raises no error? It was handling this exception somehow.

@yevhenii-ldv
Copy link
Contributor

@jgtvares In version 0.1.6, we added processing of HTTP errors, and therefore it may happen that in version 0.1.4 error with empty repositories is still skipped, but in 0.1.6 it is no longer. But I'm working on fixing this situation, the fix is almost ready.

@yevhenii-ldv yevhenii-ldv mentioned this issue Sep 1, 2021
Merged
36 tasks
@jgtvares
Copy link
Author

jgtvares commented Sep 1, 2021

@yevhenii-ldv Thanks a lot!!!

@yevhenii-ldv
Copy link
Contributor

@jgtvares We just merged this fix into master and released a new version of the connector.

Upgrade your connector to version 0.1.9 and get started. To upgrade your connector version, go to the admin panel in the left hand side of the UI, find this connector in the list, and input the latest connector version.

Please let us know if you have any further questions.
Enjoy!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yevhenii-ldv yevhenii-ldv

Labels
area/connectors Connector related issues connectors/source/github connectors/sources-api lang/python type/bug Something isn't working
Projects
None yet
Milestone
Connectors, September 3rd
6 participants
@marcosmarxm @sherifnada @danieldiamond @yevhenii-ldv @jgtvares @igrankova