Skip to content
This repository has been archived by the owner on Nov 29, 2023. It is now read-only.

Synthesis failed for python-os-config #21

Closed
yoshi-automation opened this issue Oct 10, 2020 · 4 comments
Closed

Synthesis failed for python-os-config #21

yoshi-automation opened this issue Oct 10, 2020 · 4 comments
Assignees
@yoshi-automation
Labels
api: osconfig Issues related to the googleapis/python-os-config API. autosynth failure priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.

Comments

@yoshi-automation
Copy link
Contributor

Hello! Autosynth couldn't regenerate python-os-config. 💔

Here's the output from running synth.py:

anges and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:

  git checkout -b <new-branch-name>

HEAD is now at e0ae456 chore(python): use 'setup.py' to detect repo root (#795)
2020-10-10 05:55:25,309 autosynth [DEBUG] > Running: git branch -f autosynth-543
2020-10-10 05:55:25,313 autosynth [DEBUG] > Running: git checkout autosynth-543
Switched to branch 'autosynth-543'
2020-10-10 05:55:25,318 autosynth [INFO] > Running synthtool
2020-10-10 05:55:25,318 autosynth [INFO] > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']
2020-10-10 05:55:25,318 autosynth [DEBUG] > log_file_path: /tmpfs/src/logs/python-os-config/543/sponge_log.log
2020-10-10 05:55:25,320 autosynth [DEBUG] > Running: /tmpfs/src/github/synthtool/env/bin/python3 -m synthtool --metadata synth.metadata synth.py --
2020-10-10 05:55:25,587 synthtool [DEBUG] > Executing /home/kbuilder/.cache/synthtool/python-os-config/synth.py.
On branch autosynth-543
nothing to commit, working tree clean
2020-10-10 05:55:25,722 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/synthtool
2020-10-10 05:55:25,730 synthtool [DEBUG] > Ensuring dependencies.
2020-10-10 05:55:25,736 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/synthtool
2020-10-10 05:55:25,740 synthtool [DEBUG] > Cloning googleapis.
2020-10-10 05:55:25,740 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/googleapis
2020-10-10 05:55:25,743 synthtool [DEBUG] > Pulling Docker image: gapic-generator-python:latest
latest: Pulling from gapic-images/gapic-generator-python
Digest: sha256:49c51ef3987a158fd364837ed097070218c3127fe19a57b74992097fc1282859
Status: Image is up to date for gcr.io/gapic-images/gapic-generator-python:latest
2020-10-10 05:55:26,604 synthtool [DEBUG] > Generating code for: google/cloud/osconfig/v1.
Traceback (most recent call last):
  File "/usr/local/bin/protoc-gen-python_gapic", line 8, in <module>
    sys.exit(generate())
  File "/usr/local/lib/python3.7/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.7/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/gapic/cli/generate.py", line 63, in generate
    res = generator.Generator(opts).get_response(api_schema, opts)
  File "/usr/local/lib/python3.7/site-packages/gapic/generator/generator.py", line 100, in get_response
    template_name, api_schema=api_schema, opts=opts)
  File "/usr/local/lib/python3.7/site-packages/gapic/generator/generator.py", line 285, in _render_template
    opts=opts,
  File "/usr/local/lib/python3.7/site-packages/gapic/generator/generator.py", line 313, in _get_file
    api=api_schema, opts=opts, **context
  File "/usr/local/lib/python3.7/site-packages/jinja2/environment.py", line 1090, in render
    self.environment.handle_exception()
  File "/usr/local/lib/python3.7/site-packages/jinja2/environment.py", line 832, in handle_exception
    reraise(*rewrite_traceback_stack(source=source))
  File "/usr/local/lib/python3.7/site-packages/jinja2/_compat.py", line 28, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.7/site-packages/gapic/templates/%namespace/%name_%version/%sub/services/%service/async_client.py.j2", line 1, in top-level template code
    {% extends '_base.py.j2' %}
  File "/usr/local/lib/python3.7/site-packages/gapic/templates/_base.py.j2", line 5, in top-level template code
    {%- block content %}
  File "/usr/local/lib/python3.7/site-packages/gapic/templates/%namespace/%name_%version/%sub/services/%service/async_client.py.j2", line 41, in block "content"
    {% for message in service.resource_messages|sort(attribute="resource_type") -%}
  File "/usr/local/lib/python3.7/site-packages/jinja2/environment.py", line 471, in getattr
    return getattr(obj, attribute)
  File "/usr/local/lib/python3.7/site-packages/gapic/utils/cache.py", line 39, in inner
    self._cached_values[fx.__name__] = fx(self)
  File "/usr/local/lib/python3.7/site-packages/gapic/schema/wrappers.py", line 1059, in resource_messages
    for method in self.methods.values()
  File "/usr/local/lib/python3.7/site-packages/gapic/schema/wrappers.py", line 1067, in <genexpr>
    method.lro.response_type if method.lro else method.output
  File "/usr/local/lib/python3.7/site-packages/gapic/schema/wrappers.py", line 1055, in gen_indirect_resources_used
    yield self.visible_resources[resource_type]
  File "/usr/local/lib/python3.7/collections/__init__.py", line 916, in __getitem__
    return self.__missing__(key)            # support subclasses that define __missing__
  File "/usr/local/lib/python3.7/collections/__init__.py", line 908, in __missing__
    raise KeyError(key)
KeyError: 'cloudresourcemanager.googleapis.com/Project'
--python_gapic_out: protoc-gen-python_gapic: Plugin failed with status code 1.
2020-10-10 05:55:27,956 synthtool [ERROR] > Failed executing docker run --mount type=bind,source=/home/kbuilder/.cache/synthtool/googleapis/google/cloud/osconfig/v1/,destination=/in/google/cloud/osconfig/v1/,readonly --mount type=bind,source=/tmpfs/tmp/tmp450huhep/,destination=/out/ --rm --user 1000 gcr.io/gapic-images/gapic-generator-python:latest:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-os-config/synth.py", line 29, in <module>
    "osconfig", "v1"
  File "/tmpfs/src/github/synthtool/synthtool/gcp/gapic_microgenerator.py", line 57, in py_library
    return self._generate_code(service, version, "python", **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/gcp/gapic_microgenerator.py", line 189, in _generate_code
    shell.run(docker_run_args, hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker', 'run', '--mount', 'type=bind,source=/home/kbuilder/.cache/synthtool/googleapis/google/cloud/osconfig/v1/,destination=/in/google/cloud/osconfig/v1/,readonly', '--mount', 'type=bind,source=/tmpfs/tmp/tmp450huhep/,destination=/out/', '--rm', '--user', '1000', 'gcr.io/gapic-images/gapic-generator-python:latest']' returned non-zero exit status 1.
2020-10-10 05:55:28,019 autosynth [ERROR] > Synthesis failed
2020-10-10 05:55:28,019 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at c07e6d1 chore: add default CODEOWNERS (#20)
2020-10-10 05:55:28,025 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-10-10 05:55:28,029 autosynth [DEBUG] > Running: git clean -fdx
Removing __pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 706, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 541, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 686, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 375, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 273, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.
@yoshi-automation yoshi-automation added priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. autosynth failure labels Oct 10, 2020
@product-auto-label product-auto-label bot added the api: osconfig Issues related to the googleapis/python-os-config API. label Oct 10, 2020
@yoshi-automation
Copy link
Contributor Author

Autosynth is still having trouble generating python-os-config. 😭

Here's the output from running synth.py:

anges and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:

  git checkout -b <new-branch-name>

HEAD is now at e0ae456 chore(python): use 'setup.py' to detect repo root (#795)
2020-10-11 05:51:44,554 autosynth [DEBUG] > Running: git branch -f autosynth-543
2020-10-11 05:51:44,557 autosynth [DEBUG] > Running: git checkout autosynth-543
Switched to branch 'autosynth-543'
2020-10-11 05:51:44,561 autosynth [INFO] > Running synthtool
2020-10-11 05:51:44,562 autosynth [INFO] > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']
2020-10-11 05:51:44,562 autosynth [DEBUG] > log_file_path: /tmpfs/src/logs/python-os-config/543/sponge_log.log
2020-10-11 05:51:44,563 autosynth [DEBUG] > Running: /tmpfs/src/github/synthtool/env/bin/python3 -m synthtool --metadata synth.metadata synth.py --
2020-10-11 05:51:44,814 synthtool [DEBUG] > Executing /home/kbuilder/.cache/synthtool/python-os-config/synth.py.
On branch autosynth-543
nothing to commit, working tree clean
2020-10-11 05:51:44,937 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/synthtool
2020-10-11 05:51:44,945 synthtool [DEBUG] > Ensuring dependencies.
2020-10-11 05:51:44,950 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/synthtool
2020-10-11 05:51:44,954 synthtool [DEBUG] > Cloning googleapis.
2020-10-11 05:51:44,954 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/googleapis
2020-10-11 05:51:44,957 synthtool [DEBUG] > Pulling Docker image: gapic-generator-python:latest
latest: Pulling from gapic-images/gapic-generator-python
Digest: sha256:49c51ef3987a158fd364837ed097070218c3127fe19a57b74992097fc1282859
Status: Image is up to date for gcr.io/gapic-images/gapic-generator-python:latest
2020-10-11 05:51:45,806 synthtool [DEBUG] > Generating code for: google/cloud/osconfig/v1.
Traceback (most recent call last):
  File "/usr/local/bin/protoc-gen-python_gapic", line 8, in <module>
    sys.exit(generate())
  File "/usr/local/lib/python3.7/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.7/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/gapic/cli/generate.py", line 63, in generate
    res = generator.Generator(opts).get_response(api_schema, opts)
  File "/usr/local/lib/python3.7/site-packages/gapic/generator/generator.py", line 100, in get_response
    template_name, api_schema=api_schema, opts=opts)
  File "/usr/local/lib/python3.7/site-packages/gapic/generator/generator.py", line 285, in _render_template
    opts=opts,
  File "/usr/local/lib/python3.7/site-packages/gapic/generator/generator.py", line 313, in _get_file
    api=api_schema, opts=opts, **context
  File "/usr/local/lib/python3.7/site-packages/jinja2/environment.py", line 1090, in render
    self.environment.handle_exception()
  File "/usr/local/lib/python3.7/site-packages/jinja2/environment.py", line 832, in handle_exception
    reraise(*rewrite_traceback_stack(source=source))
  File "/usr/local/lib/python3.7/site-packages/jinja2/_compat.py", line 28, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.7/site-packages/gapic/templates/%namespace/%name_%version/%sub/services/%service/async_client.py.j2", line 1, in top-level template code
    {% extends '_base.py.j2' %}
  File "/usr/local/lib/python3.7/site-packages/gapic/templates/_base.py.j2", line 5, in top-level template code
    {%- block content %}
  File "/usr/local/lib/python3.7/site-packages/gapic/templates/%namespace/%name_%version/%sub/services/%service/async_client.py.j2", line 41, in block "content"
    {% for message in service.resource_messages|sort(attribute="resource_type") -%}
  File "/usr/local/lib/python3.7/site-packages/jinja2/environment.py", line 471, in getattr
    return getattr(obj, attribute)
  File "/usr/local/lib/python3.7/site-packages/gapic/utils/cache.py", line 39, in inner
    self._cached_values[fx.__name__] = fx(self)
  File "/usr/local/lib/python3.7/site-packages/gapic/schema/wrappers.py", line 1059, in resource_messages
    for method in self.methods.values()
  File "/usr/local/lib/python3.7/site-packages/gapic/schema/wrappers.py", line 1067, in <genexpr>
    method.lro.response_type if method.lro else method.output
  File "/usr/local/lib/python3.7/site-packages/gapic/schema/wrappers.py", line 1055, in gen_indirect_resources_used
    yield self.visible_resources[resource_type]
  File "/usr/local/lib/python3.7/collections/__init__.py", line 916, in __getitem__
    return self.__missing__(key)            # support subclasses that define __missing__
  File "/usr/local/lib/python3.7/collections/__init__.py", line 908, in __missing__
    raise KeyError(key)
KeyError: 'cloudresourcemanager.googleapis.com/Project'
--python_gapic_out: protoc-gen-python_gapic: Plugin failed with status code 1.
2020-10-11 05:51:47,080 synthtool [ERROR] > Failed executing docker run --mount type=bind,source=/home/kbuilder/.cache/synthtool/googleapis/google/cloud/osconfig/v1/,destination=/in/google/cloud/osconfig/v1/,readonly --mount type=bind,source=/tmpfs/tmp/tmp4lro1w3c/,destination=/out/ --rm --user 1000 gcr.io/gapic-images/gapic-generator-python:latest:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-os-config/synth.py", line 29, in <module>
    "osconfig", "v1"
  File "/tmpfs/src/github/synthtool/synthtool/gcp/gapic_microgenerator.py", line 57, in py_library
    return self._generate_code(service, version, "python", **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/gcp/gapic_microgenerator.py", line 189, in _generate_code
    shell.run(docker_run_args, hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker', 'run', '--mount', 'type=bind,source=/home/kbuilder/.cache/synthtool/googleapis/google/cloud/osconfig/v1/,destination=/in/google/cloud/osconfig/v1/,readonly', '--mount', 'type=bind,source=/tmpfs/tmp/tmp4lro1w3c/,destination=/out/', '--rm', '--user', '1000', 'gcr.io/gapic-images/gapic-generator-python:latest']' returned non-zero exit status 1.
2020-10-11 05:51:47,132 autosynth [ERROR] > Synthesis failed
2020-10-11 05:51:47,132 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at c07e6d1 chore: add default CODEOWNERS (#20)
2020-10-11 05:51:47,137 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-10-11 05:51:47,142 autosynth [DEBUG] > Running: git clean -fdx
Removing __pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 706, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 541, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 686, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 375, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 273, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

@yoshi-automation
Copy link
Contributor Author

Autosynth is still having trouble generating python-os-config. 😭

Here's the output from running synth.py:

anges and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:

  git checkout -b <new-branch-name>

HEAD is now at e0ae456 chore(python): use 'setup.py' to detect repo root (#795)
2020-10-12 05:55:55,408 autosynth [DEBUG] > Running: git branch -f autosynth-543
2020-10-12 05:55:55,412 autosynth [DEBUG] > Running: git checkout autosynth-543
Switched to branch 'autosynth-543'
2020-10-12 05:55:55,417 autosynth [INFO] > Running synthtool
2020-10-12 05:55:55,417 autosynth [INFO] > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']
2020-10-12 05:55:55,417 autosynth [DEBUG] > log_file_path: /tmpfs/src/logs/python-os-config/543/sponge_log.log
2020-10-12 05:55:55,419 autosynth [DEBUG] > Running: /tmpfs/src/github/synthtool/env/bin/python3 -m synthtool --metadata synth.metadata synth.py --
2020-10-12 05:55:55,684 synthtool [DEBUG] > Executing /home/kbuilder/.cache/synthtool/python-os-config/synth.py.
On branch autosynth-543
nothing to commit, working tree clean
2020-10-12 05:55:55,813 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/synthtool
2020-10-12 05:55:55,822 synthtool [DEBUG] > Ensuring dependencies.
2020-10-12 05:55:55,827 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/synthtool
2020-10-12 05:55:55,831 synthtool [DEBUG] > Cloning googleapis.
2020-10-12 05:55:55,831 synthtool [DEBUG] > Using precloned repo /home/kbuilder/.cache/synthtool/googleapis
2020-10-12 05:55:55,835 synthtool [DEBUG] > Pulling Docker image: gapic-generator-python:latest
latest: Pulling from gapic-images/gapic-generator-python
Digest: sha256:49c51ef3987a158fd364837ed097070218c3127fe19a57b74992097fc1282859
Status: Image is up to date for gcr.io/gapic-images/gapic-generator-python:latest
2020-10-12 05:55:56,692 synthtool [DEBUG] > Generating code for: google/cloud/osconfig/v1.
Traceback (most recent call last):
  File "/usr/local/bin/protoc-gen-python_gapic", line 8, in <module>
    sys.exit(generate())
  File "/usr/local/lib/python3.7/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.7/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.7/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/gapic/cli/generate.py", line 63, in generate
    res = generator.Generator(opts).get_response(api_schema, opts)
  File "/usr/local/lib/python3.7/site-packages/gapic/generator/generator.py", line 100, in get_response
    template_name, api_schema=api_schema, opts=opts)
  File "/usr/local/lib/python3.7/site-packages/gapic/generator/generator.py", line 285, in _render_template
    opts=opts,
  File "/usr/local/lib/python3.7/site-packages/gapic/generator/generator.py", line 313, in _get_file
    api=api_schema, opts=opts, **context
  File "/usr/local/lib/python3.7/site-packages/jinja2/environment.py", line 1090, in render
    self.environment.handle_exception()
  File "/usr/local/lib/python3.7/site-packages/jinja2/environment.py", line 832, in handle_exception
    reraise(*rewrite_traceback_stack(source=source))
  File "/usr/local/lib/python3.7/site-packages/jinja2/_compat.py", line 28, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.7/site-packages/gapic/templates/%namespace/%name_%version/%sub/services/%service/async_client.py.j2", line 1, in top-level template code
    {% extends '_base.py.j2' %}
  File "/usr/local/lib/python3.7/site-packages/gapic/templates/_base.py.j2", line 5, in top-level template code
    {%- block content %}
  File "/usr/local/lib/python3.7/site-packages/gapic/templates/%namespace/%name_%version/%sub/services/%service/async_client.py.j2", line 41, in block "content"
    {% for message in service.resource_messages|sort(attribute="resource_type") -%}
  File "/usr/local/lib/python3.7/site-packages/jinja2/environment.py", line 471, in getattr
    return getattr(obj, attribute)
  File "/usr/local/lib/python3.7/site-packages/gapic/utils/cache.py", line 39, in inner
    self._cached_values[fx.__name__] = fx(self)
  File "/usr/local/lib/python3.7/site-packages/gapic/schema/wrappers.py", line 1059, in resource_messages
    for method in self.methods.values()
  File "/usr/local/lib/python3.7/site-packages/gapic/schema/wrappers.py", line 1067, in <genexpr>
    method.lro.response_type if method.lro else method.output
  File "/usr/local/lib/python3.7/site-packages/gapic/schema/wrappers.py", line 1055, in gen_indirect_resources_used
    yield self.visible_resources[resource_type]
  File "/usr/local/lib/python3.7/collections/__init__.py", line 916, in __getitem__
    return self.__missing__(key)            # support subclasses that define __missing__
  File "/usr/local/lib/python3.7/collections/__init__.py", line 908, in __missing__
    raise KeyError(key)
KeyError: 'cloudresourcemanager.googleapis.com/Project'
--python_gapic_out: protoc-gen-python_gapic: Plugin failed with status code 1.
2020-10-12 05:55:57,984 synthtool [ERROR] > Failed executing docker run --mount type=bind,source=/home/kbuilder/.cache/synthtool/googleapis/google/cloud/osconfig/v1/,destination=/in/google/cloud/osconfig/v1/,readonly --mount type=bind,source=/tmpfs/tmp/tmpk6qsioss/,destination=/out/ --rm --user 1000 gcr.io/gapic-images/gapic-generator-python:latest:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-os-config/synth.py", line 29, in <module>
    "osconfig", "v1"
  File "/tmpfs/src/github/synthtool/synthtool/gcp/gapic_microgenerator.py", line 57, in py_library
    return self._generate_code(service, version, "python", **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/gcp/gapic_microgenerator.py", line 189, in _generate_code
    shell.run(docker_run_args, hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['docker', 'run', '--mount', 'type=bind,source=/home/kbuilder/.cache/synthtool/googleapis/google/cloud/osconfig/v1/,destination=/in/google/cloud/osconfig/v1/,readonly', '--mount', 'type=bind,source=/tmpfs/tmp/tmpk6qsioss/,destination=/out/', '--rm', '--user', '1000', 'gcr.io/gapic-images/gapic-generator-python:latest']' returned non-zero exit status 1.
2020-10-12 05:55:58,042 autosynth [ERROR] > Synthesis failed
2020-10-12 05:55:58,043 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at c07e6d1 chore: add default CODEOWNERS (#20)
2020-10-12 05:55:58,048 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-10-12 05:55:58,052 autosynth [DEBUG] > Running: git clean -fdx
Removing __pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 706, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 541, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 686, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 375, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 273, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

@software-dov
Copy link

This is a known bug that should be fixed by googleapis/gapic-generator-python#650 . The release stalled over the weekend due to CircleCI shenanigans, but it should be back up soon.

@yoshi-automation
Copy link
Contributor Author

Autosynth passed, closing! 💚

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@yoshi-automation yoshi-automation

Labels
api: osconfig Issues related to the googleapis/python-os-config API. autosynth failure priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@software-dov @yoshi-automation