Update versions for mega-release. #2846

dhermes · 2016-12-08T23:24:27Z

We want to update

google-cloud-bigquery
google-cloud-datastore
google-cloud-logging
google-cloud-storage
google-cloud-core

And then update google-cloud to re-wrap the latest versions of each.

However, to avoid having packages in google-cloud with conflicting versions of google-cloud-core, we must release all packages.

See also: googleapis/google-cloud-python-happybase#19

dhermes · 2016-12-08T23:45:38Z

@jonparrott I realized I needed patch updates for BigQuery and Language, so there is a teeny commit since you approved. So sorry.

dhermes · 2016-12-08T23:46:46Z

@bjwatson I'd really like to get #2844 in, which requires you giving the 👍 to 1.0.2rc0 so there can be a real-live 1.0.2 /cc @nathanielmanistaatgoogle

Though we may just cut these releases today and say shucks.

dhermes · 2016-12-08T23:50:54Z

BigQuery

git log bigquery-0.22.0..ya-release -- bigquery/

Auth update (Raise ValueError if credentials are not from google-auth #2828) (the first one Switch from oauth2client to google-auth #2726 made it on 0.22.0
Follow-up to #2818, use _to_bytes as intended in BigQuery. #2822: cosmetic internals, not in release

Bigtable

git log --abbrev-commit --pretty=format:"%h %s" 0.21.0..HEAD -- bigtable/

Auth update (Raise ValueError if credentials are not from google-auth #2828) (the first one Switch from oauth2client to google-auth #2726 made it on 0.22.0

Core

$ git log core-0.22.0..ya-release -- core/

Only change is #2828 (and version bump)

Datastore

git log 0.21.0..ya-release -- datastore/

Snippets in docstrings: Converting remaining datastore snippets to doctests #2831, Adding ability to run doctests with datastore system tests. #2738
New auth stuff (ditch oauth2client and nice warning)

DNS

git log --abbrev-commit --pretty=format:"%h %s" 0.21.0..HEAD -- dns/

Switch from oauth2client to google-auth (Switch from oauth2client to google-auth #2726, Raise ValueError if credentials are not from google-auth #2828)

Error Reporting

git log --abbrev-commit --pretty=format:"%h %s" 0.21.0..HEAD -- error_reporting/

Switch from oauth2client to google-auth (Switch from oauth2client to google-auth #2726, Raise ValueError if credentials are not from google-auth #2828)

Natural Language

$ git log language-0.22.0..ya-release -- language/

reveals #2841 is only change in source. The only reason to bump is the core bump, which has #2828

Logging

git log 0.21.0..ya-release -- logging/

Add GAE and GKE fluentd Handlers (Add GAE and GKE fluentd Handlers #2668)
Auth update (Switch from oauth2client to google-auth #2726, Raise ValueError if credentials are not from google-auth #2828)

Monitoring

git log --abbrev-commit --pretty=format:"%h %s" 0.21.0..HEAD -- monitoring/

Switch from oauth2client to google-auth (Switch from oauth2client to google-auth #2726, Raise ValueError if credentials are not from google-auth #2828)

Pub / Sub

git log --abbrev-commit --pretty=format:"%h %s" 0.21.0..HEAD -- pubsub/

Switch from oauth2client to google-auth (Switch from oauth2client to google-auth #2726, Raise ValueError if credentials are not from google-auth #2828)
Upgrading GAPIC deps to 0.14 series. (Upgrading GAPIC deps to 0.14 series. #2795)
Fix double encoding of messages when commit() fails. (Fix double encoding of messages when commit() fails. #2773)
Add gateway timeout to pubsub pull. (Add gateway timeout to pubsub pull #2576)

Resource Manager

git log --abbrev-commit --pretty=format:"%h %s" 0.21.0..HEAD -- resource_manager/

Switch from oauth2client to google-auth (Switch from oauth2client to google-auth #2726, Raise ValueError if credentials are not from google-auth #2828)

Runtime Config

git log --abbrev-commit --pretty=format:"%h %s" 0.21.0..HEAD -- runtimeconfig/

Switch from oauth2client to google-auth (Switch from oauth2client to google-auth #2726, Raise ValueError if credentials are not from google-auth #2828)

Speech

git log --abbrev-commit --pretty=format:"%h %s" 0.21.0..HEAD -- speech/

Switch from oauth2client to google-auth (Switch from oauth2client to google-auth #2726, Raise ValueError if credentials are not from google-auth #2828)
Upgrading GAPIC deps to 0.14 series. (Upgrading GAPIC deps to 0.14 series. #2795)

Storage

git log 0.21.0..ya-release -- storage/

Auth update (Switch from oauth2client to google-auth #2726, Raise ValueError if credentials are not from google-auth #2828)
Fixing bug in Bucket.delete_blobs(). #2811: docs b0rken, not in release

Translate

git log --abbrev-commit --pretty=format:"%h %s" 0.21.0..HEAD -- translate/

Removing support for API_KEY auth in translate. (Removing support for API_KEY auth in translate. #2823)

Vision

git log --abbrev-commit --pretty=format:"%h %s" 0.21.0..HEAD -- vision/

Switch from oauth2client to google-auth. (Switch from oauth2client to google-auth #2726, Raise ValueError if credentials are not from google-auth #2828)
Switch to enums and clean up names. (Switch to enums and clean up names. #2826)
Add loading image from filename. (Add loading image from filename. #2778)
Move emotions to Face class. (Move emotions to Face class. #2782)
Add image.detect() for detecting multiple types. (Add image.detect() for detecting multiple types. #2770)
Fix vision error when no results returned. (Fix vision error when no results returned. #2750)

daspecster · 2016-12-09T01:22:27Z

@dhermes I filled in the notes. LMK if there's anything else I can do to help with this!

dhermes · 2016-12-09T02:01:30Z

@daspecster 0.21.1..HEAD is (probably) the wrong range for most of these. google-cloud was the only thing released at 0.21.1, everything else at 0.21.0 (except for the ones that have already started their own tag family: core-*, bigquery-* and language-*)

daspecster · 2016-12-09T02:39:28Z

@dhermes good call. I updated the notes. There were a few PRs missing from between the 0.21.1.

bjwatson · 2016-12-09T10:44:25Z

@dhermes Sorry for the delay. I was in bad shape yesterday. Doing much better today after lots of sleep.

The grpcio 1.0.2 release looks great, and I'm going to publish (gapic|grpc)-google-cloud-logging-v2 0.9.0 with a Beta development status.

logging/setup.py

@@ -50,13 +50,13 @@


 REQUIREMENTS = [
-    'google-cloud-core >= 0.21.0, < 0.22dev',
+    'google-cloud-core >= 0.22.1, < 0.23dev',
    'gapic-google-cloud-logging-v2 >= 0.14.0, < 0.15dev',


datastore/setup.py

@@ -50,13 +50,13 @@


 REQUIREMENTS = [
-    'google-cloud-core >= 0.21.0, < 0.22dev',
+    'google-cloud-core >= 0.22.1, < 0.23dev',
    'grpcio >= 1.0.0, < 2.0dev',


We want to update - `google-cloud-bigquery` - `google-cloud-datastore` - `google-cloud-logging` - `google-cloud-storage` - `google-cloud-core` And then update `google-cloud` to re-wrap the latest versions of each. However, to avoid having packages in `google-cloud` with conflicting versions of `google-cloud-core`, we must release all packages.

Also upgrading logging from 0.14.x to 0.90.x

dhermes · 2016-12-10T00:59:25Z

OK I just added the grpcio >= 1.0.2 deps and switching to version 0.90 (time travel from 0.14) of logging.

I'm ready to push the big red button?

tseaver · 2016-12-10T01:30:58Z

system-tests failure due to:

Collecting google-cloud-happybase<0.23dev,>=0.22.0 (from google-cloud==0.22.0)
  Could not find a version that satisfies the requirement google-cloud-happybase<0.23dev,>=0.22.0 (from google-cloud==0.22.0) (from versions: 0.20.0, 0.21.0)
No matching distribution found for google-cloud-happybase<0.23dev,>=0.22.0 (from google-cloud==0.22.0)

dhermes · 2016-12-10T17:26:24Z

Yup, same thing happened in googleapis/google-cloud-python-happybase#19, totally expected. Not sure how to resolve in general (I guess I could've pushed a b0rken happybase to PyPI first).

tseaver · 2016-12-10T19:01:55Z

@dhermes Push the button, Max!

tseaver · 2016-12-10T19:02:58Z

It is likely a mistake that google-cloud pulls in google-cloud-happybase.

dhermes · 2016-12-10T19:12:17Z

@tseaver You think so? I did it on purpose when the umbrella came into existence, but maybe shouldn't have?

tseaver · 2016-12-10T19:16:22Z

I think we should treat google-cloud-happybase as a "downstream" project, which a) breaks the cyclic dependency, and b) prevents resurrecting any licensing issue.

dhermes · 2016-12-10T19:17:47Z

SGTM, @jonparrott WDYT?

Also, I just did the following:

git tag 0.22.0
git tag bigquery-0.22.1
git tag bigtable-0.22.0
git tag core-0.22.1
git tag datastore-0.22.0
git tag dns-0.22.0
git tag error-reporting-0.22.0
git tag language-0.22.1
git tag logging-0.22.0
git tag monitoring-0.22.0
git tag pubsub-0.22.0
git tag resource-manager-0.22.0
git tag runtimeconfig-0.22.0
git tag speech-0.22.0
git tag storage-0.22.0
git tag translate-0.22.0
git tag vision-0.22.0

followed by

git push official 0.22.0
git push official bigquery-0.22.1
git push official bigtable-0.22.0
git push official core-0.22.1
git push official datastore-0.22.0
git push official dns-0.22.0
git push official error-reporting-0.22.0
git push official language-0.22.1
git push official logging-0.22.0
git push official monitoring-0.22.0
git push official pubsub-0.22.0
git push official resource-manager-0.22.0
git push official runtimeconfig-0.22.0
git push official speech-0.22.0
git push official storage-0.22.0
git push official translate-0.22.0
git push official vision-0.22.0

Now we'll see if the CircleCI deploy to PyPI works

dhermes · 2016-12-10T19:23:09Z

Here are the tag builds:

0.22.0
bigquery-0.22.1
bigtable-0.22.0
core-0.22.1
datastore-0.22.0
dns-0.22.0
error-reporting-0.22.0 (didn't trigger a build on CircleCI)
language-0.22.1
logging-0.22.0
monitoring-0.22.0
pubsub-0.22.0
resource-manager-0.22.0 (didn't trigger a build on CircleCI)
runtimeconfig-0.22.0
speech-0.22.0
storage-0.22.0
translate-0.22.0
vision-0.22.0

theacodes · 2016-12-10T19:55:35Z

Re: happybase SGTM

…

dhermes · 2016-12-10T20:47:29Z

OK sent #2852.

As for the two builds that didn't trigger, it is indeed I who have the stupid. My regex isn't build to pick them up:

(([a-z]+)-)?([0-9]+)\.([0-9]+)\.([0-9]+)

Similarly, the Python regex doesn't pick it up:

$ CIRCLE_TAG=error-reporting-0.22.0 python scripts/circleci_tagged_pkg.py
Invalid tag name: error-reporting-0.22.0. Expected ^((?P<pkg>[a-z]+)-)?([0-9]+)\.([0-9]+)\.([0-9]+)$

dhermes · 2016-12-10T20:50:44Z

@jonparrott It's worth noting that all of those tag builds were throttled, with the worst waiting an hour to run:

https://circleci.com/gh/GoogleCloudPlatform/google-cloud-python/540#usage-queue/containers/0

On the plus side, it's great that CircleCI tells us how long they were throttled and tells us what builds caused them to get stuck in a queue

dhermes · 2016-12-10T20:59:04Z

OK, for now, I manually finished pushing:

$ cd error_reporting
$ python setup.py sdist bdist_wheel
$ twine upload dist/*
$
$ cd ../resource_manager
$ python setup.py sdist bdist_wheel
$ twine upload dist/*
$
$ cd ..
$ git clone [email protected]:a4e097f2f80fd490b256fc3aa2b4a46b.git
$ cd a4e097f2f80fd490b256fc3aa2b4a46b/
$ python setup.py sdist bdist_wheel
$ twine upload dist/*

dhermes · 2016-12-10T21:31:45Z

I put the prose on some of the releases:

@daspecster or @tseaver can you do the rest?

daspecster · 2016-12-11T03:47:23Z

@dhermes @tseaver I updated the rest I believe.

Update versions for mega-release.

dhermes added the packaging label Dec 8, 2016

dhermes assigned daspecster, tseaver and theacodes Dec 8, 2016

googlebot added the cla: yes This human has signed the Contributor License Agreement. label Dec 8, 2016

theacodes approved these changes Dec 8, 2016

View reviewed changes

bjwatson reviewed Dec 9, 2016

View reviewed changes

dhermes mentioned this pull request Dec 10, 2016

Explicitly putting 1.0.2rc0 lower bound on grpcio. #2844

Closed

dhermes added 3 commits December 9, 2016 16:54

Making sub-minor updates to libraries already on 0.22.x

fafc4e5

Explicitly putting 1.0.2 lower bound on grpcio.

af5cc49

Also upgrading logging from 0.14.x to 0.90.x

dhermes force-pushed the ya-release branch from 9bd050d to af5cc49 Compare December 10, 2016 00:58

dhermes merged commit 920345a into googleapis:master Dec 10, 2016

dhermes deleted the ya-release branch December 10, 2016 17:26

richkadel pushed a commit to richkadel/google-cloud-python that referenced this pull request May 6, 2017

Merge pull request googleapis#2846 from dhermes/ya-release

e146bb9

Update versions for mega-release.

theacodes unassigned daspecster Sep 28, 2018

atulep pushed a commit that referenced this pull request Apr 3, 2023

Merge pull request #2846 from dhermes/ya-release

e59bd7a

Update versions for mega-release.

atulep pushed a commit that referenced this pull request Apr 18, 2023

Merge pull request #2846 from dhermes/ya-release

bd5c896

Update versions for mega-release.

parthea pushed a commit that referenced this pull request Jun 4, 2023

Merge pull request #2846 from dhermes/ya-release

0cead2b

Update versions for mega-release.

parthea pushed a commit that referenced this pull request Jul 6, 2023

Merge pull request #2846 from dhermes/ya-release

2f1b0d4

Update versions for mega-release.

parthea pushed a commit that referenced this pull request Oct 21, 2023

Merge pull request #2846 from dhermes/ya-release

e8a4250

Update versions for mega-release.

parthea pushed a commit that referenced this pull request Oct 21, 2023

Merge pull request #2846 from dhermes/ya-release

6153040

Update versions for mega-release.

parthea pushed a commit that referenced this pull request Oct 21, 2023

Merge pull request #2846 from dhermes/ya-release

35375b1

Update versions for mega-release.

parthea pushed a commit that referenced this pull request Oct 22, 2023

Merge pull request #2846 from dhermes/ya-release

816e658

Update versions for mega-release.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update versions for mega-release. #2846

Update versions for mega-release. #2846

dhermes commented Dec 8, 2016

dhermes commented Dec 8, 2016

dhermes commented Dec 8, 2016

dhermes commented Dec 8, 2016 •

edited by daspecster

Loading

daspecster commented Dec 9, 2016

dhermes commented Dec 9, 2016

daspecster commented Dec 9, 2016

bjwatson commented Dec 9, 2016

This comment was marked as spam.

This comment was marked as spam.

This comment was marked as spam.

This comment was marked as spam.

dhermes commented Dec 10, 2016

tseaver commented Dec 10, 2016

dhermes commented Dec 10, 2016

tseaver commented Dec 10, 2016

tseaver commented Dec 10, 2016

dhermes commented Dec 10, 2016

tseaver commented Dec 10, 2016

dhermes commented Dec 10, 2016

dhermes commented Dec 10, 2016

theacodes commented Dec 10, 2016 via email

dhermes commented Dec 10, 2016

dhermes commented Dec 10, 2016 •

edited

Loading

dhermes commented Dec 10, 2016

dhermes commented Dec 10, 2016 •

edited

Loading

daspecster commented Dec 11, 2016

Update versions for mega-release. #2846

Update versions for mega-release. #2846

Conversation

dhermes commented Dec 8, 2016

dhermes commented Dec 8, 2016

dhermes commented Dec 8, 2016

dhermes commented Dec 8, 2016 • edited by daspecster Loading

BigQuery

Bigtable

Core

Datastore

DNS

Error Reporting

Natural Language

Logging

Monitoring

Pub / Sub

Resource Manager

Runtime Config

Speech

Storage

Translate

Vision

daspecster commented Dec 9, 2016

dhermes commented Dec 9, 2016

daspecster commented Dec 9, 2016

bjwatson commented Dec 9, 2016

This comment was marked as spam.

This comment was marked as spam.

This comment was marked as spam.

This comment was marked as spam.

dhermes commented Dec 10, 2016

tseaver commented Dec 10, 2016

dhermes commented Dec 10, 2016

tseaver commented Dec 10, 2016

tseaver commented Dec 10, 2016

dhermes commented Dec 10, 2016

tseaver commented Dec 10, 2016

dhermes commented Dec 10, 2016

dhermes commented Dec 10, 2016

theacodes commented Dec 10, 2016 via email

dhermes commented Dec 10, 2016

dhermes commented Dec 10, 2016 • edited Loading

dhermes commented Dec 10, 2016

dhermes commented Dec 10, 2016 • edited Loading

daspecster commented Dec 11, 2016

dhermes commented Dec 8, 2016 •

edited by daspecster

Loading

dhermes commented Dec 10, 2016 •

edited

Loading

dhermes commented Dec 10, 2016 •

edited

Loading