Write xgboost_synthetic test output to html

[gabrielwen]

Write testing notebook to GCS:

https://pantheon.corp.google.com/storage/browser/kubeflow-ci-deployment/xgboost_synthetic_testing?project=kubeflow-ci-deployment

Related: kubeflow/manifests#757

---

This change is 

[jlewi]

@gabrielwen this is great. Instead of writing it to a bucket in kubeflow-ci-deployment; could we write it to the GCS location used by prow for results so that it shows up in spyglass?

1. Here's the spyglass results for the most recent presubmit run
2. I'd like to click on artifacts and see the HTML file there.

You can use this function to get the gcs_dir for the results based on the environment variables that prow sets.
https://github.com/kubeflow/testing/blob/43b78260019e15be19a29800a88fa63a6e132bae/py/kubeflow/testing/prow_artifacts.py#L110

[gabrielwen]

@gabrielwen this is great. Instead of writing it to a bucket in kubeflow-ci-deployment; could we write it to the GCS location used by prow for results so that it shows up in spyglass?

1. Here's the spyglass results for the most recent presubmit run
2. I'd like to click on artifacts and see the HTML file there.

You can use this function to get the gcs_dir for the results based on the environment variables that prow sets.
https://github.com/kubeflow/testing/blob/43b78260019e15be19a29800a88fa63a6e132bae/py/kubeflow/testing/prow_artifacts.py#L110

seems like the pod running execute_notebook doesn't have permission to write to that GCS bucket. let me see how to make this work.

[jlewi]

@gabrielwen the pod that's running the pytest (i.e. that launches the K8s job) should have permission to write to kubernetes-jenkins. So that pod could copy it from the GCS location that execute_notebook writes to.

[gabrielwen]

@gabrielwen the pod that's running the pytest (i.e. that launches the K8s job) should have permission to write to kubernetes-jenkins. So that pod could copy it from the GCS location that execute_notebook writes to.

right, that's exactly I'm trying to do.

[jlewi]

@gabrielwen let me know when this is ready for another review?

[gabrielwen]

@jlewi

ok, it's just ready for another look:
https://storage.googleapis.com/kubernetes-jenkins/pr-logs/pull/kubeflow_examples/735/kubeflow-examples-presubmit/1228467199899865088/artifacts/junit_kubeflow-examples-presubmit-notebooks-735-09045fb-5088-7a30/xgboost-synthetic-test-notebooks/notebook.html

[jlewi]

/lgtm
/approve

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jlewi

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [jlewi]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment