Ability to set NodePort IP manually

[andersbogsnes]

I love the new setup for KubeCluster with the in-cluster Scheduler. We have the same usecase of wanting to run Dask jobs on remote K8s cluster from laptops and I pretty much have it running in the static version.

Our blocker for transitioning to KubeCluster is that we need to use Nodeports for accessing the scheduler, but our service accounts aren't allowed to have the "list node" privilege. Is there a way to pass in the IP to use for the scheduler, bypassing the NodePort lookup?

[jacobtomlinson]

There isn't a way to do this currently, but we could definitely add this.

We would need a new config option which would make its way here and set the host instead of doing the lookup.

dask-kubernetes/dask_kubernetes/utils.py

Lines 56 to 57 in 6da9413

	nodes = await core_api.list_node()
	host = nodes.items[0].status.addresses[0].address

Do you have any interest in contributing this?

[andersbogsnes]

Certainly, I'd love to give it a shot!

[jacobtomlinson]

The classic KubeCluster was removed in #890. All users will need to migrate to the Dask Operator. Closing.