Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow users to test sink connectivity #60178

Open
amruss opened this issue Feb 9, 2021 · 1 comment
Open

Allow users to test sink connectivity #60178

amruss opened this issue Feb 9, 2021 · 1 comment
Labels
C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) E-starter Might be suitable for a starter project for new employees or team members.

Comments

@amruss
Copy link
Contributor

amruss commented Feb 9, 2021

Is your feature request related to a problem? Please describe.
Changefeeds can oftentimes run into problems with external systems (network connectivity, brokers opening/closing, etc.) that can cause failure or loss of performance. When this happens it can cause a disruption in service, plus it is hard to debug the source of failure. We should give users the tools to head these problems off early by giving them visibility into the health of their changefeed connection. We should also give SREs the tools to diagnose these problems better.

Describe the solution you'd like
There are several options that have been thrown around here: perhaps a "changefeed ping" that verifies the connectivity to a kafka cluster or cloud sink. We could also surface metrics on network/sink health in the admin console.

Jira issue: CRDB-3195

@amruss amruss added the C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) label Feb 9, 2021
@amruss amruss added the E-starter Might be suitable for a starter project for new employees or team members. label Aug 2, 2021
@jhatcher9999
Copy link
Collaborator

Are we thinking something that would feel like a call to an embedded kcat/kafkacat and show the results?

FYI...this would be particularly helpful in cloud-based deployments (Dedicated/Serverless)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) E-starter Might be suitable for a starter project for new employees or team members.
Projects
None yet
Development

No branches or pull requests

2 participants