consumer segfaulting when connecting to test.gcn.nasa.gov

[blaufuss]

Hi

Was trying to listen in on some testing messages I'm trying to generate and send from icecube.* but am having trouble with simply listening to the test instance.

This code
consumer = Consumer(client_id='XXX',
client_secret='XXX',
domain='test.gcn.nasa.gov')

Subscribe to topics and receive alerts

consumer.subscribe(['gcn.classic.text.ICECUBE_ASTROTRACK_BRONZE',
'gcn.classic.text.ICECUBE_ASTROTRACK_GOLD',
'gcn.classic.text.ICECUBE_CASCADE'])
while True:
for message in consumer.consume(timeout=1):
value = message.value()
print(value)

(when using credentials from test.gcn.nasa.gov)
segfaults (backtrace attached)

Similar code, without the "domain" setting and client_* from gcn.nasa.gov has worked fine

This is gcn-kafka 0.3.0, using Homebrew python (Mac OS 13.3.1,Python 3.11.3)

Anything I'm doing wrong?

gcn_kafka_crash.txt

[blaufuss]

tried on a linux box as well, same result, with gdb output;
Starting program: /home/blaufuss/env3/bin/python test.py
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
[Detaching after fork from child process 185623]
[New Thread 0x7ffff529b700 (LWP 185624)]
[New Thread 0x7fffeffff700 (LWP 185625)]
[New Thread 0x7ffff4a9a700 (LWP 185626)]
[New Thread 0x7fffef7fe700 (LWP 185627)]
[New Thread 0x7fffeeffd700 (LWP 185628)]
[New Thread 0x7fffee7fc700 (LWP 185629)]
[New Thread 0x7fffedffb700 (LWP 185630)]

Thread 1 "python" received signal SIGSEGV, Segmentation fault.
0x00007ffff6a72034 in rd_kafka_q_serve_rkmessages ()
from /home/blaufuss/env3/lib/python3.8/site-packages/confluent_kafka/../confluent_kafka.libs/librdkafka-e24e6ccd.so.1

HTH

[lpsinger]

This is due to a known issue in the latest version of librdkafka/confluent-kafka-python: confluentinc/librdkafka#4245

As a workaround, install the previous version of confluent-kafka:

pip install 'confluent-kafka==2.0.2'

[lpsinger]

@blaufuss, as an alternative workaround, you can just update to the latest version of gcn-kafka-python:

pip install --upgrade gcn-kafka

[blaufuss]

Thanks fixed the seg faults.