TL;DR —
How to Authenticate Kafka Using Kerberos (SASL), Spark, and Jupyter Notebook. We want to have permission to read and write Kafka topics. We need to obtain a ticket from Kerbero to access the topic. To get the ticket we have to provide a keytab — authentication file for each user. All these steps have to be done automatically because when we use commands to access Kafka there won’t be an opportunity to show keytab manually. To make Spark do this, we need to specify the right parameters and configurations.
[story continues]
Written by
@artemg
Data Engineer, Teacher and Technical Writer.
Topics and
tags
tags
spark|kafka|kerberos|apache-spark|jupyter-notebook|spark-streaming|pyspark|programming
This story on HackerNoon has a decentralized backup on Sia.
Transaction ID: kEosA2S9-Ju7SH9GS0DhejMcEGBpqKTF8S2_VEcloEw
