This story on HackerNoon has a decentralized backup on Sia.
Transaction ID: kEosA2S9-Ju7SH9GS0DhejMcEGBpqKTF8S2_VEcloEw
Cover

How to Authenticate Kafka Using Kerberos (SASL), Spark, and Jupyter Notebook

Written by @artemg | Published on 2021/7/19

TL;DR
How to Authenticate Kafka Using Kerberos (SASL), Spark, and Jupyter Notebook. We want to have permission to read and write Kafka topics. We need to obtain a ticket from Kerbero to access the topic. To get the ticket we have to provide a keytab — authentication file for each user. All these steps have to be done automatically because when we use commands to access Kafka there won’t be an opportunity to show keytab manually. To make Spark do this, we need to specify the right parameters and configurations.

[story continues]


Written by
@artemg
Data Engineer, Teacher and Technical Writer.

Topics and
tags
spark|kafka|kerberos|apache-spark|jupyter-notebook|spark-streaming|pyspark|programming
This story on HackerNoon has a decentralized backup on Sia.
Transaction ID: kEosA2S9-Ju7SH9GS0DhejMcEGBpqKTF8S2_VEcloEw