Closed
Description
Is your feature request related to a problem? Please describe.
For larger workloads, kafka compression is really important to reduce disk usage on brokers and minimize network traffic.
Describe the solution you'd like
Include a compression.codec option in the kafka sink. Probably just needs to include another option in RdKafkaPropertiesProducer.
Describe alternatives you've considered
No response
Additional context
If that looks good, I can open a PR.