Integrating Amazon MSK connect with Amazon MSK
Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a managed service for Apache Kafka. In my previous article …
Kafka
Monitoring the Kafka consumer lag
Kafka consumer lag gives the offset difference between last produced message and the last consumed message. If the rate …
Create Apache Kafka cluster on Kubernetes using Strimzi and monitor using Prometheus, Grafana
In this article we will see how to create an Apache Kafka cluster on Kubernetes using Strimzi and to monitor Strimzi …
Stream data from Kafka to Google Cloud Storage(GCS) using Aiven's GCS Sink Connector
In this article we will see how to use Aiven’s GCS Sink Connector for Apache Kafka to stream data from Kafka to …
How To Stream Data From Kafka To APM Platforms
In this article we will see how to stream data from Kafka to apm platforms like DataDog and New Relic. Code used in this …
How To Stream Data From Kafka To Snowflake Using S3 and Snowpipe
In this article we will see how to stream data from kafka to snowflake using S3 and Snowpipe. Code used in this article …
Building Weather Alert Application using Python, Airflow, Kafka, ksqlDB, Faust and Docker
In this article we will see how to build a simple weather alert application using Python, Airflow, Kafka, ksqlDB, Faust …
Integrating Kafka Connect With Amazon Managed Streaming for Apache Kafka (MSK)
In this article we will see how to integrate Kafka connect with Amazon Managed Streaming for Apache Kafka (MSK). Code …
Snowflake Connector For Kafka
In this article we will see how to use the Snowflake connector to stream data from Kafka to Snowflake. The Snowflake …
Exploring ksqlDB in Docker, headless ksqlDB and ksqlDB in Kubernetes
ksqlDB is built on top of Kafka Streams, a lightweight, powerful Java library for enriching, transforming, and …