Integrating Amazon MSK connect with Amazon MSK
Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a managed service for Apache Kafka. In my previous article …
Blog
Configure Google Workspace as an identity provider for Snowflake SSO
Federated authentication enables your users to connect to Snowflake using secure SSO (single sign-on). With SSO enabled, …
Snowflake object naming conventions
A Snowflake object naming convention is a framework for naming objects in a way that describes what they contain and how …
Monitoring the Kafka consumer lag
Kafka consumer lag gives the offset difference between last produced message and the last consumed message. If the rate …
Create Apache Kafka cluster on Kubernetes using Strimzi and monitor using Prometheus, Grafana
In this article we will see how to create an Apache Kafka cluster on Kubernetes using Strimzi and to monitor Strimzi …
Visualizing Snowpipe usage with dbt and Superset
Snowpipe is Snowflake’s continuous data ingestion service. Snowpipe loads data within minutes after files are …
Stream data from Kafka to Google Cloud Storage(GCS) using Aiven's GCS Sink Connector
In this article we will see how to use Aiven’s GCS Sink Connector for Apache Kafka to stream data from Kafka to …
How to setup dbt for Materialize database with streaming data from Redpanda
Materialize is a streaming database for real-time applications. Materialize accepts input data from a variety of …
How to setup dbt for Materialize database with streaming data from Kafka
Materialize is a streaming database for real-time applications. Materialize accepts input data from a variety of …
Exploring IBM DataStage Next Generation / IBM DataStage on Cloud Pak
DataStage Next Gen is here now. It is fully managed and cloud-ready data integration SaaS offering from IBM built on …