VHOL - Building Data-Intensive Applications with Real-Time Data Streaming

Feeling grateful after attending the VHOL event hosted by Snowflake on Building Data Intensive Applications with real-time data streaming.

The event showcased a deployment architecture diagram, with an MSK cluster and a Linux EC2 instance in private subnets of an AWS VPC.

The Kafka producer and Snowpipe streaming data via Kafka Connect, were hosted on the Linux jumphost.

The event highlighted the ingestion of time-series data in JSON format into the Kafka cluster, which was then delivered to a Snowflake table.

The data in the Snowflake table can be analyzed using BI tools like Amazon Quicksight, while real-time visualization can be achieved with AMG and Streamlit.

Stay tuned for the future Quickstart demo that will focus on visualization. #DataStreaming #AWS #Snowflake #DataArchitecture