One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)

《Kafka技术内幕》代码

Spark with Scala example projects

End-to-end Kafka Streaming Examples on Databricks with Evolving Avro Schemas.

Samples for using Kafka within Spark Streaming and Akka Actors, Akka Streams

Spark Examples

These are a select few projects related to Big Data Analytics and Management. The projects listed are a combination of both small and big projects but interesting ones.

A working example of Twitter -> Kafka -> Spark Streaming integration by a beginner

Structured Streaming Log Analysis

Data processing ang ingestion backend for ViyaDB based on Spark streaming

Research on legacy and structured streaming with Spark

An ETL application which is written in Quarkus, Spark SQL Streaming, Neo4j and various types of Databases and stores. It also covers the devops frameworks like Jenkins CI/CD, docker and Kubernetes.

Streaming news data from the guardian website and classify the news data into different categories like sports, weather, world news, education etc.

In-Stream final project

Streaming component of the project, which is written with Spark Streaming.

Playstore apps rating analysis - Machine Learning on Bigdata- Loading streaming Data using Kafka and Flume

Near real-time streaming using Apache Spark and Apache Kafka

Project to compare Apache Spark Streaming vs Apache Flink.