Open source resources for building real-time event-driven services and data pipelines on Kubernetes.

There is a rich ecosystem of open source projects providing event-driven and real-time data infrastructure, including Apache Kafka, Flink, Spark, Pulsar, and many more. Navigating this ecosystem is often difficult, and knowing how to deploy, run, and combine these projects can be daunting.

The goal of StreamsHub is to provide a curated set of projects, templates, tools, and documentation to help infrastructure engineers build services that support event-driven architectures (EDA) on Kubernetes. Where a gap exists in the current open source offering, StreamsHub aims to host a project to fill it, with the goal of contributing solutions upstream where appropriate.

• Console -- A web UI for managing Strimzi-managed Apache Kafka clusters on Kubernetes.
• Flink SQL Runner -- A wrapper for deploying Flink SQL jobs using the Flink Kubernetes Operator.
• Flink SQL Examples -- Tutorials for running Flink SQL on Kubernetes.

• Propose a new project or change: Submit a proposal via the proposals repository.
• Contribute documentation and tutorials: Help improve best-practice guides and tutorials on the StreamsHub website (source).
• Report issues and contribute code: Each project repository welcomes issues and pull requests.
• Governance: Community Governance (code of conduct, voting rules, etc.) is covered in the Governance Repository

The main way to interact officially with the StreamsHub community is via the Proposals repository and Issues/PRs on the relevant project repositories. However, there is a community Slack workspace for more free-form conversations:

Slack Invite Link

The StreamsHub community call is usually held bi-weekly:

• Meetings are scheduled on the StreamsHub Google Calendar: Web / iCal
• Meeting agenda and notes are stored in this Google Doc
• Please add any discussion items to the agenda at least 12 hours before the meeting starts. If there are no agenda items or significant proposals/issues/PRs to discuss, the maintainers reserve the right to cancel the meeting. Cancellations will be announced on the #all-streamshub channel on the community Slack.