Contact Troy-West to arrange a workshop day.
Start
Copyright © 2019 Troy-West, Pty Ltd. Open Sourced under the MIT
License.
- Distributed Systems Consultancy
- Kafka since 0.8.0 (2013)
- Cassandra since 2.0.1 (2013)
- Clojure / Data-Oriented
Today
Presentations
Real Code
Vendor Products
Today
ASK QUESTIONS!
RULES
- 350+ projects
- 200M+ lines of code
- 7000+ committers
- All volunteers
The Log
What every software engineer should know about real-time data's unifying abstraction
--Jay Kreps (read this ^^)
- Append Only
- Sequence of Records
- Naturally Immutable
- Ordered by Time
- ID by Offset
- Ubiquitous
What about High Availability & Linear Scalability?
Replication Factor = 3
Partitions = 6
Partitions = 6
Topic
Partitions = 6, Replication Factor = 3
Consumer Groups
Serdes
Exactly Once
Recap
Local State & Time Series
Processor API (PAPI)
Local State
Kafka Streams
Interactive Queries
Storing State
Is It OK to Store Data in Kafka? -- Jay Kreps
Kafka As:
- The Golden Store of LOG data? Yes!
- The Golden Store of COMPUTED data? Maybe.
KSQL & Kafka Connect
Kvistholt Photography