Brain O’Neill details his first experiments of migrating from using JMS to Kafka in a very interesting architecture involving:
Now, Kafka is fast. When running the Kafka Spout by itself, I easily reproduced Kafka’s claim that you can consume “hundreds of thousands of messages per second”. When I first fired up the topology, things went well for the first minute, but then quickly crashed as the Kafka spout emitted too fast for the Cassandra Bolt to keep up. Even though Cassandra is fast as well, it is still orders of magnitude slower than Kafka.
Original title and link: A Big Data Trifecta: Storm, Kafka and Cassandra ( ©myNoSQL)