Apache Kafka is publish-subscribe messaging rethought as a distributed commit log.

learn more… | top users | synonyms

0
votes
1answer
130 views

Backing up messages in S3 within a Storm topology

In my project we are trying to build up a KIND-of-a-lambda storm based architecture. The component would be responsible for indexing the site usage events so we expect a quite massive random load. The ...
1
vote
0answers
269 views

Apply filter in Kafka Queue

Is it possible to apply a filter on the Kafka stream of topic? What I want to do is filter out messages while consuming and then run some custom logic on top of it. It is a sort of thing that Storm ...
1
vote
2answers
426 views

Kafka, is it possible to get the message offset after producing?

While using Apache Kafka, is it possible to get the offset of the message that has been produced? From the Kafka documentation page it says: each message in the partition are assigned a unique ...