kafka-consumer

The following two places we silently overwrite or ignore user supplied configuration properties for deserializers. For debugging purposes we should emit warnings when we either overwrite or ignore user supplied configuration options.

https://github.com/SourceLabOrg/kafka-webview/blob/master/kafka-webview-ui/src/main/java/org/sourcelab/kafka/webview/ui/manager/kafka/KafkaConsumerFactory.java#L1

We need the option to read from the beginning of a partition. Something along the lines of https://stackoverflow.com/questions/49723182/kafka-consumer-seektobeginning but the parallel consumer does not expose seekToBeginning() or assignment(). Is it possible to expose these or provide an overall wrapper for seekToBeginning()?

• Task batching is a common-pattern that many Decaton users often implement by their own
  • i.e. Batching several tasks of type T to List<T> and process them at once. e.g. when downstream-DB supports batching I/O (which often very efficient)
  • Batch-flushing should be done in time-based and size-based.
• So it's better to provide BatchingProcessor built-in to meet the common needs