Apache MiNiFi (a subproject of Apache NiFi)

Open Source Computer Vision with TensorFlow, MiniFi, Apache NiFi, OpenCV, Apache Tika and Python For processing images from IoT devices like Raspberry Pis, NVidia Jetson TX1, NanoPi Duos and more which are equipped with attached cameras or external USB webcams, we use Python to interface via OpenCV and PiCamera. From there we run image processing at the edge on these IoT device using OpenCV and TensorFlow to determine attributes and image analytics. A pache MiniFi coordinates running these Python scripts and decides when and what to send from that analysis and the image to a remote Apache NiFi server for additional processing. At the Apache NiFi cluster in the cluster it routes the images to one processing path and the JSON encoded metadata to another flow. The JSON data (with it's schema referenced from a central Schema Registry) is routed and routed using Record Processing and SQL, this data in enriched and augment before conversion to AVRO to be send via Apache Kafka to SAM. Streaming Analytics Manager then does deeper processing on this stream and others including weather and twitter to determine what should be done on this data. References https://community.hortonworks.com/articles/103863/using-an-asus-tinkerboard-with-tensorflow-and-pyth.html https://community.hortonworks.com/articles/118132/minifi-capturing-converting-tensorflow-inception-t.html https://github.com/tspannhw/rpi-noir-screen https://community.hortonworks.com/articles/77988/ingest-remote-camera-images-from-raspberry-pi-via.html https://community.hortonworks.com/articles/107379/minifi-for-image-capture-and-ingestion-from-raspbe.html https://community.hortonworks.com/articles/58265/analyzing-images-in-hdf-20-using-tensorflow.html

USB WebCam - Raspberry Pi - Apache MXNet - Movidius - Apache NiFi - MiniFi

MiNiFi Agent Configuration and Scripts for NVidia Jetson Nano device

Edge to AI: IoT

My Talk at IoT Fusion 2018 Philadelphia, PA

Using MiniFi with the Pimoroni Breakout Garden Hat and Sensors

EFM + MiNiFI + Electric + Sensehat + Movidius Intel + Java + Python + NiFi

Log back appender to publish data to a processor with in nifi using site-to-site protocol

MiNiFi Agent with Enviro Plus Sensors

Using SenseHat for Sensor Ingest into Raspberry Pi 3 B+ via Python to Apache NiFi

Strata NYC 2018 Material

Apache NiFi Book

Mm FLaNK Stack (MXNet, MiNiFi, Flink, NiFi, Kafka, Kudu) for AI-IoT

Demos

Second edition of Pimoroni Breakout Garden Hat with I2C and SPI with 0.96 LCD, BMP280, MAX30105

Apache NiFi Flows

minifi

Trying GluonCV examples

MiNiFi

Install Device Scripts, Libraries, Python Libraries and more for AI, IoT and general usage

EDGE2AI workshop featuring CDF and CDSW

Demo 2020

GrovePi + Sensors + MiNiFi = Fun

Edge2AI Workshop

DataWorks Summit 2019 Barcelona Spain

Retail - Dynamic Shelf Pricing

nifi-minifi-coral

MiNiFi for Gas Sensors and Thermal Cameras