APACHE-NIFI

Apache open-source visual dataflow for ETL/ELT.

Definition

NiFi uses FlowFiles with attributes and content, Processors (GetFile, PutKafka, EvaluateJsonPath), Connections (back-pressure queue), Process Groups. Cluster mode via Zookeeper. Full provenance tracking for audit. MiNiFi (edge agent) for IoT.

Origin

Created by NSA (NiagaraFiles) in 2006 ; open-sourced Apache in 2014.

Example in context

A NiFi dataflow ingests 1000 EDI files/min via GetSFTP then dispatches to Kafka topics.

Related terms

• Apache Camel — code-first alternative.