COMPACTION

Log compaction. See Enterprise Integration Patterns.

Definition

Compaction — operation that reduces the size of a log by keeping only the latest value for a given key. In EDI, compaction of historical MDNs to keep only one per (payload-id, partner) pair.

Origin

Concept formalised by Kafka log compaction (LinkedIn, 2014); adapted to EDI to limit long-term storage of acknowledgements while preserving the latest known state of each transaction.

Use

An EDI archive store keeps raw payloads for 10 years (audit trail), but compacts intermediate MDNs: only one final MDN per transaction is kept, which cuts storage costs by 60-70 %.

Related

• AUDIT TRAIL — see entry.
• LOOK BACK WINDOW — see entry.
• TRAILING WINDOW — see entry.