Dataflow-rs

A high-performance rules engine for IFTTT-style automation in Rust with zero-overhead JSONLogic evaluation.

Dataflow-rs is a lightweight, embeddable rules engine that lets you define IF → THEN → THAT automation in JSON. Rules are evaluated using pre-compiled JSONLogic for zero runtime overhead, and actions execute asynchronously for high throughput.

Whether you’re routing events, validating data, building REST APIs, or creating automation pipelines, Dataflow-rs provides enterprise-grade performance with minimal complexity.

⚡ Blazing Fast Performance

Dataflow-rs is built for high-throughput hot paths. By pre-compiling all JSONLogic expressions at startup, execution runs with zero runtime allocations or JSON parsing overhead. On a 10-core machine, the multi-threaded release benchmark yields:

• Throughput: ~640,000 messages/sec
• Median (P50) Latency: 6 μs
• Tail (P99) Latency: 51 μs
• Tail (P99.9) Latency: 93 μs

🧩 Why Choose dataflow-rs?

If you need dynamic business rules or user-customizable workflows, writing hardcoded if/else checks makes your codebase rigid, while running heavy workflow orchestrators (like Temporal or Zeebe) adds complex infrastructure dependencies and milliseconds of database/network latency. Dataflow-rs gives you the best of both worlds:

Key Features

• IF → THEN → THAT Model - Define rules with JSONLogic conditions, execute actions, chain with priority ordering
• Async-First Architecture - Native async/await support with Tokio for high-throughput processing
• Zero Runtime Compilation - All JSONLogic expressions pre-compiled at startup for optimal performance
• Full Context Access - Conditions can access any field: data, metadata, temp_data
• Execution Tracing - Step-by-step debugging with message snapshots after each action
• Built-in Functions - Parse, Map, Validate, Filter, Log, and Publish for complete data pipelines
• Pipeline Control Flow - Filter/gate function to halt workflows or skip tasks based on conditions
• Channel Routing - Route messages to specific workflow channels with O(1) lookup
• Workflow Lifecycle - Manage workflow status (active/paused/archived), versioning, and tagging
• Hot Reload - Swap workflows at runtime without re-registering custom functions
• Extensible - Easily add custom async actions to the engine
• Typed Integration Configs - Pre-validated configs for HTTP, Enrich, and Kafka integrations
• WebAssembly Support - Run rules in the browser with @goplasmatic/dataflow-wasm
• React UI Components - Visualize and debug rules with @goplasmatic/dataflow-ui
• Auditing - Track all changes to your data as it moves through the pipeline

Try It Now

Experience the power of dataflow-rs directly in your browser. Define a rule and message, then see the processing result instantly.

Want more features? Try the Full Debugger UI with step-by-step execution, breakpoints, and rule visualization.

How It Works

┌─────────────────────────────────────────────────────────────────┐
│  Rule (Workflow)                                                │
│                                                                 │
│  IF    condition matches        →  JSONLogic against any field  │
│  THEN  execute actions (tasks)  →  map, validate, custom logic  │
│  THAT  chain more rules         →  priority-ordered execution   │
└─────────────────────────────────────────────────────────────────┘

1. Define Rules - Create JSON-based rule definitions with conditions and actions
2. Create an Engine - Initialize the rules engine (all logic compiled once at startup)
3. Process Messages - Send messages through the engine for evaluation
4. Get Results - Receive transformed data with full audit trail

Next Steps

• Installation - Add dataflow-rs to your project
• Quick Start - Build your first rule
• Playground - Experiment with rules interactively