Skip to content
MCP server built inHow that works
Back to the platform overview

lavaflow

From raw file to analysis — assembled by clicking

Pick a source, add steps, set a target — the preparation is done. lavaflow turns raw data into a dependable table: visible on a canvas, versioned like source code, scheduled like any other job. Build it with the mouse, in Python, JavaScript or SQL — or let the assistant do it.

Where
Console → Automatisieren → lavaflow
Steps
Python, JavaScript, SQL, column mapping
Sources
A file drop or tables already in the lake
Targets
A table in the lake, or a file to hand on
Build it
by mouse, in code, or from the assistant
The lavaflow editor in the console: four connected nodes — landing zone, JavaScript, SQL and a Lavalake table as the target — with the selected node's configuration on the right.
Four steps from a dropped file to a finished table. Navigation on the left, draft and published version at the top, the selected step's settings on the right.

Built in minutes

A pipeline runs left to right: source, steps, target. Every step can be tried on its own while you build, and the canvas shows what happens to the data at any moment. Open it six months later and you understand it in seconds — and can carry on building.

Building blockPurpose
File dropPick up new CSV files from a folder as soon as they arrive.
Table as sourceBuild on what is already in the lake.
Python, JavaScriptReshape in the language your people already speak.
SQLReshape with the means your analysts have long since mastered.
Column mappingRename, set types, drop columns — without a line of code.
Table as targetCreate, append, replace, or reconcile through an upsert.
File outputHand results out as CSV, clean for Excel.

Every version stays

You work on a draft and publish a version — with a version history. Every earlier version stays visible and can be put back at any time. Reworking means: try it, compare it, publish it.

Changing a pipeline changes what tomorrow's numbers say. That is why every publication carries a date, a person and a version — readable years later.

The assistant builds the first draft

Describe what should become of which file and the built-in AI assistant places the steps. The proposal stands finished on the canvas: look it over, adjust it, publish it. An idea from a conversation becomes a running preparation in one go.

Part of the platform

lavaflow lives in the same installation as everything else: the same sign-in, the same audit chain, the same policies on the tables it reads and writes. It runs where your data already is — in your data center, on your hardware.

  • One product, one vendor, one contract — and the data stays in the building.
  • The same roles and permissions as the rest of the platform.
  • Every run and every publication in the tamper-evident log.
  • Pipelines can be scheduled and chained like any other job.

Where this sits in the platform

The same picture as on the home page: one platform, one authorization model, one store.

One platform, one authorization model: every access — human, agent or BI tool — runs through the same identity and the same audit trail.
  • Access: Console (SPA) · SQL worksheet · dashboards · AI assistant · MCP server — all behind one reverse proxy
  • Identity & governance: Keycloak OIDC · token exchange per RFC 8693 · row-access and masking policies · WORM audit · lineage
  • Compute: Trino under your identity · S, M and L workload classes in the Compose stack
  • Catalog & table format: Apache Iceberg with Nessie: ACID · time travel · branching · schema evolution · open to Spark, Flink, Trino
  • Storage & index: S3-compatible (MinIO, Ceph, NetApp StorageGRID, Dell ECS) · PostgreSQL with pgvector as the vector index