Senior Staff Software Engineer - Lakeflow Pipelines Datasets

Databricks builds the world's leading data and AI platform, used by tens of thousands of organizations to turn raw data into decisions that matter. The Lakeflow Engineering team owns the entirety of the ETL product line: Declarative Dataflow Graphs, Materialized Views, Structured Streaming, and Flows. We run what is arguably the world's largest data engineering platform, processing exabytes of data daily across tens of thousands of customers. The problems we solve (fault-tolerant incremental computation, stream-batch unification, declarative pipeline orchestration at massive scale) sit at the frontier of what distributed data systems can do. We're looking for a Senior Staff Engineer to serve as a technical architect and engineering leader for this platform. You'll own the long-term technical direction for how pipelines are defined, optimized, executed, and operated, shaping the systems that data teams worldwide depend on every day. You will work across one or more of t