Senior Software Engineer, Data Governance & Foundations

Instacart

Posted 3mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Define and drive multi-year architecture roadmaps for data ingestion and processing infrastructure
Own end-to-end platform initiatives from build vs. buy decisions to production rollout
Partner with vendors on technical integration, contract evaluation, and TCO modeling
Collaborate to embed governance and compliance controls into platform architecture
Optimize infrastructure spend at scale
Write compelling architecture documents, strategy memos, and proposals
Mentor engineers on the team and model strong engineering culture
Collaborate with cross-functional teams to ensure platform meets evolving needs

5+ years of software engineering focused on data infrastructure or distributed systems at scale
Experience in modern data lakehouse architectures and open table formats
Strong understanding of compute/storage trade-offs
Hands-on experience with distributed query and compute systems
Proven depth in event-driven infrastructure: Kafka for high-throughput data ingestion
Experience with Flink (or equivalent) for stream processing at scale
Track record owning and executing major platform transitions
Experience building business cases for infrastructure investments
Exceptional written technical communication
Strong ownership and comfort operating in ambiguity

Familiarity with data governance and compliance frameworks
Experience designing governance controls into platform architecture
Experience with FinOps and data platform cost optimization
Managing large infrastructure budgets and negotiating enterprise vendor contracts
Deep SQL expertise
Strong proficiency in Python or Scala for systems-level work
Experience with orchestration (Apache Airflow)
Experience with transformation pipelines (dbt) in large-scale production environments
Bachelor's, Master's, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience

Skills