Senior Data Engineer
Sigma Software- Location
- Warsaw, Masovian Voivodeship, Poland
- Workplace
- Remote
- Employment
- Full Time
- Salary
- —
Posted 2d ago
- Write and defend diagnostic SQL queries against large-scale production datasets
- Build and maintain ingestion pipelines for bid, win, and impression logs into BigQuery
- Harmonize fields across independently designed datasets and maintain versioned field mappings
- Develop point-in-time-correct feature tables and aggregation pipelines
- Design and maintain conversion and labeling pipelines with delayed label handling
- Own the data serving write path, schema contracts, publishing flows, and freshness SLOs
- Build experimentation infrastructure including traffic splitting and reporting pipelines
- Perform large-scale historical backfills and safe reprocessing after mapping changes
- Implement data isolation and safe-aggregation controls for advertiser data protection
- Develop automated data quality validation frameworks
- Collaborate closely with Customer engineers and prepare operational documentation
- Contribute to architecture discussions and platform scalability improvements
- 5+ years of experience in Data Engineering
- At least 2 years of experience working with production ML or large-scale analytics pipelines
- Expert-level SQL skills including window functions and incremental processing patterns
- Strong Python skills for production-grade pipeline development
- Hands-on experience with Spark or PySpark
- Experience designing ETL / ELT pipelines with Airflow, Cloud Composer, Dagster, or similar tools
- Experience working with cloud data warehouses at scale, preferably BigQuery
- Strong understanding of data modeling and point-in-time correctness
- Experience working with event-driven or clickstream datasets at very large scale
- Experience supporting business-critical production pipelines
- Upper-Intermediate English level or higher
WILL BE A PLUS
- Experience with GCP services including Dataflow, Pub/Sub, GCS, and Beam
- Experience building streaming or near-real-time ingestion systems
- Understanding of feature stores, train/serve skew, and label leakage prevention
- Experience in AdTech or auction-based environments
- Experience handling delayed or incomplete labels in ML systems
- Experience with dbt or similar transformation frameworks
- Experience delivering solutions into Customer-owned infrastructure
- Knowledge of GDPR/CCPA-related privacy engineering practices
- Experience with experimentation infrastructure and statistical validation pipelines
- Experience working in hybrid cloud/on-prem Linux environments
- Terraform and Kubernetes experience
- Experience optimizing warehouse cost and performance
PERSONAL PROFILE
- Strong analytical and problem-solving skills
- Ownership-oriented mindset
- Ability to work independently in a client-facing environment
- Strong communication and documentation skills
- Comfortable working in a fast-paced engineering environment
- Collaborative and proactive attitude
Skills
- SQL
- BigQuery
- Machine Learning
- Python
- Spark
- PySpark
- ETL
- ELT
- Airflow
- Cloud Composer
- Dagster
- GCP
- Dataflow
- Pub/Sub
- Google Cloud Storage
- Beam
- dbt
- GDPR
- Linux
- Terraform
- Kubernetes
More jobs at Sigma Software
All 101Customer Success & Implementation Support Specialist (AI Solutions)
Sigma Software · São Paulo, SP, Brazil · 2d ago
Senior MLOps / ML Platform Engineer
Sigma Software · Kraków, Lesser Poland Voivodeship, Poland · 2d ago
Senior ML Engineer / Data Scientist
Sigma Software · Lviv, Lviv Oblast, Ukraine · 3d ago
Senior .NET Developer
Sigma Software · Bucharest, Bucharest, Romania · 3d ago
Senior Data Scientist
Sigma Software · Warsaw, Masovian Voivodeship, Poland · 6d ago
Similar roles
Senior Cyber Security Application Engineer | EMEA
Colliers International EMEA · Warszawa, Województwo mazowieckie, Poland · today
AI / Machine Learning Engineer Leader
Prolific Academic · Poland · USD 200/hr · today
Full-Stack Software Engineer with OAuth
Endava · Warsaw, Mazovia, Poland · today
Senior Full-Stack Software Engineer with OAuth
Endava · Warsaw, Mazovia, Poland · today
Senior Product Manager
Huuuge Games · Warszawa, Mazowieckie, Poland · today
Senior Data Engineer (Rust)
Nagarro · Remote, Poland · today