Senior Engineer - Data Engineering
Ksb- Location
- Pune
- Workplace
- —
- Employment
- —
- Salary
- —
Posted 3mo ago
Key Responsibilities
- Contribute to the design and development of scalable data pipelines and a growing data lake
- Build and extend data processing workflows using Python, Apache Spark, and Databricks
- Define technical standards, best practices, and reusable frameworks for data engineering
- Ensure data quality, reliability, performance, and maintainability across data solutions
- Support data modeling, data integration, and transformation processes for analytics and reporting
- Drive automation, monitoring, and CI/CD improvements to ensure operational excellence
- Collaborate across teams, acting as a technical interface between the data platform and engineering, analytics, and business stakeholders.
- Contribute to architecture decisions and long-term data platform strategy
Your Profile
- Outstanding programming experience, preferably in Python; ability to write clean, testable, production-grade code; able to write clean, testable, production-grade code
- Strong SQL skills and familiarity with structured and semi-structured data formats (JSON, Protobuf, Delta format)
- Hands-on experience with Apache Spark, ideally on Databricks, and understanding of the medallion architecture
- Solid grasp of data lakehouse principles, data modeling, and data governance concepts
- Experience building and maintaining CI/CD pipelines (e.g. GitLab CI); familiarity with IaC and deployment
- Cloud Platforms: Experience with AWS or comparable cloud providers; familiarity with Databricks as a managed Lakehouse platform
- Experience with event-driven architectures or streaming platforms (e.g. Kafka)
- Proven track record deploying, monitoring, and maintaining data pipelines and services in
production environments; experience with testing practices
- Able to work autonomously and take ownership of tasks end-to-end
- Clear and concise communicator — comfortable working across engineering and data teams
Education & experieance
- Bachelor's degree in Software Engineering, Mathematics, Physics, or a related field
- 3 years of project/coding experience in a company
- Cloud experience:
- Databricks, AWS/Azure
- Staging, testing, Git, pipelines
- Distributed systems, data pipelines
- Python experience:
- Versioning, package management, requirements/environments
- Change data capture
- Data engineering experience:
- SQL
- Partitioning
- Data structures (tables, relations)
- Lakehouse
Skills
- Python
- Spark
- Databricks
- SQL
- JSON
- Protobuf
- GitLab CI
- AWS
- Kafka
- Azure
- Git
More jobs at Ksb
All 41Similar roles
Business Intelligence II-SUPPORT SERVICES-Data & Analytics - In House Engineering
Kotak Additional · Bangalore, Karnataka, India · today
Data Scientist Associate
JPMC Candidate Experience page · Bengaluru, Karnataka, India · today
Senior Data Scientist II
Chubb External · Bangalore, Karnataka, India · today
Senior Data Engineer (AI/ML)
OpenTable · India · today
DE&A - Core - Cloud Data Engineering - Informatica Cloud
Zensar Technologies · India · today
DE&A - Core - Cloud Data Engineering - Informatica Cloud
Zensar · India · today