Senior Data Engineer - Azure Databricks

Job Title

Senior Data Engineer - Azure Databricks

Key Skills

Azure Databricks, DBT, Snowflake, Python, SQL, Terraform

Experience

5+ YOE.

Location

Costa Rica, Peru, Colombia, and Bolivia.

Mode

Remote.

We at Coforge are hiring Senior Data Engineer - Azure Databricks (#22146) with the following skill set.

Key Responsibilities

• Own the end-to-end delivery of data pipelines and data products from design through deployment and production support.
• Develop, maintain, and optimize scalable data pipelines using Azure Databricks, DBT, and Python.
• Support and execute large-scale data migrations from Snowflake (AWS) to Azure Databricks.
• Build and manage infrastructure-as-code solutions using Terraform.
• Ensure seamless integration across enterprise data platforms and environments.
• Implement data quality frameworks, testing, and validation processes.
• Enable observability through monitoring, logging, and alerting solutions.
• Contribute to the design of scalable data architectures aligned with Lakehouse principles.
• Monitor and support production environments, ensuring performance and reliability.
• Collaborate with cross-functional teams and mentor junior engineers through best practices and code reviews.

Required Skills & Qualifications

• 5 to 8+ years of experience in Data Engineering within enterprise-scale environments.
• Strong hands-on expertise with Azure Databricks, DBT, and Snowflake.
• Strong proficiency in Python and SQL.
• Proven experience building and managing large-scale data pipelines and transformations.
• Experience working with high-volume datasets and complex data models.
• Solid understanding of data modeling, ETL/ELT frameworks, distributed systems, and Lakehouse architectures.
• Experience with Terraform and Infrastructure as Code (IaC) principles.
• Strong experience with CI/CD pipelines and Git-based version control.
• Experience supporting production systems, including monitoring, alerting, and incident resolution.
• Knowledge of data quality, testing, and observability frameworks.
• Excellent analytical, problem-solving, and communication skills.

Preferred Skills

• Experience in insurance or financial services environments.
• Experience with real-time and streaming technologies such as Kafka, Event Hubs, or Delta Live Tables.
• Knowledge of security, compliance, and data protection standards in regulated industries.
• Experience with cloud cost optimization and performance tuning.
• Exposure to multi-cloud or hybrid architectures.

Posted On

14-08-2026

At Coforge, we hire professionals based solely on their skills and qualifications and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.