Senior Software Data Engineer

ComplexCare Solutions

Posted 1mo ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Design, develop, and support scalable cloud-native data solutions using Azure Databricks and Delta Lake
Develop and optimize PySpark, Spark SQL, and SQL data pipelines for batch and near real-time processing
Implement Medallion Architecture and Delta Lake solutions for enterprise data platforms
Build and maintain scalable ETL/ELT frameworks for ingesting and transforming large data volumes
Design logical and physical data models including STAR and SNOWFLAKE schemas
Develop data quality, reconciliation, monitoring, and lineage frameworks
Design scalable data export solutions for downstream applications and customer integrations
Optimize Databricks workloads, Spark jobs, and SQL queries for performance and cost efficiency
Implement CI/CD processes, Infrastructure as Code, and deployment automation
Collaborate with Power BI and Analytics teams to optimize semantic models and reporting datasets
Participate in troubleshooting production issues and root cause analysis
Produce technical design documentation, architecture diagrams, and operational runbooks
Maintain compliance with HIPAA requirements and PHI data security standards

7+ years of experience in Data Engineering, Data Warehousing, and ETL/ELT development
5+ years of hands-on experience with Azure Databricks, PySpark, Spark SQL, and Delta Lake
5+ years of experience building enterprise-scale data pipelines and cloud-native platforms
Strong experience with Azure Data Factory, Azure Data Lake Storage, and Azure SQL Database
Strong SQL development skills including query optimization and performance tuning
Experience implementing Medallion Architecture and modern analytics platforms
Experience with CI/CD, Git, Azure DevOps, and Infrastructure as Code
Experience designing dimensional models, STAR schemas, and SNOWFLAKE schemas
Experience building data quality frameworks and operational support solutions
Experience with reporting platforms such as Power BI or Tableau
Strong understanding of cloud architecture, data governance, and security
BS degree in Computer Science, Computer Engineering, Business, or equivalent experience

Skills