[8AD] Data Engineer

Responsibilities

• Design and implement Infrastructure as Code (IaC) using Terraform to automate and manage infrastructure across Azure and Cloudflare, ensuring consistent and scalable deployments.
• Oversee PostgreSQL DB operations and automate DB-related tasks to streamline database management.

Message Queue Configuration

Deploy and configure message queues to facilitate efficient data processing and communication between services.

• Develop and maintain CI/CD pipelines using GitHub Actions, automating the software delivery process to improve deployment efficiency.
• Ensure security across the infrastructure, enforcing RBAC practices and applying best practices for compliance and security within the DevOps lifecycle.
• Implement and maintain monitoring and observability solutions to track and optimize system performance, identify bottlenecks, and maintain system health.
• Quickly diagnose and resolve any infrastructure- related issues, ensuring minimum disruption to our services.
• Power BI (must-have): semantic models, DAX, report definitions authored as PBIP with .pbix deployment, incremental refresh, query folding, and troubleshooting model performance issues (e.g., refresh/XMLA timeouts).
• Azure Synapse (must-have): notebooks, pipelines, triggers, and workspace management; source-side query optimization.
• Strong SQL for data validation, transformation, and troubleshooting.
• PowerShell scripting, with comfort working across common modules (e.g., Az, MicrosoftPowerBIMgmt) for deployment and operational tasks.
• Familiarity with Azure Functions/function apps and CI/CD deployment workflows.
• Experience with Azure DevOps (work item tracking) and Git/GitHub (branching, pull requests).
• Senior-level experience preferred, with strong proficiency across this specific tech stack and the ability to work with a high degree of autonomy.