Databricks Developer

Description

• Should be able to work with architect and lead engineers for solutions to meet functional and non-functional requirements.
• Demonstrated knowledge of relevant industry trends and standards.
• Demonstrate strong analytical and technical problem-solving skills.
• Must have excellent coding skills in Python.
• Must have implemented at least 1 project end-to-end in Databricks.
• Must have at least experience on databricks which consists of various components as below

o Delta lake

o Unity catalog

o Basic governance knowledge

o Databricks workflows orchestration

• Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.
• Must have good understanding to create complex data pipelines
• Must have good knowledge of Data structure & algorithms.
• Must be strong in SQL and spark-sql.
• Must have strong performance optimization skills to improve efficiency and reduce cost.
• Must have worked on both Batch and streaming data pipeline.
• Must have extensive knowledge of Spark and Hive data processing framework.
• Must have strong communication skills and should be able to work directly with customer.
• Must have great attitude towards learning new skills and upskilling the existing skills.