Python Developer - Azure Databricks at Snapnet Limited

Job Description

• We are seeking a talented Python Expert with expertise in Azure Databricks to join our team as a Data Transformation Developer.
• As a Python Expert, you will be responsible for developing solutions using Azure Databricks to transform and manipulate data efficiently and accurately.
• You will work closely with our data engineering and data science teams to design and implement data transformation processes that meet the needs of our organization.

Responsibilities:

• Develop and maintain Python-based data transformation solutions using Azure Databricks.
• Collaborate with data engineering and data science teams to understand data requirements and design effective data transformation processes.
• Analyze and profile data to identify patterns, inconsistencies, and data quality issues that may impact data transformation processes.
• Implement data transformation logic and algorithms using Python programming language and/PySpark, ensuring efficiency, scalability, and maintainability.
• Optimize data transformation processes to enhance performance and minimize processing time.
• Develop and maintain Jupyter notebooks within Azure Databricks, ensuring smooth and reliable execution of data transformation tasks.
• Conduct thorough testing and debugging of data transformation code to ensure accuracy and reliability of results.
• Collaborate with cross-functional teams to ensure seamless integration of data transformation processes with downstream systems and applications.
• Stay updated with the latest advancements in Azure Databricks and other relevant technologies to continuously enhance data transformation capabilities.
• Provide technical guidance and mentorship to junior team members, fostering a culture of learning and growth.

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field. Equivalent work experience may be considered.
• Proven experience as a Python Developer, with expertise in Python programming language.
• Strong knowledge and hands-on experience with Azure Databricks for data transformation and analytics.
• Solid understanding of data transformation techniques, algorithms, and best practices.
• Proficiency in working with large datasets and utilizing distributed computing frameworks.
• Experience with data profiling, data quality assessment, and data cleansing techniques.
• Familiarity with SQL and relational databases, including data modeling concepts.
• Strong analytical and problem-solving skills, with the ability to analyze complex data and develop effective transformation strategies.
• Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
• Self-motivated and proactive, with the ability to prioritize tasks and manage time effectively.
• Relevant certifications in Azure Databricks or related technologies are highly desirable.