Data Engineer

Company Description

UNIFY Dots is a global technology and software solutions company and Microsoft Gold Certified partner specializing Dynamics 365 ERP and CRM cloud-based solutions. We are seeking a dedicated and experienced Data Engineer to join our dynamic team. This role is ideal for someone who has a strong foundation in data processing technologies and methodologies, including experience with Databricks, ETL processes, data warehousing, and analytics platforms. As a Data Engineer, you will play a crucial role in the development and maintenance of our data infrastructure, ensuring the reliability and accessibility of data for decision-making and operational efficiency. 

Job Description

• Design, construct, install, test, and maintain highly scalable data management systems. 

• Implement complex data warehousing projects with a focus on collecting, parsing, managing, analyzing, and visualizing large datasets to turn information into insights using Power BI. 

• Ensure systems meet business requirements and industry practices by integrating new data management technologies and software engineering tools into existing structures. 

• Create robust data pipelines using ETL processes that follow best practices in data modeling, ingestion, modeling, data cleansing, data enrichment, and transformation. 

• Utilize Azure cloud services effectively to deploy and maintain scalable data infrastructure. 

• Collaborate with data Analysts, data scientists and architects on several projects, ensuring optimal data delivery architecture is consistent throughout ongoing projects. 

• Engage with stakeholders and team members to assist with data-related technical issues and support their data infrastructure needs. 

• Develop high-performance algorithms, predictive models, and prototypes using Python and PySpark. 

Qualifications

• Bachelor’s or master’s degree in computer science, Engineering or Information Technology. 

• 3-5 years of experience in a Data Engineer role, with a deep understanding of data structures, data modelling, and software architecture. 

• In-depth knowledge of SQL, Python and PySpark for large-scale data processing. 

• Proficient in using Azure Databricks for developing scalable data processing pipelines. 

• Extensive experience with Azure, including Azure Data Factory, Azure Data Lake, Azure Synapse, Fabric and other services. 

• Expertise in ETL tools and processes, and data warehousing solutions. 

• Strong analytical skills with the ability to collect, organize, analyse, and disseminate significant amounts of information with attention to detail and accuracy. 

• Experience with Power BI and other visualization tools to convert raw data into actionable insights. 

• Excellent problem-solving skills and ability to work in a dynamic and agile environment. 

• Strong written and verbal English communication skills 

Certifications Required 

• Azure Data Engineer Associate 

• Databricks Certified Data Engineer Professional 

Additional Information

BENEFITS:

1. Market competitive compensation.
2. Medical Insurance.
3. Work Laptop
4. People before Profit Culture that values team members over financial numbers.