Principal Data Engineer

It starts with YES!

At Optus, we have an ambitious goal to be Australia’s most loved everyday brand.

As a Principal Data Engineer, you are one of the most critical members of the team. You are coaching, developing, inspiring, and working with your peers and leading the new starters in the chapter to take on the challenge of delivery complex programs. You are always in demand and praised by various teams such as Data Science, Data Analytics, Product, Marketing, Sales, Etc.

One of the key responsibilities is ensuring that the data engineers have the right toolset to perform their day-to-day activities. Additionally, you will be responsible for leading PoCs to access different data engineering tools to ensure that the DPM team is aware of the latest industry practices.

Your day in the life of a Principal Data Engineer at Optus

• Enhance, optimize and maintain existing data ingestion, transformation and extraction pipelines and assets built for reporting and analytics on Big Data, Azure Databricks & Airflow platforms.
• Provide Technical guidance and training new team members joining the Data engineering chapters for Optus frameworks and technologies.
• Design, build, maintain and review data pipelines, assets to meet the end-user requirements. The Data pipelines must adhere to all the architecture, design and engineering principles.
• Design the data pipelines and assets to meet non-functional requirements (Security, reliability, performance, maintainability, scalability, and usability). Most importantly, they should be designed to be to keep the compute cost low on Cloud.
• Data wrangling, Data profiling and data analysis for new datasets ingested from source systems and derived/built from existing datasets with the on-premises and cloud-native tools
• Functionally understand the Data assets working with various SMEs and apply the transformation rules required to build the target data asset.
• Coordinate with other teams for planning, design, governance, engineering and release management of processes and ensure timely and accurate delivery of data and services.
• Schedule the data pipeline using the existing tools like Control M with the correct upstream dependencies and meeting the SLA requirements.

Your skills to pay the bills

• Relevant professional qualifications in Maths, Statistics and/or Computer Science, with hands on experience working in Data Engineering and Data Warehousing.
• Experience with Azure Platform and having experience with Databricks, ADO, ADLS2, ADF, Cosmos, SQL Server.
• Proven experience in migration of data assets and pipelines from On-premises to Cloud, and tuning on Cloud platform to reduce the daily run cost.
• Experience in building fully automated end to end data pipelines using on-premises or cloud-based data platforms.
• Hands On in data profiling, source-target mappings, ETL development, SQL optimisation, testing and implementation.
• Knowledgeable managing structured and unstructured data types.
• Experience in leading a team of data engineers working from different locations in different time zones.
• Excellent communication, effective prioritisation and attention to detail, underpinned by phenomenal business partner management.

Perks we love at Optus

• Competitive salary and performance incentives
• Discounts to Optus products and services, and to over 400 retailers Australia-wide
• Training, mentoring and development opportunities (ask us about OptusU!)
• Up to five days of Volunteer Leave per year
• A “connected” day for you to use to connect to something you are passionate about
• Hybrid ways of working
• Vibrant campus life, variety of facilities including restaurants, cafes, gymnasium, GP, and post office

Keen to see what it’s really like to work at Optus? Search #OptusLife on LinkedIn to go behind the scenes!

At Optus, we are strengthened by others and that means valuing diversity and saying ‘yes’ to embracing individual differences. We are committed to ensuring that our application process provides an equal employment opportunity to all job seekers, including individuals from diverse gender, cultural and linguistic backgrounds, individuals with a disability, individuals identifying as being part of the LGBTQIA+ community, individuals who may have served in the armed forces or who identify as Aboriginal and/or Torres Strait Islander. If you require any adjustments or accessibility support to participate fairly and equitably in the recruitment process, please email AccessibleRecruitment@optus.com.au along with your preferred method of contact and we will be in touch.

For more information on Diversity, Inclusion & Belonging at Optus, please visit https://www.optus.com.au/about/inclusion-diversity.

#LI-DD1