Senior Data Engineer
Krakow, Lesserpoland
First Advantage
At First Advantage (Nasdaq: FA), people are at the heart of everything we do. From our customers and partners to our greatest advantage — our team members. Operating with empathy and compassion, First Advantage fosters a global inclusive workforce devoted to the diverse voices that make up our talent and products. Our team members empower each other to be their authentic selves and treat all with respect, integrity, and fairness.
Say hello to a rewarding career and come join a leading provider of mission-critical background screening solutions to some of the most recognized Fortune 100 and Global 500 brands.
What We Do:
We are on the frontline of recruitment enabling organizations to Hire Smarter. Onboard Faster™ First Advantage is an HR Tech company delivering innovative solutions and insights to enable our clients to manage risk and hire the best talent. Leveraging an advanced technology platform, First Advantage builds fully scalable, configurable screening programs that meet the unique needs of over 30,000 clients. Headquartered in Atlanta, GA and with an internationally distributed workforce spanning 17 countries with about 5,000 employees, First Advantage performs over 100 million screens in over 200 countries and territories annually.
Who You Are:
You are self-motivated and ready to “roll up your sleeves." While you are an independent contributor, you are also collaborative. You can spearhead a project and see it through from start to completion.
As a team player, you navigate cross-functional teams and work well with team members in other business units and departments toward a common goal.
An Innovator — you see gaps in current processes or workflows as an opportunity to improve and try something new.
A lifelong learner and always seeking out opportunities to learn and upskill, you understand the importance of thorough and secure screenings and are interested in the Human Capital sector and the confluence of people, process, and technology.
What You'll Do
We are looking for a Senior Data Engineer with strong experience in PySpark, to help us build our data lakehouse in Azure cloud. Specifically, the person in this role will focus on and need the below skills to be successful.
Responsibilities:
Develop reusable, metadata-driven data pipelines
Develop and maintain the shared functions organized as libraries
Optimize data storage using partitioning and Databricks Delta native features
Automate data platform-related processes, including the set up of a metastore, compute clusters and policies
Write unit tests, perform code reviews to ensure code quality, and proactively resolve performance or quality issues in ETL processes and reporting queries
Collaborate with Product Owners to gather functional requirements and develop mapping rules for data from different sources
Cooperate with infrastructure engineering team to set up cloud resources
Contribute to data platform wiki / documentation
Initiates and implements improvements to the data platform architecture
What You Need to be Successful:
Expert-level programming experience in Python/PySpark, SQL
Proficient in dealing with large and complex datasets
Experience with building robust data pipelines using Databricks Spark
Knowledge of stream processing challenges and familiarity with Spark Structured Streaming
Experience building and optimizing data models
Experience developing CI/CD pipelines
Experience with Agile Software Development methodologies (Scrum)
Additionally, it is not required but would be helpful if the candidate has:
Knowledge of Azure cloud native solutions (Azure Event Hubs, Azure Data Factory, Azure Function App, Azure Container Instances)
Familiarity with DWH concepts and dimensional data modeling (Kimball, Inmon, Data Vault)
Experience building event sourcing solutions
Why First Advantage is Your Next Big Career Move
First Advantage is going through a technology transformation! We are looking for experts who are excited to work with advanced technologies and provide best-in-class user experiences, drive the development and deployment of scalable solutions, and smoothly guide our agile teams and clients through meaningful changes as we continue to expand our impact.
Additional benefits offered to our eligible people include:
Competitive benefits package, including health care, life insurance and Multisport,
Challenging projects.
Spacious, modern, and fully equipped office space in the heart of Krakow.
Flexibility and possibility to work remotely.
Superior co-working and personal development experience.
What Are You Waiting For? Apply Today!
You have learned a little about us today – we want to learn about you! If you think this position and our company are a great fit for your areas of interest and expertise, tell us about you by applying now!
United States Equal Opportunity Employment:
First Advantage is proud to be a global leader in removing barriers and supporting our community members to ensure the changing demographics of the workforce are reflected in our hiring and employment practices. We value all of our candidates, employees, and clients, and place great emphasis on hiring and supporting qualified individuals in each role. We are an equal opportunity employer. We do not discriminate on the basis of race, color, ethnicity, ancestry, religion, sex, national origin, sexual orientation, age, citizenship status, marital status, disability, gender identity, gender expression, veteran status, genetic information, or any other area protected by applicable law.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture Azure CI/CD Confluence Databricks Data pipelines Engineering ETL Pipelines PySpark Python Scrum Spark SQL Streaming
Perks/benefits: Career development Health care Insurance
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Business Intelligence Engineer jobs
- Open Lead Data Analyst jobs
- Open Power BI Developer jobs
- Open Data Engineer II jobs
- Open Senior Business Intelligence Analyst jobs
- Open Marketing Data Analyst jobs
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Business Data Analyst jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Analyst Intern jobs
- Open Sr Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Data Engineering Manager jobs
- Open Junior Data Engineer jobs
- Open Big Data Engineer jobs
- Open Research Scientist jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Data quality-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open NLP-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open LLMs-related jobs
- Open APIs-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs