Lead Data Engineer
York, United Kingdom, Hybrid
StarCompliance
Star’s regulatory compliance solutions empower all industries to monitor conflicts, meet regulatory obligations, reduce risk & comply with confidence.Role You will play a key role in the delivery of Star’s Data Strategy. You will be responsible for enhancing our master data platform to provide a consistent, quality internal product for all other product teams to utilise, providing data and search capability to 1000s of users across 100s of clients across the globe. As the Data Tech Lead you will be hands-on and you will be expected to actively contribute to the codebase, alongside code reviewing other team members’ code and enhancing our technical data capabilities. The future of the platform has several interesting technologies to assess, to allow more efficient data-processing and searching at an enterprise level. You will assist in assessing how technologies such as ElasticSearch and Graph databases can help develop the product. Star has a culture of continuous learning and improvement. We invest heavily in training of our engineers through Pluralsight and industry-relevant certifications.
Responsibilities
- Identify and build solutions to aid the master data platform in being truly enterprise-level
- Design, and build scalable, efficient, and fault-tolerant data products which align to the Data Strategy
- Regularly contribute to the codebase and aid other engineers within the team by reviewing and advising/sharing best-practices
- Re-engineer and re-architect elements of the platform where necessary
- Explore and recommend new tools and technologies to optimize the data platform. Help lead Hackathons and POCs to determine technical recommendations
- Ensure the platform remains secure, well-monitored and performant
- Work alongside the Data Engineering Manager, Product Manager and Product Owner to enhance this vital data product and deliver on Star’s Data Strategy
- Play a key role in Agile ceremonies with particular input into backlog refinement and estimations, as well as ownership of the tech-debt backlog
- Look for ways to help others, whether this be through mentoring, pair programming or other approach to knowledge sharing
Mandatory Skills, Knowledge or Experience
- At least 5 years of experience in data engineering with experience in a previous tech leadership position
- Expert in SQL, including a knowledge of efficient query and schema design, DDL, and use of stored procedures
- Proficiency in programming languages such as Python
- Strong knowledge of coding best practices with the ability to regularly review and coach other engineers
- Strong knowledge of data quality, data governance, and data security principles and practices
- Experience of search technologies such as ElasticSearch / Azure Search / Graph databases
- Experience with data modelling, data warehousing, and ETL processes
- Experience building production systems in the cloud. We are an Azure company but other cloud providers are acceptable.
- Experience and understanding of master data platforms, techniques and challenges (MDM)
- Work in an Agile development environment and utilize DevOps, CI/CD (Azure Devops)processes
- Excellent communication, collaboration, and problem-solving skills
Desirable skills
- Cloud certifications (Azure, AWS, GPC)
- Experience of Snowflake cloud data warehouse
- Experience defining, implementing or supporting software in financial services industry
- Understanding of financial instruments, securities and company hierarchy
- Experience and understanding of data governance tools
- Experience of Data migration projects including data-mapping and merging
Transferable Skills, Knowledge or Experience
- Skills may be transferable from a role which includes software development. .
Integrity and Ethics
- All StarCompliance employees are expected to commit to a high standard of personal integrity and carry out their responsibilities in an ethical manner
All positions require pre-employment screening due to employees potentially having access to highly sensitive and confidential information involving finance and compliance; candidates must be trustworthy and have a heightened sensitivity to protecting confidential financial, professional information. To be eligible for employment with StarCompliance, candidates must undergo a rigorous background investigation with checks including, but not limited to, criminal record history, consumer credit, employment history, qualifications, and education checks.
Equal Opportunity Employer Statement
We prohibit discrimination and harassment of any kind based on race, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, gender identity or expression, marital/civil union/domestic partnership status, veteran status or any other protected characteristic as outlined by country, state, or local laws.
This policy applies to all employment practices within our organisation, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. StarCompliance makes hiring decisions based solely on qualifications, merit, and business needs at the time. For more information, please request a copy of our Equal Opportunities Policy.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile AWS Azure CI/CD Data governance Data quality Data strategy Data warehouse Data Warehousing DDL DevOps Elasticsearch Engineering ETL Finance Python Research Security Snowflake SQL
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Business Intelligence Engineer jobs
- Open Lead Data Analyst jobs
- Open Power BI Developer jobs
- Open Data Engineer II jobs
- Open Senior Business Intelligence Analyst jobs
- Open Marketing Data Analyst jobs
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Junior Data Scientist jobs
- Open Business Intelligence Developer jobs
- Open Business Data Analyst jobs
- Open Data Scientist II jobs
- Open Product Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Data Analyst Intern jobs
- Open Sr Data Engineer jobs
- Open Principal Data Scientist jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Data Engineering Manager jobs
- Open Junior Data Engineer jobs
- Open Big Data Engineer jobs
- Open Research Scientist jobs
- Open Data Quality Analyst jobs
- Open Azure Data Engineer jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Data quality-related jobs
- Open ML models-related jobs
- Open Business Intelligence-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Data visualization-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open NLP-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open LLMs-related jobs
- Open APIs-related jobs
- Open Generative AI-related jobs
- Open CI/CD-related jobs
- Open Snowflake-related jobs
- Open Consulting-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Databricks-related jobs
- Open Airflow-related jobs