Our client is looking for a highly skilled Senior Data Engineer / Technical Lead to join their team. This role is ideal for someone with deep expertise in data engineering across both cloud and on-premises environments, with strong architectural knowledge and a proven ability to lead complex data projects in Agile and hybrid delivery environments.
This is an initial 12-month contract, with the opportunity to convert to permanent or extend based on mutual fit and business needs.
The requirement is to be on-site on a full-time basis.
Key Responsibilities
- Lead and contribute to the design, development, and deployment of data engineering and analytics solutions.
- Oversee project delivery using Agile Scrum, DevOps practices, and occasionally Waterfall, depending on the project phase and stakeholder needs.
- Develop robust, scalable data pipelines and data transformation processes using Azure technologies.
- Collaborate with business stakeholders, data analysts, and BI teams to ensure the effective delivery and consumption of data.
- Design and implement data models including Star Schema, Snowflake, 3NF, Data Vault, and other financial services data modeling approaches.
- Mentor and guide junior engineers and developers and serve as a technical expert in data engineering best practices.
- Optimize database performance and ensure high data quality and governance.
- Contribute to solution architecture and technology roadmap discussions.
Technical Skills & Experience
Cloud Environment (Microsoft Azure):
- Azure Data Lake, Data Factory, Synapse Analytics
- Azure Databricks (Apache Spark, PySpark, Data Lakehouse, Medallion Architecture)
- Power BI
- Python
- DevOps pipelines and practices
On-Premises Technologies:
- SQL Server (including SSMS, SSIS, SSRS, SSAS)
- Transact-SQL
- Power BI, Tableau
- C#
- SharePoint
Data Modeling & Architecture:
- Data Vault, Kimball, Inmon (3NF), Star Schema, Snowflake
- Financial Services Data Models
- Business Intelligence Architecture (Data Ingestion, Cleaning, Transformation, Distribution, Consumption)
Databases:
- Microsoft Azure SQL, Cosmos DB
- Oracle, MySQL, PostgreSQL
- Writing and optimizing: Stored Procedures, UDFs, Triggers, Views, Materialized Views, CTEs
Programming Paradigms:
- Strong understanding of OOP concepts (Inheritance, Encapsulation, Polymorphism, Abstraction)
Other Tools & Platforms:
- Microsoft Office 365 Suite (Excel, Word, PowerPoint, OneNote, Projects)
- Visio
- Operating Systems: Windows 10, Windows Server 2016, Unix/Linux, Red Hat Linux
- Web Browsers: Chrome, Edge, IE, Firefox
Bonus / Advantageous:
- Experience with Google Cloud Platform (GCP)