Azure Synapse Data Engineer - £75K - Remote (London)

My client a market leading provider grants clients access to bespoke data insights and analytics specific to their needs, providing research, data and expertise to support clients and all lines of business (Advisory, Digital, Search). They are an innovation centre focused on illuminating key trends and drivers of human and organizational performance, and also has a focus on delivering deep insights to clients, working collaboratively with our colleagues across the business.

We are looking for an experienced Azure Synapse Data Engineer with exceptional technical, analytical, communication and project management skills to join our team of data and analytics experts, helping organize and leverage arguably the richest, broadest data available on work and people, and support the build-out of a scalable, distributed data estate and supporting applications.

The role will help us leverage critical data assets, set up data pipelines, transform data, and enable our data scientists to leverage the data to create compelling insights.

This will be a remote role (UK based candidates only), with office travel to London once/twice per quarter.

Responsibilities:

Architecture design: Contribute to the design, development, and maintenance of the architecture of the Azure data estate to meet business requirements while adhering to IT Policies.

Data acquisition and integration: ensure feeds from various platforms - primarily internal but increasingly external are established. Use programming skills to develop, customize and manage ingestion tools, storage accounts, and analytical applications and their access. Adhere to current logic and design and strive for consistency in solutions.

Create ETL processes for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure Synapse tools and technologies.

Data pipeline development/testing. Test the reliability and performance of each part of a system during the development phase. Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability and data quality.

Track pipeline stability. Monitor the overall performance and stability of the system and ensure automated parts/scheduled tasks are monitored.

Manage structured and unstructured data and meta-data stored in the data estate. Ensure availability of clean, transformed data to meet business needs.

Partner with IT to provide Business Intelligence tools/infrastructure. Set up solutions, tools, views, and access permissions for different user groups enabling them to view data, generate reports, and create visuals. Work with data scientists to strive for greater functionality and use of our data.

Data strategy. Contribute to the broader organizational data strategy, including data privacy, infrastructure, network, security, legal and governance practices. Develop strong relationships with key stakeholders across the organization and help determine critical objectives.

Requirements:

• Microsoft Azure Synapse Analytics experience is essential. (Dedicated SQL Pool, Azure Data Factory, Azure Storage)
• Proficiency in programming language such as Python
• End-to-end Data Warehouse experience: ingestion, ETL, 'big data' pipelines, data architecture, message queuing, stream processing, BI/Reporting, and Data Security.
• Ability to build processes supporting data transformation, data structures, metadata, dependency, and workload management, as well as the ability to manipulate, process, and extract value from large, disconnected structured and unstructured datasets.
• Advanced SQL/relational database knowledge (including SSIS), query authoring (SQL).
• Experience performing root cause analysis on data, answering specific business questions, and identifying opportunities for improvement.

If the above role is of interest and you've got the required experience, apply with your most up to date CV for immediate consideration and interview!

Alternatively, if you would like to find out more about the position, reach out to me on (phone number removed) or at (url removed)

In Technology Group Ltd is acting as an Employment Agency in relation to this vacancy.