Remote with the opportunity to work from one of our offices: Preston, Liverpool, Manchester or London

OUR CLIENT CANNOT OFFER SPONSORSHIP NOW OR IN THE FUTURE

Role Summary:

We are seeking a skilled and passionate Data Engineer to play a crucial role in modernising our clients data infrastructure. You will be responsible for designing, building, and maintaining robust data pipelines that extract data from their transactional systems and seamlessly integrate it into their Snowflake data warehouse. Your work will empower data-driven decision-making across the company, enabling us to better understand customer behaviour, optimise pricing strategies, and enhance the overall user experience. Our development team is small but moves quickly, so an understanding of agile workflow and developing in an iterative process is an advantage.

My client is seeking a passionate individual who looks to continually improve their skills, whilst keeping abreast of modern data pipeline technologies.

Responsibilities:

Pipeline Development: Design, develop, and maintain efficient and reliable data pipelines to extract, transform, and load (ETL) data from various platforms (e.g., MySQL, AWS Aurora, Intercom, Google Analytics) into Snowflake.
Talend Integration: Utilise Stitch and Qlik Talend Cloud to orchestrate and manage data pipelines, ensuring efficient data transfer and transformation between transactional systems and Snowflake.
Data Quality: Ensure data quality and integrity by implementing data validation, cleansing, and deduplication processes within the pipelines.
Performance Optimization: Monitor pipeline performance, identify bottlenecks, and optimize data flows for speed and scalability.
Legacy System Integration: Develop a deep understanding of our existing legacy systems and their data structures to ensure seamless data extraction.
Documentation: Maintain comprehensive documentation of data pipelines, data models, and ETL processes.
Collaboration: Work closely with business intelligence developers, software engineers, and business stakeholders to understand data requirements and deliver impactful solutions.

Essential Requirements:

Proven experience as a Data Engineer with a strong focus on data integration and ETL processes.
Extensive experience working with relational databases (e.g., SQL Server, MySQL) and data warehousing environments (e.g., Snowflake).
Proficiency in SQL and at least one scripting language (e.g., Python, Bash).
Familiarity with data pipeline orchestration tools (e.g., Airflow, dbt).
Strong understanding of data quality principles and best practices.
Excellent communication and collaboration skills.

Desirable Requirements:

Working with AWS, Twilio Segment and Google Analytics
Hands-on experience with Stitch and Qlik Talend Cloud for data integration and ETL
Experience with ElasticSearch
Experience with data modeling techniques and best practices.
Unification of customer data from various sources (including web and mobile apps)
Good understanding of user experience best practice
Maintain a high awareness of industry issues and trends, particularly regarding accessibility, usability, and emerging technologies, and keep team members informed as appropriate
Experience in the event ticketing industry is a plus.

In return our client will offer you:

Friendly, open, informal and most important equal working environment where management are all approachable

Home Working

Cycle to work scheme / Tech scheme

Electric Car scheme

Company pension

Health insurance provided by Vitality including Optical, Dental and Hearing Cover

Excellent future career progression opportunities

Increased holiday entitlement after 1 year service

Flexible working hours

Casual Dress

Opportunity to attend tech conferences

Time given to progress skills, research and keep up-to-date with latest tech

Important Information: The successful applicant must agree to a Basic Disclosure under the Disclosure and Barring Service (DBS) procedures. Employment will be confirmed to the successful applicant subject to a satisfactory Disclosure report.

SmartSourcing are a Disability Confident Employer and we promote, celebrate and value diversity, we are committed to promoting equality and inclusion for all

SmartSourcing plc

Latest Leads

Data Engineer