Senior Data Engineer

If discovering and unlocking the hidden potential in massive data sets is what you love, then you’ll love this role! We’re on the hunt for a Senior Data Engineer to join an International media group with a footprint across Europe, Asia and Africa.

Working remotely and reporting to the Head of Search & Data, you’ll leverage your data mining and statistical analysis skills, as well as your ability to build best in class prediction systems to enable enhanced business performance and data driven decisions.

In terms of tech, you’ll be highly proficient in Python with solid experience working on either AWS or GCP, building big data pipelines and data sets.

Requirements:

• 2+ Years’ experience working with either AWS or GCP
• Solid understanding of Data Lakes
• 4+ years’ experience building and optimizing big data pipelines, architecture and data sets.
• Ability to leverage various skills/techniques to extract value from large data sets
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• Highly skilled in analysing large, unstructured data sets.
• Working knowledge of message queuing, stream processing and highly scalable “big data” data stores

Responsibilities:

• Design, build and maintain data pipeline architecture
• Design data integration and data quality frameworks
• Assemble large complex data sets according to business requirements
• Design and implement internal process improvements i.e – optimisation of data delivery, automation of manual processes etc…
• Ensure data security
• Unit/integration testing