Data Engineer

Standort: London, England Gehalt: £300 - £350 per day
Bereich: Consultancy Bereich: Freiberufler
Reference #: CR/058710_1549904643

Data Engineer / 11 months / London / Start ASAP

Job Purpose and primary objectives:

The GCP Data Engineer will be responsible for expanding, optimising and supporting our data and data pipeline architecture, as well as optimising data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimising data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.

Key responsibilities (please specify if the position is an individual one or part of a team):

* Create and maintain optimal data pipeline architecture,
* Assemble and automate large, complex data sets that meet functional / non-functional business requirements.
* Bringing existing commercial experience to help improve the engineering capability
* Operationalise data models and ML models as required by the business
* Work with stakeholders of varying technical fluency to assist with data-related technical issues and support their data infrastructure needs.
* Ensure our data is secure and adherent to all JLP security NFRs
* Work with data and analytics experts to strive for greater functionality in our data systems.

Key Skills/Knowledge:

* Experience with building and supporting secure data-pipelines
* Experience with developing and deploying CI/CD pipelines
* High technical capability with Python
* Some experience of working with the GCP stack, in particular Cloud Composer (Apache airflow), Cloud Storage and Data-Flow (Apache beam)
* An understanding, and experience of, implementing security best practices within data pipelines
* An ability to work closely with analysts to define technical requirements
* Be highly independent and motivated individual
* Comfortable adopting new technologies and applications (essential due to fast moving cloud stack).

Experience required:

* At least 3+ years of working in a data-engineering or similar role