Home > Data Engineer (Hadoop/Hive)
Data Engineer (Hadoop/Hive)
6 Month rolling contract
We are currently looking for a Data Engineer whose expertise lies across Hadoop/Hive to join our large financial services clients Digital Development and Applied Sciences Team.
Joining their Digital Engineering team you'd be working with a group of pathfinders and trailblazers at the hub of this transformational agenda.
They're developing new techniques for capturing data from front-end and other systems to create platforms that transform and analyse data for the benefit of our colleagues and customers alike.
And with your skills spanning across data mining/analysis and Big Data systems (Hadoop) you'll get to own and work through a number of high profile projects to deliver scalable platforms whilst getting exposure to a host of wider technologies and careers by broadening your data horizons.
In essence you'd be focusing primarily on the following areas:
* Ensuring data quality in data collection from our data lake of structured and unstructured sources and managing the structure, packaging and repeatability of your datasets that will feed into Robotics, Cognitive and Data Science areas * Exploring new data sources for integration using enterprise data/ETL/ELT and data querying/modelling techniques to support the wider function * Working with our new Hadoop platforms to deliver value over and above traditional database technologies
You'll need to have a passion for developing new solutions and translating data into analytics based business opportunities - championing the role of data engineering in decision-making at all levels.
Essential Skills and Experience
So we'll be looking for you to have a suitable depth of experience across the following areas:
* Relational database technologies (e.g. Oracle, IBM, Teradata, SQL Server) and associated analytical techniques and tools * Hadoop ecosystems (ideally Hortonworks) such as HBase, Cassandra, MongoDB, MapReduce and associated toolsets such as Spark, Storm, Kafka, Oozie etc. * Expertise using HIVE with wider beneficial skills in other scripting/coding languages (SQL, SAS, Python, R etc.) being useful * Any experience you have of Optimisation Performance using HIVE/SQL would also be a real bonus (partitioning, bucketing, indexing etc.). * A wider knowledge and understanding of enterprise data modelling applications such as denormalised views, star schemas, third-normal form, OLAP cubes etc. then you're sounding like our ideal person.
Candidates will ideally show evidence of the above in their CV in order to be considered
Please be advised if you haven't heard from us within 48 hours then unfortunately your application has not been successful on this occasion, we may however keep your details on file for any suitable future vacancies and contact you accordingly.
Pontoon is an employment consultancy and operates as an equal opportunities employer
You may return to your current search results by clicking here.
Temps in the City
Kemp House160 City Road
UK: +44 (0)203 807 5400
Mobile: +44 (0)738 729 2822
Job Board website by Strategies