Senior Data Engineer

Senior Specialist, Data Engineer
494248
Permanent Full Time
London
Information Technology
Role Purpose

This position needs someone with energy and enthusiasm to complement our existing development team to accelerate the delivery of our data lake solution.
In this role, you must have a growth mindset with a desire to deliver high-quality output for yourself and the team and challenge the status quo.
You’ll have the ability to hit the deck running as well as add value quickly.

Key Accountabilities

Hands-on development on Data Lake build and change

Responsible for the code quality and simplicity in the system and leading the enforcement of quality within the data landscape
Working with the team within an Agile framework using the industry best practice agile methodology tooling that controls our development and CI/CD release processes
Building knowledge of all data resources within ND and prototype new data sources internally and externally
Contributing to the new Data Lake technology across the organization to address a broad set of use cases across data science and data warehousing

Skills and Experience

ESSENTIAL

• Proficiency in Big Data data integration technologies such as Spark, Scala, Kafka
• Excellent Scala/Java engineer with knowledge of and experience with container frameworks
• Excellent API and library design skills
• Proficiency with traditional database SQL technologies (Oracle, SQL Server, DB2)
• Experience with integration of data from multiple data sources
• Writing high-performance, reliable, and maintainable code.
• Analytical and problem-solving skills applied to the Big Data domain
• Experience of CI/CD best practice
• Good aptitude in multi-threading and concurrency concepts
• Experience with cloud deployment
• Familiarity with the fundamentals of Linux scripting language

DESIRABLE

• Previous proficiency with ETL technologies (e.g. Talend, Informatica, Abinitio)
• Previous exposure to Python and Cython
• Exposure to building applications for a cloud environment
• Knowledge of workflow/schedulers like Yarn & Oozie.
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Good knowledge of back-end programming, such as HTML, python, java, C, C++, JS, Node.js, and OOA

Personal Attributes

• Loves to code, and is relentless about code quality.
• Structured, organized, process driven and outcome-oriented
• Personable, credible, with good communication skills
• Excellent interpersonal & written communication skills. Ability to present ideas in business-friendly language
• Self-motivated, and able to work in a high-pressure environment
• Strong organizational, planning, and time management skills
• Ability to build strong and effective working relationships on an ongoing basis
• Ability to embrace company culture and embed it into day-to-day interactions
• Passionate, keen, and energetic with demonstrable enthusiasm and commitment.
• Pragmatism in design decisions