Data Engineer


Ya no puede postularse a este trabajo. Este trabajo ya no está disponible. Contáctanos si estás interesado en trabajos como este

Perfiles Desarrollo (IT)

Long-term contract

Full-time

Competitive salary

  • Incorporación inmediata

You will join a Multicultural Company where you will get to play out your skills.

As a Data Engineer you will be part of Europe Digital Data Hub responsible for building and improving our global data lake by:

• Connecting new sources to enrich the data scope of the platform
• Designing and developing new features based on consumer application requests to ingest data in the different layers of data lake
• Automating the integration and delivery of data objects and data pipelines

Your duties and responsibilities of this job are to prepare data and make it available in an efficient and optimized format for consumer analytics, BI, or data science applications. It requires to work with current technologies used by our data lake and in particular Spark, Presto, Hive and RedShift on AWS environment. This includes:

• Design and develop new data ingestion patterns based on the requirements and needs for connecting new data sources or for building new data objects. Working in ingestion patterns allow to automate the data pipelines
• Participate to and apply DevSecOps practices by automating the integration and delivery of data pipelines in a cloud environment. This can include the design and implementation of end-to-end data integration tests and/or CI/CD pipelines
• Analyse existing data models, identify and implement performance optimizations for data ingestion and data consumption. The objective is to accelerate data availability within the platform and to consumer applications. Target technologies are Apache Spark, Apache Presto and RedShift
• Support client applications in connecting and consuming data from the platform, and ensure they follow our guidelines and best practices
• Participate in the monitoring of the platform and debugging of detected issues and bugs
• Embed end-to-end security and privacy
• Tenaciously solve problems and make decisions under uncertainty
• Demonstrate a strong ownership in understanding business needs and driving business valued outcomes

You are the perfect fit if your education or certifications are:

• Academic degree in Computer Science, Engineering, Mathematics or equivalent

• AWS Certification: Solutions Architect, SysOps Administrator, Developer, DevOps Engineer (desired)

And if you count with the following job related experience:

• At least 5 years of experience in software development with minimum of 3 years as data engineer/architect with proven experience on Big Data and Data Lakes on AWS
• Experience of the full software development lifecycle on BI projects and support experience
• Strong experience with schema design and data modelling
• Proven ability and initiative to learn and research new concepts, ideas, and technologies quickly
• Ability to effectively move forward on tasks even with ambiguous or changing requirements
• Ability to work in a team-oriented, collaborative environment in a global context
• Willingness and ability to train and teach others
• Ability to self-manage, prioritize and execute tasks in a high-pressure environment
• Strong systems/process orientation with demonstrated analytical thinking, organization skills and problem-solving skills
• The desire for growth and innovation, to bring rapid solutions to business challenges/opportunities
• The ability to work in a centralized/decentralized operating model, with varying implementation partners and implementation owners

If your technical skills are:

• ETL tools: Informatica PowerCenter, PL/SQL, ODI…
• SQL and Data-Bases: RedShift, PostgreSQL, Oracle 12c, Exasol,…
• Analytical Data modeling knowledge (DWH, STAR schema, Kimball…)
• BI tools: Tableau, Oracle Business Intelligence, Birst, PoweBI… (less priority)
• AWS: S3, EMR, RedShift, Automation (Cloud Formation)
• Programming language: Python, R
• Big Data: Spark, Hive, Presto
• Broad IT knowledge and experience

If you count with the following soft skills:

• Digital disruptor
• Self-driven
• Creative thinker
• Strong team player
• Active listener
• Analytical and problem-solving skills
• Attention to details

Vacantes Similares