Ver oferta completa

SENIOR DATA ENGINEER

Descripción de la oferta de empleo

Inetum is an agile IT services company that provides digital services and solutions, and a global group that helps companies and institutions to get the most out of digital flow. In a context of perpetual movement, where needs and usages are constantly being reinvented, the Inetum group is committed to all these players to innovate, continue to adapt, and stay ahead. With its multi-expert profile, Inetum offers its clients a unique combination of proximity, a breakdown by sector, and state of the art solutions.We are looking for a DATA ENGINEER to run projects and maintenance activities in Madrid team. ROLES / RESPONSIBILITIES:• Develop data pipelines with Spark and Scala to ingest and transform data from different sources (Kafka topics, APIs, files) into HDFS, IBM Cloud Storage, Parquet or SQL/NOSQL databases.• Manage big data storage solutions in the platform (HDFS, IBM Cloud Storage, Parquet).• Implementation of schemas and queries in SQL/NOSQL databases like postgres, MongoDB or Oracle.• Develop and configure scheduling of data pipelines with a combination of shell scripting and Autosys, Oozie or AirFlow.• Configure Dremio Data Virtualization to interface with Parquet or as a way to expose the data in the different data products. • Configure Dataiku pipelines as a data preparation tool for loading and transformation of data from our big data platform into specific datamarts for data or business products. • Provide N3 level support to end users. IT TOOLS:• Spark and Scala as legacy data pipeline development language.• SparkaaS and Scala as data pipeline development platform.• Experience in the design and development of streaming procesess using Spark Streaming, Spart Structure Streaming, and Apache Kafka.• Management of legacy big data storage solutions (HDFS and Parquet).• Management of big data storage solutions (IBM Cloud Object Storage and Parquet).• Implementation of SQL/NO SQL database schemas and queries (MongoDB, Oracle, Postgres).• Ksh, Autosys and Oozie as legacy data pipeline scheduling solution.• Ksh and Airflow as data pipelie scheduling solution.• Dremio as data virtualization tool.• Dataiku as data preparation tool.• Migration from SAS to Spark as a bonus. SKILLS:• Knowledge of banking industry and processes. • Business / IT Relationship. BEHAVIOURAL SKILLS:• Ability to understand, explain and support change. • Ability to Deliver / Results Driven. • Ability to collaborate / Teamwork. • Ability to manage a project as a bonus. • Knowledge of Spark SQL and Spark MLib as bonus. • Experience with tools monitoring and management of logs (Prometheus, Grafana, ELK Stack, …) as bonus.TRANSVERSAL SKILLS: • Agile LANGUAGES: • English C1 • French as a bonus Join us! @Inetum. #Weareinetum

Ver oferta completa

Detalles de la oferta

Empresa

Inetum

Localidad

En toda España

Dirección

Sin especificar - Sin especificar

Fecha de publicación

28/04/2024

Fecha de expiración

27/07/2024

Cómo detectar ofertas falsas

Data Engineer

Innoit

Are you a big data engineer looking for a new challenge? so... solid knowledge of data structures and experience with integration of data from multiple sources... ensures that non-functional/support aspects of data classification and data sharing agreements (dsas) and sign-offs are fulfilled... com/es-es/meetup-de-innoit-consulting-en-barcelona/?_locale=es-es......

Senior Sales Manager

VEGA Group

The career path in our company is clearly designed as below: executive-> senior executive-> assistant manager-> manager-> senior manager-> associate director-> director-> line gm-> country manager-> senior management and partners... job title： senior sales manager feed or food additives career level：......

Qa automation engineer

Innoit

Your profile: at least 3y of experience working as a qa automation engineer... are you a qa automation engineer looking for new challenge? we aspire to reach everyone and connect them to top projects... com/es-es/meetup-de-innoit-consulting-en-barcelona/?_locale=es-es we’re waiting for you......

ELECTRICAL ENGINEER FV DESIGNER BIZKAIA

Engineers Sourcing

Electrical fv engineer bizkaiajob description: company dedicated to engineering, assembly and industrial maintenance... job description electrical engineer (solar project designer), for the development of epc projects in the photovoltaic sector... requisitos del puestorequired qualifications electrical......

CAD Engineer with Solidworks

Recruit4Work

Exciting opportunity for a cad engineer in the recycling industry! are you a skilled engineer with a passion for developing machines and promoting sustainability through recycling? if you have experience in cad drawing using solidworks and a deep understanding of conveyors, shredders, mills, and structural......

Remote Data Contributor – Image collection

TransPerfect DataForce

Our division focuses on gathering, enriching, and processing data for machine learning in different ai domains... we offer high-quality data for human-machine interaction to some of the most prestigious technology companies in the world... position: data contributor project location: spain(remote) engagement......

Asistente de atención médica Senior - Coordinador de turnos

Reach HR Consulting

Estamos buscando un asistente de atención médica senior para coordinar la prestación de atención médica... asistente de atención médica senior - coordinador de turnos - car home / asistencia domiciliaria - turnos de día y de noche - centro de atención continua y domiciliaria - cornwall reino unido reach......

Asistente de atención médica Senior - Coordinador de turnos

Reach HR Consulting

Estamos buscando un asistente de atención médica senior para coordinar la prestación de atención médica... asistente de atención médica senior - coordinador de turnos - asistencia domiciliaria / asistencia domiciliaria - turnos de día y noche - centro de atención continua y domiciliaria - cornwall reino......

CALL 37-2023-1 Satellite Communications Engineer

Centre Tecnològic de Telecomunicacions de Catalunya

Who are we looking for ? the space and resilient communications and systems unit is looking for a satellite communications engineer... * cvs and any other information gathered during this process will be handled confidentially who are we? the center tecnològic de telecomunicaciones de catalunya (cttc)......

CALL 41-2023-1 - Satellite Communications Engineer

Centre Tecnològic de Telecomunicacions de Catalunya