Ver oferta completa

SENIOR DATA ENGINEER

Descripción de la oferta de empleo

Inetum is an agile IT services company that provides digital services and solutions, and a global group that helps companies and institutions to get the most out of digital flow. In a context of perpetual movement, where needs and usages are constantly being reinvented, the Inetum group is committed to all these players to innovate, continue to adapt, and stay ahead. With its multi-expert profile, Inetum offers its clients a unique combination of proximity, a breakdown by sector, and state of the art solutions.We are looking for a DATA ENGINEER to run projects and maintenance activities in Madrid team. ROLES / RESPONSIBILITIES:• Develop data pipelines with Spark and Scala to ingest and transform data from different sources (Kafka topics, APIs, files) into HDFS, IBM Cloud Storage, Parquet or SQL/NOSQL databases.• Manage big data storage solutions in the platform (HDFS, IBM Cloud Storage, Parquet).• Implementation of schemas and queries in SQL/NOSQL databases like postgres, MongoDB or Oracle.• Develop and configure scheduling of data pipelines with a combination of shell scripting and Autosys, Oozie or AirFlow.• Configure Dremio Data Virtualization to interface with Parquet or as a way to expose the data in the different data products. • Configure Dataiku pipelines as a data preparation tool for loading and transformation of data from our big data platform into specific datamarts for data or business products. • Provide N3 level support to end users. IT TOOLS:• Spark and Scala as legacy data pipeline development language.• SparkaaS and Scala as data pipeline development platform.• Experience in the design and development of streaming procesess using Spark Streaming, Spart Structure Streaming, and Apache Kafka.• Management of legacy big data storage solutions (HDFS and Parquet).• Management of big data storage solutions (IBM Cloud Object Storage and Parquet).• Implementation of SQL/NO SQL database schemas and queries (MongoDB, Oracle, Postgres).• Ksh, Autosys and Oozie as legacy data pipeline scheduling solution.• Ksh and Airflow as data pipelie scheduling solution.• Dremio as data virtualization tool.• Dataiku as data preparation tool.• Migration from SAS to Spark as a bonus. SKILLS:• Knowledge of banking industry and processes. • Business / IT Relationship. BEHAVIOURAL SKILLS:• Ability to understand, explain and support change. • Ability to Deliver / Results Driven. • Ability to collaborate / Teamwork. • Ability to manage a project as a bonus. • Knowledge of Spark SQL and Spark MLib as bonus. • Experience with tools monitoring and management of logs (Prometheus, Grafana, ELK Stack, …) as bonus.TRANSVERSAL SKILLS: • Agile LANGUAGES: • English C1 • French as a bonus Join us! @Inetum. #Weareinetum
Ver oferta completa

Detalles de la oferta

Empresa
  • Inetum
Localidad
  • En toda España
Dirección
  • Sin especificar - Sin especificar
Fecha de publicación
  • 28/04/2024
Fecha de expiración
  • 27/07/2024
Data Engineer
Innoit

Are you a big data engineer looking for a new challenge? so... solid knowledge of data structures and experience with integration of data from multiple sources... ensures that non-functional/support aspects of data classification and data sharing agreements (dsas) and sign-offs are fulfilled... com/es-es/meetup-de-innoit-consulting-en-barcelona/?_locale=es-es......

Qa automation engineer
Innoit

Your profile: at least 3y of experience working as a qa automation engineer... are you a qa automation engineer looking for new challenge? we aspire to reach everyone and connect them to top projects... you will participate in defining and driving automated testing strategies... selenium, cypress)......

Asistente de atención médica Senior - Coordinador de turnos
Reach HR Consulting

Estamos buscando un asistente de atención médica senior para coordinar la prestación de atención médica... asistente de atención médica senior - coordinador de turnos - car home / asistencia domiciliaria - turnos de día y de noche - centro de atención continua y domiciliaria - cornwall reino unido reach......

Asistente de atención médica Senior - Coordinador de turnos
Reach HR Consulting

Estamos buscando un asistente de atención médica senior para coordinar la prestación de atención médica... asistente de atención médica senior - coordinador de turnos - asistencia domiciliaria / asistencia domiciliaria - turnos de día y noche - centro de atención continua y domiciliaria - cornwall reino......

Devops engineer
Innoit

Are you a devops / site reliability engineer seeking new interesting opportunity? so... what we can offer you: you will join a highly motivated team, where everyone is developing themselves to higher levels of professionality... we’re very open to hear your opinions and ideas about how we can do things......

Diseñador Gráfico Senior UI/UX
S&F

Diseñador/a gráfico senior ui/ux, con experiencia demostrable para integrarse de forma inmediata en nuestro gran equipo de desarrolladores, realizando tareas de diseño ui/ux/ixd, animaciones y branding para proyectos digitales tecnológicos innovadores... conceptualización y creación de producto digital......

Técnicos senior de radiología - Unidad de salud móvil
Reach HR Consulting

Técnicos senior de radiología - reino unido - unidad de salud móvil de imágenes reach hr es una empresa especializada en la contratación de profesionales sanitarios... rhr busca contratar técnicos de radiología para trabajar como proveedores de diagnóstico y atención médica para el nhs, el servicio nacional......

Ingeniero proyectista PTC Creo Parametric (Pro/Engineer)
Surf engineering

Se precisan proyectistas de ptc creo parametric (pro/egineer) enfocado en elsector industrial mecánico y que tenga una experiencia mínima indispensable y demostrable de 2 años en el desarrollo de proyectos de piezas de caldereria y desarrollo de piezas de chapa con utilizando esta aplicación cad......

CONSULTOR/A SÉNIOR – TRANSACCIONES
Anthesis

¡en anthesis somos el equipo activador del cambio! ¿nuestro objetivo? ¡lo tenemos claro! trabajamos para conseguir un mundo más resiliente, sostenible y justo... colaborarás con expertos en sostenibilidad y consultores técnicos globales de anthesis group, no solo para entregar grandes proyectos sino......

ADMINISTRATIVE DEPARTMENT
Rainsteal Oil & Gas, UK.

Administrative department business analyst, payroll manager, marketing specialist, administration supervisor, human resources officer, financial analyst, senior marketing analyst, logistics coordinator / expert, procurement officer, secretary / office assistants / office clerks / front desk clerks, account......