TRABAJO DATA SPARK KAFKA HDFS

Proficiency in data processing frameworks (e... integration of heterogeneous datasets into a structured data lake and/or data management system (e...

Experience and expertise across data integration and data management with high data volumes... build, validate, and optimize large-scale, big data solutions in heterogeneous...

data engineer - big data en akkodis buscamos dos data engineers especializados en big data para unirse a nuestro equipo... conocimiento avanzado de apache spark...

spark, scala, hive, kafka spark, scala, hive, kafka... senior consultant big data spark en accenture creemos en la tecnología como motor de la reinvención total...

Procesamiento en tiempo real con spark streaming... ejecutar y monitorizar aplicaciones spark mediante jenkins y yarn... configurar y ejecutar archivos de ingesta...

• metodologías data mesh y lakehouse... requisitos imprescindibles • ≥ 5 años de experiencia como data engineer, data architect o similar... responsabilidades principales • diseñar...

Procesamiento en tiempo real con spark streaming... ejecutar y monitorizar aplicaciones spark mediante jenkins y yarn... conocimientos en replicación, alta disponibilidad...

Proven expertise in designing, implementing, and optimizing data pipelines using spark streaming, spark sql, or other spark modules... understanding of data governance...

Knowledge of modern data lakehouse architectures... proficiency with modern data orchestration platforms (e... understanding of llm fine-tuning data requirements...

spark streaming, kafka) for real-time data processing... collaborate with data architects and engineers to define and implement data models, data governance standards...

Buy options for data and ai/ml capabilities (e... proven expertise in: modern data platforms (lakehouse, data fabric, data mesh) cloud and hybrid architectures (aws...

•    experience with data warehousing architecture and data modelling best practices... role purpose: the sr big data engineer is a core member of the agile teams...

Translate business requirements into concrete data engineering tasks and support the integration of new data sources into shared data environments...

Experience and expertise across data integration and data management with high data volumes... experience in implementing end-to-end data solutions...

Understanding of data governance and data security principles is advantageous... collaborate with data scientists and analysts to understand their data needs and...

Integrate data sources and optimize data processing... experience in testing for data processing... experience in ci/cd for the data environment...

Experience · database systems (mysql, postgresql, mongodb, elasticsearch, cassandra db, redis) · implementation of data catalogues (ckan), data brokers and data...

Create efficient etl processes for data extraction, transformation, and loading into data warehouses and lakes... your contributions will be crucial in delivering...

Aws data architect - senior positionabout the rolewe are seeking an experienced aws data architect to lead our clients' digital transformation through innovative...

Implement complex data transformations and enrichment on streaming data... this includes data streaming, data lakes, and analytics databases...