TRABAJO DATA SPARK KAFKA HDFS
(80 ofertas de trabajo)
Listado de trabajos de Data spark kafka hdfs
Big data engineer - data platform - digital hub @bcn
Primary mission: as a data engineer, you will interact with data scientists, big data architects, software developers, and business experts to understand how data...
Experience and expertise across data integration and data management with high data volumes... experience with data warehousing and visualisation tools...
Big data developer spark scala / pyspark - full remote
Desarrollo de software usando tecnologías big data... evolución y mantenimiento de la plataforma big data... actualmente estamos buscando para una importante empresa...
Assists with updating data from multiple data sources... ) spark (scala and pyspark), hdfs, kafka and other high volume data tools... use of agile and devops practices...
 assists with updating data from multiple data sources... sponsorship is not available for data engineer ii role... sponsorship is not available for data engineer...
You will have a focus on data streaming, data management, data quality, data security and deliver the systems that process huge volumes of data...
• knowledge of spark sql and spark mlib as bonus... it tools:• spark and scala as legacy data pipeline development language... • dremio as data virtualization tool...
data warehousing: optimize data warehouse structures for fast querying and reporting... data integration: integrate data from various sources, both internal and...
Develop and maintain data pipelines, data visualizations, and dashboards to monitor key metrics and kpis... experience with advanced spark functionalities is highly...
¿Quieres encontrar trabajo?
You’ll provide expert guidance to source and integrate structured and unstructured data from dozens of local data sources including streaming data feeds into our...
Data engineer | major technology consultancy
data platform construction: develop a robust data platform tailored for data storage, management, and large-scale processing... data modeling: architect scalable...
Purposethe goal of the data engineer is to architect, specify and implement data access, ingestion, processing, and provisioning of large-scale datasets into the...
We are looking for you!you take care of building, maintaining, and optimizing the infrastructure and data pipelines to store, process, and manage data efficiently...
you will join the data engineering team which is responsible for developing models, practices and systems to support the data lifecycle... io/clarity-ai/clarity-ai-datalocation ...
Net, java big data frameworks: spark, hive, kafka, kubernetes data base: relational (sql server) experience in agile methodology and control version...
Experience on data quality standards and contribution on defining and monitoring data quality metrics and kpis is a plus... the ideal candidate will have good knowledge...
Relevant experience with data process technologies like apache... experience on data quality standards and contribution on defining and monitoring data quality metrics...
Big data infrastructure engineering / devops intern (%)
Knowledge of apache spark... · analyse data ingestions and bottlenecks to improve the latency of data pipelines... maximizing network i/o throughput, improving query...
Research data engineer for the health domain
Experience in the design and development of timely asynchronous data processing systems (batch, streaming) in both big data and non-big data contexts...
¿Quieres encontrar trabajo?
¿Quieres encontrar trabajo?