SENIOR DATA ENGINEER

Descripción de la oferta de empleo

The Senior Data Engineer will do:You'll immerse yourself in all aspects of our ever-growing set of external and internal data pipelines, understand the problems, and tie them back to data engineering solutionsYou'll come up with architectural patterns to validate and consume source data, thinking end to end, constantly evolving our data architecture to balance scalability and performance.You'll transform raw data from different sources (batch and near-real-time) into intuitive data models, using a diverse set of tools (such as Spark, Hadoop, Redshift, Kafka, etc.) to build robust data pipelines of high quality in a scalable fashion (regarding volume and maintainability).You'll build and experiment with different tools and tech, and share learnings with the larger team. You'll contribute to internal tools that enable efficiency throughout the Company, both for data processing and analysis. Top 2 start-ups with impact worldwide Experienced Data Engineer The Senior Data Engineer will have:You have 3+ years of professional experience as a data engineer, and hold a degree in a quantitative field (CS, Engineering, Math, Physics, … ).You thrive in collaborative, start-up paced environments with fast-changing requirements and priorities; you are always ready and eager to learn.You have built production data pipelines in the cloud, setting up data-lake and server-less solutions; on top of that, you have hands on experience with schema design and data modeling.You are proficient in at least one major programming language such as Java, Scala or Python. You have a software engineering mindset and strive to write elegant, maintainable code and you're comfortable working in a variety of tech stacks. You may even be a software engineer with a focus or passion for data-driven solutions.You have strong SQL skills and knowledge and familiarity with other distributed data stores such as Redis, ElasticSearch, Druid, Cassandra, Hbase.You are comfortable working in containerized cloud developments, and familiar with the integration of public and private APIs.You are fluent in both Spanish and English (minimum C1 level). Company with a disruptive tech tool allows systematic measurement and optimization of the social impact of investment portfolios, and our proprietary methodology provides a deeper understanding of the needs of the population and give a comprehensive view of how those needs are covered by different economic actors. Together, the tool and the methodology will improve the allocation of the World's capital to human needs. Interesting professional opportunity The Senior Data Engineer will transform raw data from different sources (batch and near-real-time) into intuitive data models, using a diverse set of tools (such as Spark, Hadoop, Redshift, Kafka, etc.) to build robust data pipelines of high quality in a scalable fashion (regarding volume and maintainability).
Ver oferta completa
No me interesa

Detalles de la oferta

Empresa
  • Sin especificar
Salario
  • 50000€
Fecha de publicación
  • 21/02/2019
Fecha de expiración
  • 16/07/2019