SPARK-SCALA SENIOR CONSULTANT - HYBRID - EY GDS SPAIN

Job description Requisition ID.
Senior Data Engineer with Spark/Scala   You love working with data of all sorts, small and big.
You enjoy helping clients push the boundaries of extracting business insights and value from the data automatically and efficiently.
The opportunity We are looking for a top-notch technology savvy specialists willing to move our projects on the new track! You will use the most advanced technology stack and have an opportunity to implement new solutions while working with top leaders in their industries.
As a part of our global team, you will participate in national or international projects mostly based and implemented on major three cloud providers (Azure, GCP, AWS).
As a member of our team in the EY GDS Spain office in Malaga, you’ll have a chance to extend your knowledge & experience by working on interesting projects with the newest technologies and approaches.
You’ll support clients in choosing the most suitable business solution and take part in digital transformation.
Your key responsibilities As a Senior Data Engineer with Spark/Scala, you are responsible for building software that enables our clients and business partners to make efficient decisions with ease.
You can design robust solutions on state-of-the-art compute engines such as Databricks, Presto, and modern data warehousing solutions (Synapse, BigQuery, Redshift or Snowflake).
Skills and attributes for success 6+ years of data engineer experience Proficiency in SQL, Scala and Spark Strong background in data pipelining, distributed data processing, software engineering components, and data modeling concepts – Spark Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment Basic knowledge on Elastic or Kibana.
Basic understanding of IntelliJ.
Experience in enterprise-class solution implementations Experience with version control system (GIT, Azure DevOps, SVN)   To qualify for the role, you must have.
Solving complex business problems on a large scale Participating in cross-functional initiatives and collaborating across various domains Good command of English   Ideally, you’ll also have Knowledge of data formats.
Parquet, ORC, Avro, as well as emerging concepts like Deltalake/Apache Hudi/Iceberg Hands-on experience with workflow/pipeline tools like Airflow/Luigi/Oozie Containerisation.
Docker, Kubernetes, DevOps principals Experience in using Agile methodologies (Scrum, Kanban, etc) Experience in Cloud Azure/AWS/GCP Unix Shell Scripting Good understanding of ETL process Spark Data structures (Datasets, Data frames and RDD) Concept of Entity Resolution Cleansing and Parsing Understanding of UI.
Good command of Spanish is valuable, though not mandatory   What we look for   As a menber of our team in the EY GDS Spain office in Malaga, you'll have the chance to extend your knowledge & experience by working on interesting projects with the newest technologies and approaches.
You'll support clients in choosing the most suitable business solution and take part in digital transformation.
What we offer In EY GDS Spain, you will collaborate with our teams on exciting projects and work with well-known brands from across the globe.
We’ll introduce you to an ever-expanding ecosystem of people, learning, skills, and insights that will stay with you throughout your career.
Continuous learning.
You’ll develop the mindset and skills to navigate whatever comes next.
Success as defined by you.
We’ll provide the tools and flexibility, so you can make a meaningful impact, your way.
Transformative leadership.
We’ll give you the insights, coaching, and confidence to be the leader the world needs.
Diverse and inclusive culture.
You’ll be embraced for who you are and empowered to use your voice to help others find theirs.
About EY GDS EY Global Delivery Services (EY GDS) is a dynamic and truly global delivery network of over people working across the world, to provide innovative and strategic business solutions to our clients worldwide.
We play a vital role in growth strategy, helping our clients become agile and efficient, and helping fulfill our purpose to build a better working world.
From accountants to coders, we offer a wide variety of fulfilling career opportunities that span all business disciplines.
We look for skills that are evergreen and our roles evolve with industry trends.
We also work across Finance, Business Development, Technology, Talent, Procurement and Risk Management functions to help our teams operate as efficiently and effectively as possible.
Across our 10 locations and 21 cities, we work with teams from all service lines, geographies, and sectors.
We operate in Argentina, China, Hungary, India, the Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.
Our EY GDS Spain office is located at Malaga Technology Park and currently employs over 750 people.
If you are interested in being part of our team, we kindly invite you to get in touch with us.
The exceptional EY GDS experience.
It’s yours to build.