Senior Data Engineer (Scala/Spark + AWS)

As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable Big Data solutions. You will work with large datasets, real-time processing frameworks, and cloud-based platforms to ensure clean, reliable, and actionable data for decision-making.

Your Skills & Experience

• 5+ years of experience in Data Engineering, with a strong focus on Apache Spark and SQL.

• Ideally 2+ years of recent, hands-on experience with Scala and a strong willingness to ramp up and train in Scala (Scala training will be provided)

• Prior exposure to stream processing projects.

• Proven ability to reverse-engineer and optimize SQL queries — and ideally Scala code — to enhance performance and understand existing systems.

• Experience designing and implementing ETL/data pipelines on AWS using services such as EMR, Glue, Kinesis, Lambda, S3, and Redshift.

• Strong knowledge of database design, data modeling, and data mining techniques.

• Demonstrated experience in data cleaning, preparation, and validation, ensuring accuracy and reliability across datasets.

• Proficiency in applying statistical techniques for data analysis and insight validation.

• Solid understanding of distributed computing, cloud storage, and performance optimization in large-scale data environments.

Set Yourself Apart With

• Knowledge of other programming languages like Python, R, Oracle, JavaScript, XML, or ETL frameworks.

• Familiarity with data visualization tools (Tableau, Qlik).

• Experience with reporting packages (Business Objects, etc.).

• Familiarity with containerization and orchestration tools (Docker, Kubernetes) for deploying Big Data workloads.

• Knowledge of data governance, security, and compliance frameworks.

• AWS Certifications such as AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect.

This is a full-time role (40 hours per week) open to both permanent and contractor hires in Mexico, Colombia, and Costa Rica, and available only as a contractor position in Brazil.

Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting, and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting, and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value.