Senior Spark/Pyspark

Dellent is a consulting company focused in System Information and Telecommunications. Our goal is to help our candidates and consultants to take a step forward in their careers through projects that meet their needs and expectations.

Can you imagine yourself being part of a global, innovative, and ever-evolving project, where technology and creativity come together to create solutions that make a real impact? If you’re looking for a dynamic environment with a culture of collaboration and innovation, where you’ll have access to exciting challenges and real opportunities for growth, then this is the project for you!

We are looking for a Senior Spark/Pyspark to work in Braga, Coimbra or Lisbon (Hybrid).

Profile’s Role

• Experience with reworking and modernizing our python and pyspark ETL library and Delta tables, possibly leaning more toward software engineer than strict data engineer;
• Experience with Databricks is a plus;
• Strong kills with Python/Pyspark and SQL knowledge;
• Experience with building out Data Quality framework with the Great Expectation spark library;
• Fluency in English (C1);

What can you expect from us

• Health insurance;
• A personalized training plan, with a budget to spend on the training and technical books you find necessary;
• Constant feedback so you can grow professionally;
• Remote onboarding process;
• Team events every semester so you can live new adventures;
• Culture of proximity and transparency. Your ideas and needs are heard and valued by us!