Jobs in Portugal, in English.
12,000+ live jobsSenior Data Engineer (Spark & Airflow)
On-site in Porto·Added yesterday (last checked 17 Nov)
Our summary
- Work mode
- On-site, Porto
- Experience
- 6+ years


Skills
This job advert was originally written in Portuguese.
Requirements
What we're looking for
- Degree in Computer Science or similar;
- Minimum of 6 years of experience in Data Engineering, including architecture or technical leadership roles;
- Proven knowledge in the definition and evolution of modern data architectures, including Lakehouse and hybrid analytical platforms (Data Lake and Data Warehouse);
- Proficiency in SQL, Python, and PySpark, with solid practice in distributed processing (Spark, Databricks, Hadoop, Hive), Cloud environments (Azure, GCP, or AWS), and processing large volumes of data in batch and/or streaming;
- Solid knowledge of engineering best practices, including versioning (Git), automation, and CI/CD pipelines;
- Analytical capacity, attention to detail, critical thinking, and a systemic vision;
- Autonomy, proactivity, and the ability to work with multidisciplinary teams.
Nice to have
- IBM DataStage, migration of ETL processes to Spark, Apache Airflow, and workflow orchestration will be valued;
The role
Noesis is looking for a Senior Data Engineer with experience in data architecture or technical leadership to join a Data Engineering team.
What you'll do
- Analyze and migrate ETL processes from IBM DataStage to Spark (PySpark and SQL), adapting and optimizing them for distributed execution;
- Migrate workflow orchestration from CAWA to Apache Airflow, implementing DAGs and ensuring integration with Spark processes;
- Act as a technical reference in the definition of standards, best practices, and the technical roadmap for Data Engineering.
Requirements
If you meet these conditions and would like to join an innovative organization that continuously invests in the training of its talents, send us your application.
Join us. Let’s innovate together!
All our recruitment and selection processes are based on equal opportunity, valuing the competence and potential of each person and ensuring that no candidate is discriminated against based on gender, ethnicity, sexual orientation, age, religion, or physical condition.
- Advertisement created under Law No. 4 / 2019, of January 10th
More jobs like this
or browse Data engineering·Senior·Best Workplaces Portugal·IT Consulting