Num relance
- Tarefas: Desenvolver novas funcionalidades na plataforma Big Data e otimizar aplicações Spark.
- Empresa: Empresa inovadora no setor de tecnologia com foco em Big Data.
- Benefícios: Salário competitivo, benefícios de saúde e oportunidades de desenvolvimento profissional.
- Outras informações: Ambiente dinâmico com oportunidades de crescimento na carreira.
- Porquê este emprego: Trabalhe com tecnologias de ponta e faça a diferença em projetos de grande escala.
- Qualificações: Experiência em desenvolvimento Big Data e conhecimento em Apache Spark e Scala.
O salário previsto situa-se entre 63000 - 77000 € por ano.
Between 3 and 6 years of experience in a similar field; Strong experience in Apache Spark 3, including application optimization techniques and large-scale data processing.
Proficiency in Scala 2.12, particularly for Spark application development.
Solid knowledge of coding best practices, clean code principles and software development standards.
Very good knowledge of the Hadoop ecosystem, including YARN, HDFS, Hive, HBase and Kafka.
Knowledge of Big Data security mechanisms, particularly Kerberos and Apache Ranger.
Experience implementing and maintaining CI/CD pipelines in a Dev Ops environment.
Knowledge of deployment and automation tools, namely Jenkins, XL Deploy and XL Release.
Experience with version control systems, particularly Bitbucket/Git.
Knowledge of job scheduling and orchestration tools, particularly Control-M.
Experience working with on-premises Big Data environments, preferably Cloudera.
Knowledge of functional programming frameworks such as ZIO or Cats is considered an advantage.
Responsibilities
Develop new features and components within the Big Data platform.
Optimize Spark applications to ensure performance, efficiency and scalability when processing large volumes of data.
Rationalize, optimize and reuse existing components to build a consistent, scalable and non-redundant architecture.
Participate in code reviews, ensuring code quality, readability, maintainability and consistency.
Participate in deployments to testing and production environments within a Dev Ops context.
Manage component upgrades, including the associated testing and validation processes.
Implement and maintain CI/CD pipelines.
Write and maintain technical documentation whenever required.
Plan and estimate development tasks, identifying technical requirements and dependencies.
Participate in Agile/Scrum ceremonies, including daily meetings, sprint planning, sprint reviews and retrospectives.
Use collaboration and project management tools such as Jira and Confluence.
Collaborate with Infrastructure teams, Developers, Business Analysts and end users, adapting communication to different technical audiences.
Contribute to continuous improvement initiatives, enhancing development processes, architecture and overall code quality.
Empregador para Big Data Developer in Lisbon: Act Digital
A Act Digital é um excelente empregador, oferecendo um ambiente de trabalho dinâmico e colaborativo em Lisboa, onde a inovação e a tecnologia estão no centro das operações. Os colaboradores têm acesso a oportunidades de crescimento profissional, formação contínua e um forte foco na automação e melhoria de processos, o que torna cada dia uma nova oportunidade para aprender e contribuir. Além disso, a cultura de apoio e a ênfase na segurança e fiabilidade dos sistemas bancários garantem que cada membro da equipa se sinta valorizado e parte integrante do sucesso da empresa.
