Data Engineer
Reporting to the Data Engineering Senior Manager, the successful candidate will be responsible for developing and optimising the Bank’s data flow and collection. The selected candidate will collaborate with stakeholders at all levels, including Business, Operations, and Technology team members, and will have a high interest in keeping up with latest industry best practices.
Malta * Full-time
Duties and responsibilities
- Designing, developing, testing and supporting data collection and data integration with batched ETL and Real-time data processing
- Leading the data integration team in building scalable data pipelines
- Writing scalable code for managing Batch and Real-time data processing, making use of onsite/cloud tools and storage
- Improving existing batch based ETLs, possibly integrating them in real-time data transformations
- Maintaining documentation as evolutions/revisions occur
Required knowledge, skills and experience
- Experience in designing and implementing data streaming solutions involving Kafka, NiFi, Airflow, and Talend technologies
- Strong analytical and troubleshooting skills working in a Linux environment
- Experience on Snowflake platform
- Strong SQL scripting capabilities
- Experience with Linux based scripting tools such as shell and bash, and programming languages like Java and Python
- Being familiar with data structures such as JSON and XML
- Designing and building data pipelines for both batch and real-time data processing
- Conducting research and development on technologies with the aim of assisting the data platform transformation
- Excellent written and verbal communication skills in English
- Familiarity with SCRUM methodology