Senior Data Engineer
Reporting to the Senior Data Engineering Manager, the successful candidate will be responsible for developing and optimising the Bank’s data flow and collection. The selected candidate will collaborate with stakeholders at all levels, including Business, Operations, and Technology team members, and will have a high interest in keeping up with the latest industry best practices.
Malta * Full-time
Duties and responsibilities
- Designing, developing, testing, and supporting data collection and data integration with batched ETL and Real-time data processing
- Using analytical and statistical approaches in building data sets and driving business decisions
- Writing scalable code for managing Batch and Real-time data processing, making use of onsite/cloud tools and storage
- Improving existing batch-based ETLs, possibly integrating them in real-time data transformations
- Assisting in maintaining the existing infrastructure and its migration
- Maintaining records and documentation as evolutions/revisions occur
- Building analytical tools that utilise the data pipeline, to provide actionable insights into key customer business performance metrics
Required knowledge, skills and experience
- Experience in designing and implementing data streaming solutions involving Kafka, NiFi, Airflow, and Talend technologies
- Strong analytical and troubleshooting skills working in a Linux environment
- Building intuitive and scalable data models on Snowflake platform
- Strong SQL scripting capabilities
- Experience with Linux based scripting tools such as shell and bash, and programming languages like Java and Python
- Being familiar with data structures such as JSON, XML, and CSV
- Designing and building data pipelines for both batch and real-time data processing
- Conducting research and development on technologies to assist the data platform transformation
- Excellent written and verbal communication skills in English