Senior Data Engineer (INBW23197) Amsterdam, Nederland
As a Senior Data Engineer, you will design, develop, and maintain the data infrastructure to support all data-driven initiatives. You will utilise your expertise in Python software development to design and implement efficient data ingestion pipelines to ensure the smooth and reliable extracting, transformation and loading of data from various sources. Among your repsonsibilities:
- Design, implement and manage data ingestion tools and processes:
- Select and configure the most suitable tools;
- Ensure seamless integration with existing systems and optimize data ingestion processes;
- Work with streaming platforms:
- Handle real-time data streams efficiently;
- Establish data lake infrastructure;
- Create a robust and scalable data lake infrastructure by applying your expertise in parquet and delta lake formats;
- Implement best practices for data organization, storage, and retrieval.
In addition, you will have the opportunity to contribute to projects involving spatial analysis, visualization, and mapping (handle geospatial data).
You will get to leverage your knowledge to enhance data organization, discoverability, and interoperability within our systems (explore semantic web databases).