This position is no longer open for applications

Freelance Date Engineer

We are currently looking for a freelance data engineer for a big client in the Travel industry;

Job Summary
Our client is searching for a Data Engineer with experience with bigdata and business intelligence.
The candidate will: Design and deliver a fact table that will support the calculation of business metrics, Write an oozie workflow using hadoop, to schedule table’s update, using one querying/scripting language (hive query language, pyspark..) Documentation about the project: how to maintain the system, extend it, data flow diagram.

Requirements recommendation for the Consultant
Knowledge of Big Data, particularly Hadoop
Knowledge of one querying language (hive dialect of SQL) or pyspark
Knowledge of version control systems (preferably Git)
Knowledge of scheduling with oozie
Knowledge of data warehousing with Hive Experience with working with Business Intelligence data pipelines
Experience with working with big data

Key Responsibilities
Rapidly developing next-generation scalable, flexible, and high-performance data pipelines;
Solving issues with data and data pipelines, prioritizing based on customer impact, and building solutions that prevent them from happening again (root cause);
End-to-end ownership of data quality in our core datasets and data pipelines;
Experimenting with new tools and technologies to meet business requirements regarding performance, scaling, and data quality;
Providing tools that enhance Data Quality company wide;
Developing integrations between multiple applications and services, both on premise and in the cloud;
Contributing to self-organizing tools that help the analytics community discover data, assess quality, explore usage, and find peers with relevant expertise;
Building effective monitoring of data, and jumping in to handle outages.
This role may require to be on an on-call rotation

Requirements of special knowledge/skills
Software Systems Design Evaluate possible architecture solutions by taking into account cost, business requirements, technology requirements and emerging technologies Describe the implications of changing an existing system or adding a new system to a specific area, by having a broad, high-level understanding of the infrastructure and architecture of our systems Help grow the business and/or accelerate software development by applying engineering techniques (e.g. prototyping, spiking and vendor evaluation) and standards Meet business needs by designing solutions that meet current requirements and are adaptable for future enhancements
Critical Thinking Find solutions to difficult or complex issues by applying different skills and techniques like analytical thinking, lateral thinking, and logical reasoning Constructively improve existing ideas, plans and solutions by reviewing them in a critical yet constructive manner, initiating concrete improvements and articulating their rationale Continuous Quality and Process Improvement Identify opportunities for process, system and/or structural improvements, by applying an understanding of process flows and the methods that can be used to boost effectiveness and efficiency
End to End System Ownership Own a service end to end by actively monitoring application health and performance, setting and monitoring relevant metrics and act accordingly when violated Reduce business continuity risks and bus factor by applying state-of-the-art practices and tools, and writing the appropriate documentation such as runbooks and OpDocs Reduce risk and obtain customer feedback by using continuous delivery and experimentation frameworks Independently manage an application or service by working through deployment and operations in production
Effective Communication Deliver clear, well-structured, and meaningful information to a target audience by using suitable communication mediums and language tailored to the audience Achieve mutually agreeable solutions by staying adaptable, communicating ideas in clear coherent language and practicing active listening Ask relevant (follow-up) questions to properly engage with the speaker and really understand what they are saying, by applying listening and reflection techniques.

Contractdetails
Startdate: As soon as possible
Duration: 3 months, with option to extend
Hours: 32-40 hours, working hybridly is possible

*Please note that it is mandatory to be located in the Netherlands for this position