Context
The Belgian, German and European energy landscape is in full swing. Did you know that our client plays a crucial role in this?
As part of their team, a European transmission system operator, ensures the reliability and sustainability of the electricity supply.
Side-by-side with other Contingent Workers and internal staff, you will play a part in building a sustainable, green and reliable energy infrastructure that stimulates economic growth and reduces our ecological footprint.
Only together can we make the biggest impact possible! We believe in the power of diversity: we are convinced that an inclusive and diverse work environment leads to more innovation, creativity and better results.
Mission description
Within the corporate Digital & Data department, they aim at facilitating and driving their organization to leverage data. At our client, data is considered a major asset for the business to achieve its targets (strategic ambitions, innovation or transformation themes, objectives, and regulatory compliance).
With their Data Platform consisting of:
- Cutting-edge Integration Toolset,
- Business Intelligence, Analytics, and storage capabilities,
- A platform for the Management of Master Data,
- A Data Governance platform that encompasses Data Lineage and Data Quality.
With their Data Organization consisting of:
- Business Product Teams (supporting the business stakeholder initiatives, organized according to Agile principles),
- Backbone/Platform Teams (supporting the data platform initiatives, organized according to Agile principles),
- Transversal Competencies Team (supporting the various profiles and technologies initiatives, organized according to Agile principles (Spotify)).
Their Data Organization never stands still: No status-quo! Accordingly, they challenge themselves and the organization continuously. They work in a quite flat hierarchy, with their teammates widespread in agile teams, and according to the principle of open source.
They are looking for a Data Engineer Service, who will primarily join one of their product teams. It is an opportunity to mark with your signature their corporate Data organization, and contribute indirectly to better products to manage their customers, as well as more qualitative data or services around data for their customers.
Role & responsibilities
- Design and implement data pipelines: Create efficient data pipelines using Azure services such as Azure Databricks, Azure Data Factory, Azure Functions, Azure Stream/Log Analytics, and Azure DevOps.
- Develop storage structures: Build and maintain efficient storage structures and powerful materialized views in various analytical technologies.
- Create data exchange endpoints: Develop data exchange endpoints for users, ensuring seamless data flow and accessibility.
- Interact with governance tools: Engage with data governance tools, including Glossary, Modeling, Lineage, and Data Quality, to ensure data integrity and compliance.
- Collaborate with business analysts and stakeholders: Work closely with business analysts and stakeholders to refine requirements and present reusable, integrated solutions.
- Contribute to testing and DevOps: Participate in extensive testing of solutions and reinforce DevOps principles within the team.
- Document solutions: Contribute to the writing and structuring of documentation for data solutions and processes.
- Implement data enrichments with Python: Use Python in a Databricks environment to implement data pipelines and data enrichments.
- Challenge and advise the business: Provide logical and well-reasoned advice to the business without making decisions for them, ensuring a collaborative approach.
- Promote a transversal data approach: Continuously look at data across the entire enterprise to maximize coherence, reuse, and adoption, avoiding data silos.
Profile
- Experienced Data Engineer: Over 3 years of experience in a similar role, demonstrating proficiency in data engineering tasks.
- SQL Server Expertise: Skilled in using SQL Server for database management and data manipulation.
- Azure Services Proficiency: Experienced in implementing data pipelines using Azure Databricks, Azure Data Factory, Azure Functions, Azure Stream/Log Analytics, and Azure DevOps.
- Python and Databricks: Proficient in implementing data pipelines and data enrichments with Python in a Databricks environment.
- Multilingual: Fluent in English (mandatory) and proficient in German, French, or Dutch (preferred).
- Tech-Savvy and Adaptable: Open to learning and adopting new technologies such as Redis, RabbitMQ, Neo4j, and Apache Arrow.
- Collaborative: Able and willing to interact with business analysts and stakeholders to refine requirements and present reusable, integrated solutions.
- DevOps and Testing: Contributes to extensive testing of solutions and reinforces DevOps principles within the team.
- Documentation Skills: Capable of contributing to the writing and structuring of documentation for data solutions.
- PowerBI Experience: Experienced in using PowerBI for data visualization and reporting.
We use the pronoun « they » or « the candidate » wherever possible to include all individuals when talking about candidates, regardless of their gender identity. We believe that everyone should be treated with respect, regardless of their gender identity.