Spoke Data Engineer

Apply now »

Date: Dec 17, 2024

Location: Other City, WFH, FR

Company: sistemasgl

 

Organization

 

Our client is the leading global partner in employee benefits & engagement, dedicated to making life better for millions of people, across more than 30 countries.
The group’s mission is to open a world of opportunities in creating sustainable and personalized employee experiences to bring more freedom and enrichment to work and beyond.

 

Position Overview

 

Client's Data organization has chosen a decentralized Data Hub (central) & Data Spoke (local) organization where the Spokes are data factory teams covering multiples countries Data needs and supporting business teams by delivering Business intelligence reports, ad-hoc analysis supporting decision-making and advanced insights aiming at predicting clients, merchants, or consumers behaviours.

 

Reporting to Data Spoke Manager, the Spoke Data Engineer is a member of Spoke Data Team. You are a data flow expert, work on multi-domain projects and deliver data ingestion workflow to serve the country business.

Mission & Responsabilities

 

  • Data flow expert:
    • Ingest data into the company data platform
    • Implement cost-efficient and industrialized data jobs on a hybrid infrastructure (on premise / cloud) mixing several technologies: Rest API, SQL & NoSQL databases, batch and files… with different latencies (from batch to Realtime)
    • Design Data Model (star schema, data vault) and tables (SCD pattern) to ensure data accuracy and relevance and to feed Power BI dashboard, IT systems, etc
    • Diligently maintain and update documentation, ensuring clarity, accuracy, and accessibility for all technical and non-technical stakeholders

 

  • Data Platform user:
    • Understand the data platform architecture and the purpose of each Azure ressources
    • Enhance data quality following Data Governance principles
    • Ensure compliance with data protection law
    • Monitor the data ingestion jobs
    • Develop, test, and deploy code and jobs within a DevOps framework, expertly managing branches, pull requests, and test environments
    • Collaborate with and follow the guidelines set by the Hub team, ensuring alignment with our highest standards and practices
    • Contact with clear information (errors, tests, context, etc) the Hub team when the local Data Engineer team needs help

 

  • Project Management:
    • Understand and interpret business objectives, adeptly converting them into technical workflows that align with our strategic goals
    • Skilfully dissect complex projects or features into manageable, coherent technical subtasks, ensuring efficient and effective execution
    • Maintain and update project boards with accurate, up-to-date information, providing a clear view of project development progress and milestones.

 

This is your chance to be part of a dynamic team where your expertise in data platform management and project execution will drive innovation and contribute significantly to our business success. Your role is pivotal in ensuring the smooth and effective use of our data resources and in steering our projects towards their strategic objectives.

 

Profile, Experience & Key Competencies

 

  • Master's degree in computer science or data engineering or equivalent
  • At least 2 years building and managing ETL and ELT processes
  • Advanced knowledge of data lake and data warehouse for analytical and operational purposes
  • Experience in working transversally in an international company and in an agile organization
  • Fluency in English is required.
  • Good understanding of company business
  • Agile Project Management Knowledge (tracking on Azure Boards)
  • Communication and Negotiation
  • Ability to work autonomously
  • Team spirit and engagement in projects
  • Strong SQL skills: querying, procedures and basic administration tasks
  • At least one of the following languages: C#, Python or Node.js
  • Data modelling for Analytical purposes
  • Data modelling for OLTP databases
  • ETL and ELT principles
  • Cloud computing: storage, serverless, API … (Azure is a plus)
  • Distributes computation with Spark (databricks or Spark)
  • Good understanding of python applied to Machine Learning
  • Devops principles with CI/CD (azure devops) and infrastructure as code
  • Rest API: Oauth, Swaggers, backend services
  • Real or near real-time data process design and implementation

 

Working Conditions:
This is a full-time role.
Hybrid: on site and work from home according to hosting country policy

 

Country to work: Spain, Italy, Portugal, UK, France, Romania, Austria, Bulgaria, Belgium, Poland, Czech, Luxembourg


Joining as a Spoke Data Engineer offers an exciting opportunity to be at the forefront of our strategic initiatives. As a collaborative and innovative team, we value your expertise in driving successful project execution and making a significant impact on the organization's growth and success.


Job Segment: Database, Project Manager, Cloud, Data Modeler, Work from Home, Technology, Contract, Data

Apply now »