Senior Data Engineer

Job Locations India-Gurgaon
ID
2021-7264

Introduction

EIU logo

 

The Economist Intelligence Unit (EIU) is a world leader in global business intelligence. We help businesses, the financial sector and governments to understand how the world is changing and how that creates opportunities to be seized and risks to be managed.

 

At our heart is a 50 year forward look, a global forecast of the majority of the world’s economies, we seek to analyse the future and deliver that insight through multiple channels and insights, allowing our clients to take better trading, investment and policy decisions.

 

We’re changing, embedding alternate data sources such as GPS and satellite data into our forecasting, products will increasingly be tailored to individual clients, driven by some of the most innovative data in the market. A highly collaborative team of Product Managers, Customer Experience and Product Engineering is being created with a focus on creating business and customer value driven by real time analytics alongside our traditional products.

 

We are recruiting a Senior Data Engineer to accelerate The Economist Intelligence Unit (eiu.com) drive towards becoming a digitally enabled business at scale. We are actively changing our landscape, from supporting desktop data tools, Excel analysis and visualisation pipelines to Cloud scale big data analysis on AWS. Effective Data management is essential for the research and analysis division of the Economist Group. 

 

*Work/Life Harmony: Our team values work-life harmony. We offer flexibility in working hours/locations and encourage you to find your own balance between your work and personal lives.

 

*Our team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives*

 

Accountabilities

How you will contribute:

 

Don’t feel you have to tick every box, the ‘perfect candidate’ doesn’t exist. If you think you can do most of what we are looking for, you could be exactly what we need!

Can you 

  • Build data pipelines: Architecting, creating and maintaining data pipelines and ETL processes in AWS via Python, Glue and Lambda
  • Support and Transition: Support and optimise our current desktop data tool set and Excel analysis pipeline to a transformative Cloud scale Big Data Architecture environment. 
  • Work in an agile environment: within a collaborative agile product team using Kanban
  • Collaborate across departments: Work in close relationship with data science teams and with business (economists/data) analysts in refining their data requirements for various initiatives and data consumption requirements.
  • Educate and train: Required to train colleagues such as data scientists, analysts, and stakeholders in data pipelining and preparation techniques, which make it easier for them to integrate and consume the data they need for their own use cases.
  • Participate in ensuring compliance and governance during data use: To ensure that the data users and consumers use the data provisioned to them responsibly through data governance and compliance initiatives. 
  • Become a data and analytics evangelist: This role will promote the available data and analytics capabilities and expertise to business unit leaders and educate them in leveraging these capabilities in achieving their business goals.

 

It would be an advantage if you have experience working with products that harness real-time, high frequency data sets as well as more traditional data sources. 

Experience, skills and professional attributes

The ideal skills for this role include:

  • Experience with programing in Python, Spark, and Lambda functions
  • Knowledge of building bespoke ETL solutions, and extracting data using Data APIs
  • MS SQL Server (data modelling, T-SQL, and SSIS) for managing business data and reporting
  • Ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, schemas, metadata and workload management.
  • A combination of IT skills, data governance skills, analytics skills and economics knowledge

 

 To succeed in this role it would be an advantage if you possess:

  • Experience with advanced analytics tools for Object-oriented/object function scripting using languages such as C#, R
  • An advanced degree in computer science (MS), statistics, applied mathematics (Ph.D.), information science (MIS), data management, information systems, information science (postgraduation diploma or related) or a related quantitative field or equivalent work experience.
  • Experience in working with data science teams in refining and optimizing data science and machine learning models and algorithms.
  • Adept in agile methodologies and capable of applying DevOps and increasingly DataOps principles to data pipelines to improve the communication, integration, reuse and automation of data flows between data managers and consumers across an organization

Options

Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed