3Pillar Global

Senior Data Engineer

3Pillar Global

Overview

Role involves leading data engineering projects and orchestrating complex data workflows.

Ideal candidate should have 5-8 years of experience in data engineering with strong programming skills.

100k inr / yearremotemidpermanentfull-timeEnglishPythonHadoopSQLSparkHive

Locations

  • India

Requirements

  • 5-8 years experience in data engineering
  • Strong programming skills in Python and Linux Bash
  • Hands-on experience with Luigi
  • Expertise in Hadoop ecosystem tools
  • In-depth knowledge of AWS services
  • Familiarity with monitoring solutions
  • Proven ability to lead projects

Responsibilities

  • Lead data engineering projects
  • Orchestrate complex data workflows
  • Manage SQL databases
  • Deploy and manage data solutions on AWS
  • Monitor and troubleshoot data pipelines
  • Collaborate with stakeholders
  • Guide junior team members