3Pillar Global

Data Engineering Lead

3Pillar Global

Overview

Lead data engineering initiatives to drive innovation and optimize data solutions.

Ideal candidate should have 8+ years of IT experience with strong data engineering skills and leadership capabilities.

remoteseniorfull-timeSnowflakePythonHadoopSQLSparkHive

Locations

  • India

Requirements

  • 8+ years of IT experience
  • 5 years in data engineering
  • Strong experience in Snowflake
  • Strong programming skills in Python and Linux Bash
  • Hands-on experience with Luigi
  • Expertise in Hadoop ecosystem tools
  • In-depth knowledge of AWS services
  • Proven ability to lead projects

Responsibilities

  • Lead data engineering projects
  • Orchestrate complex data workflows
  • Manage data storage and query optimization
  • Deploy and manage data solutions on AWS
  • Monitor and troubleshoot data pipelines
  • Collaborate with stakeholders
  • Guide junior team members
  • Design or optimize data lake solutions