ProjectTree

Data Engineer

Data Engineer

Surat / Ahmedabad (On-Site, Remote, Hybrid)
Full-Time,
3+ Years Experience

About Project Tree  

At Project Tree, we bridge the gap between complex business challenges and elegant technical solutions. As a premier IT service provider in Gujarat, we specialize in building scalable, future-ready applications. We are looking for a highly technical Data Engineer to architect robust data pipelines and seamless system integrations for our global enterprise clients. 

Role Overview  

As a Data Engineer at Project Tree, you will own the data pipelines that keep our systems accurate and in sync. You will build and maintain ETL jobs, author and extend Airflow DAGs across the Bronze, Silver and Gold layers, investigate and resolve pipeline failures, and ensure data quality through reconciliation and schema validation. Your work will directly support real-time analytics and business intelligence for our global enterprise clients.

Key Responsibilities 

  • Add and maintain ETL jobs by editing job config (source and target tables, primary keys, column lists, filters, schedules) and writing the SQL behind them. 
  • Build and extend Airflow DAGs for the Bronze, Silver and Gold layers, including scheduling, retries and failure alerting. 
  • Investigate failed runs from DAG logs and the run-history tables, and fix the root cause. Typical causes are schema drift, NOT NULL violations, duplicate source rows and wrong keys. 
  • Check data quality: row-count reconciliation, duplicate detection, and column-level schema comparison between source and target. 
  • Maintain Grafana dashboards that show job and pipeline health. 
  • Help prepare and run production rollouts: prerequisites, validation, cutover and rollback steps. 
  • Document pipelines, runbooks and handoffs clearly. 
  • Handle credentials and environments securely (secrets management, least-privilege access, no plaintext secrets in repos).

Technical Skills & Qualifications 

Education:  

  • B.E./B.Tech/MCA/M.Sc. in Computer Science, IT or a related field, or equivalent practical experience. 

Required skills: 

  • 2–3 years of hands-on data engineering or ETL experience. 
  • Strong SQL: joins, window functions, upserts/MERGE, and performance basics. You should be comfortable with SQL Server (T-SQL) and PostgreSQL. 
  • Python, for loaders, DAGs and scripting. 
  • Python, in depth. This is a core skill for the role: 
  • Write clean, modular, production-quality Python 3 (functions, classes, typing, error handling, logging) rather than one-off scripts. 
  • Use pandas or similar for data transformation, and know when to stream or batch instead of loading everything into memory. 
  • Connect to databases with SQLAlchemy, pyodbc/pymssql and psycopg2. Use parameterized queries, transactions, bulk inserts and batched upserts. 
  • Build and maintain configuration-driven loaders that generate SQL dynamically (primary keys, column lists, filters) without exposing it to SQL injection. 
  • Write Airflow DAGs and custom operators or callbacks in Python, including retries, failure alerts and task dependencies. 
  • Handle errors, retries and idempotency, and surface failures clearly in logs and run-history tables. 
  • Write unit and integration tests (e.g. pytest), including testing against sample or mock data. A dry run alone does not prove a job works. 
  • Debug and profile Python code, and manage dependencies with venv/pip inside Docker images. 
  • Use the command line, argument parsing (argparse/CLI tools) and environment-based configuration for secrets. 
  • Working knowledge of Apache Airflow: DAGs, scheduling, operators, connections, and debugging failed tasks. 
  • Understanding of ETL/ELT patterns: incremental loads, upsert versus full refresh, idempotency, and primary-key design. 
  • Comfort with Git and the command line. 
  • Practical experience with Docker and Docker Compose. 

Good to have 

  • Experience with the medallion (Bronze/Silver/Gold) architecture. 
  • Grafana or another BI/monitoring tool for operational dashboards. 
  • Basic Linux administration and AWS EC2 experience. 
  • Email/SMTP alerting setup and cron-style scheduling. 
  • Familiarity with data-warehouse concepts and cross-database access patterns. 
  • Experience with CI/CD and with promoting changes from non-production to production.

Soft Skills 

  • AI-Augmented Efficiency: A forward-thinking mindset with the ability to leverage AI tools (e.g., Copilot for SQL, AI-driven data mapping) to accelerate pipeline development and error detection. 
  • Analytical Problem-Solving: The ability to trace complex data flows and resolve architectural inconsistencies across multiple platforms. 

What we look for in a person 

  • You verify results against real runs and the data, not just a clean dry run. 
  • You are careful with production data and credentials. 
  • You write clear notes so the next person can pick up your work. 
  • You are willing to work with business and application teams to understand source-data quirks.

What We Offer 

  • Career Evolution: We offer a merit-based trajectory from Data Engineer → Senior → Lead, culminating in Principal Data Architect. Your journey is defined by transitioning from technical execution to Strategic Data Governance. 
  • Project Tree Life: We believe in celebrating our wins together! Enjoy a vibrant culture with frequent team lunches, dinners, annual trips, and our signature Cricket tournaments. 
  • The Advantage: Technical autonomy to shape our data strategy, premium hardware at our Iconic Shyamal (Ahmedabad) or Surat offices, and competitive salary benchmarks.

How to Apply 

If this feels like the right role for you, click on the Apply button to submit your Resume and Portfolio/GitHub and complete the application form. 

Apply for this position

Allowed Type(s): .pdf, .doc, .docx
Scroll to Top