JD: Snowflake/dbt/Python/ADF
Total years of exp:10+ experience
Relevant exp: 4+ years of working experience in Snowflake, dbt , Python, ADF on Azure in production environments and hands-on experience in developing moderate to complex ETL/ELT data pipelines
Job location: India GDC location
Mandatory skills: Snowflake, dbt , Python, ADF on Azure
Shift Timing: as per client
Detail JD:
Strong experience in SQL, Python, Snowflake, dbt, and ADF.
• 4+ years of working experience in Snowflake, dbt , Python, ADF on Azure in production environments and hands-on experience in developing moderate to complex ETL/ELT data pipelines
• Advanced SQL in Snowflake (CTEs, Views, UDFs, Materialized Views) & DBT
• Partitioning, clustering, and performance tuning in Snowflake Streams, Tasks, and Snowpipe for real-time and incremental data pipelines
• Cost and query optimization (e.g., using result cache, pruning, compute credits control)
• DBT-Data Modeling, SQL Mastery, Workflow Optimization & Configuration a plus, Data Loading and Cleaning
• 3+ years of hands-on experience with Cloud Composer (Airflow) developing DAGs
• 3+ years of ETL Python development experience; experience parallelizing pipelines
• Demonstrated ability to troubleshoot complex query, pipeline, and data quality issues
• Develop, test, and deploy robust ETL pipelines on Snowflake on MS Azure Platform using, but not limited to, Snowflake/dbt, Cloud Composer, and Cloud Run to ingest structured/unstructured data from on-prem SQL Server instances into Snowflake Models/Database/Schema
• Implement data validation checks, error handling, and logging to ensure pipeline reliability
Automate deployment workflows using CI/CD pipelines (GitHub Actions, etc.) and infrastructure-as-code (IaC) tools
• Monitor pipelines via Cloud Logg