Sr Technical Lead – AWS Cloud Engineering

Location – Hyderabad/Bangalore

Job Description :

• 10+ years of experience in Data Engineering / Big Data / Cloud Data Platforms
• 5+ years of hands-on experience with Databricks
• Strong expertise in PySpark / Scala
• Experience with Delta Lake and Lakehouse Architecture
• 5+ years of experience with Azure ADLS Gen2
• RBAC, ACLs, hierarchical namespace
• 4+ years of experience in AWS Glue
• Glue ETL Jobs, Workflows, Crawlers, Glue Data Catalog
• 3+ years of experience designing data ingestion and transformation pipelines using Spark-based frameworks
• Lead design and development of scalable data platforms and pipelines
• Architect Lakehouse solutions using Databricks, Delta Lake, and Medallion architecture
• Build and optimize Spark-based ETL/ELT pipelines using PySpark/Scala and AWS Glue
• Integrate and manage data across ADLS Gen2 and S3 with proper governance and security
• Ensure data quality, performance tuning, and cost optimization
• Implement IAM, RBAC, and access control for secure data operations
• Establish coding standards, conduct code reviews, and mentor team members
• Collaborate with stakeholders to translate business requirements into technical solutions
• Work with DevOps teams to enable CI/CD and smooth deployments

Key Skills: AWS, Databricks, Azure, AWS Glue, Pyspark, S3, ADLsGen2, Lamda.