Module Lead – Data and AI

Location – Hyderabad or Bangalore

Experience – 6 to 8 Years

        Job/Role Description

• Analyze users’ needs to identify and recommend technical requirements that align with project objectives.
• Confer with management and development teams to prioritize needs, resolve conflicts, and determine solutions.
• Evaluate code to ensure validity, proper structure, compliance with standards, and compatibility across platforms.
• Identify, locate, and acquire data needed for projects, ensuring data curation as required.
• Periodically collaborate with stakeholders to manage change and drive projects to completion.

• Write, test, and debug serverless software applications on the AWS platform.
• Detail the design of user interfaces, applications, and database services for effective solutions.
• Review and contribute to high-level design and architecture discussions, offering valuable insights.
• Configure environments, Data pipelines, and Infrastructure-as-Code (terraform) for efficient development and deployment.
• Perform thorough code reviews to ensure adherence to standards and code quality.
• Take responsibility for delivering comprehensive technical documentation.
• Collaborate with cross-functional teams including product management, QA, and operations to ensure project success.

Primary Skills (Must have)

• Strong handson experience in SQL, PySpark, AWS Glue for Data Engineering, AWS Glue Catalog, MWAA (Airflow DAG), Strong Experience in AWS cloud environment, AWS S3, AWS Serverless Services using Lambda, AWS EMR (big data), AWS RDS
• Good knowledge in Data Engineering Methodologies, Data Ingestion techniques and Data Modeling (preferably Dimensional Data Modeling)
• Good in performance tuning of Spark Applications
• Deep Understanding of IAM Roles

Key Skills: AWS, Glue, Python, PySpark