Lead Data Engineer

Date: 17 Apr 2024

Location: IN

Company: kmartaustr

Brighter Futures Start Here

Anko is the global capability centre for Kmart Group Australia, fuelling growth aspirations of iconic Australian retail brands Kmart, Target and Anko. Based in Bangalore, India, we strive to accelerate retail innovation by building competitive capabilities in Technology, Data Sciences and Business Services that enable our brands to deliver delightful experiences to our in-store and online customers

Join our team, choose your own path and work on projects that excite you.

 

 

Team name: Data Platform

The Data & Analytics team exists to drive competitive advantage through best-in-class data, analytics, and insights for the Kmart group. This team comprises of 75 members globally – bulk of them based out of India. The team in India was set up in July 2019 with 10 members and has grown considerably over the last 2 years. Our teams are embedded within each business function and work on strategic projects such as customer engagement, supply chain transformation, product quality etc  across the Kmart group. We are paving the way to bringing in a data culture in the wider organization and we get to see this impact in the form of improved sales, cost savings and customer satisfaction. Everyday is a new learning. We use the latest cloud platform tools, data engineering practices and data science methods to achieve our goals.

What you’ll be doing   

 

  • Design, develop, and maintain robust, scalable and sustainable data product and build & optimizing data pipeline and infrastructure.
  • Excellent problem-solving and communication skills
  • Proven experience in designing and implementing large-scale data solutions, including data pipelines and ETL processes.
  • In-depth knowledge of data warehousing concepts and data modelling techniques.
  • Collaborate with stakeholders to understand their data requirements and translate them into technical solutions.
  • Identify and implement data quality monitoring and validation processes to ensure data integrity.
  • Work closely with data scientists and analysts to support their data needs and enable advanced analytics and machine learning initiatives.
  • Provide technical leadership and mentorship to junior data engineers, guiding them in best practices and fostering their professional growth.
  • Contribute to the development of the organization's data strategy, including evaluating new technologies, tools, and frameworks to enhance the data engineering ecosystem.
  • Implement data quality frameworks and ensure data governance best practices, including data lineage, data documentation, and data security.

 

 

Technical Skills 

 

  • Troubleshoot and resolve data-related issues, performance bottlenecks, and scalability challenges.
  • Excellent analytical abilities
  • Solid understanding of DevOps principles and experience with infrastructure automation using tools like Terraform or CloudFormation.
  • Excellent problem-solving, communication, and collaboration skills.
  • Hands-on experience with cloud platforms, such as AWS or Azure, and related services (e.g., EC2, S3, Snowflake, Data Lake, etc.).
  • Understandings of data warehousing concepts and best practices
  • Work closely with stakeholders to understand business requirements and translate them into data solution designs.
  • Strong understanding of data architecture principles, data modelling techniques, and data integration patterns.

 

Desired qualification and work experience  

 

  • 7- 10 years to total IT experience preferably in field of data engineering
  • 5+ years’ experience with AWS services including Lambda, IAM, API gateway.
  • 4+ years’ experience in creating and deploying docker containers on Kubernetes.
  • 4+ years’ experience in supporting development teams on Kubernetes best practices, troubleshooting, and performance optimization.
  • 4+ years’ experience with CI/CD pipelines toll such as Jenkins and GitHub Actions
  • 4+ years’ experience with Snowflake data warehousing and data lake solutions
  • Strong programming skill in Python, Java or Scala
  • 4+ years of experience in scripting and automation using languages such as Bash, Python, or Go
  • 4+ years of experience with infrastructure-as-code tools such as Terraform, Ansible, or CloudFormation and containerization technologies (e.g., Docker, Kubernetes).
  • Knowledge of Agile methodologies and software development lifecycle processes

A place you can belong

We celebrate the rich diversity of the communities in which we operate and are committed to creating inclusive and safe environments where all our team members can contribute and succeed. We believe that all team members should feel valued, respected, and safe irrespective of your gender, ethnicity, indigeneity, religious beliefs, education, age, disability, family responsibilities, sexual orientation and gender identity and we encourage applications from all candidates.