Job Requisition ID: 31268

• Work on cutting edge data platforms and analytics technologies in real world environments
• Work with clients in Australia and APAC to transform their technology and digital capabilities
• World-class learning, development and leadership programs throughout your career

About us

Our diverse Data & AI team comprises over 500 specialist practitioners across Australia, each of whom are constantly curious and excited about combining their business acumen and technology expertise to create technology solutions that help solve complex problems and transform, or reinvent our client’s business. Our Data & AI team partner with public and private sector clients to design and implement world leading solutions and capabilities.

About the job

Our Data & AI practice brings the full suite of services that focus on applying our experience across the entire data and analytics value chain. This means bringing together expertise across business analysis, systems analysis, data engineering, data management, data architecture, data science and data visualisation.

As a Specialist Lead in our Data & AI team, you will work closely with our clients to deeply understand their business challenges, document their requirements, design and implement next generation solutions using leading data and analytics tools.

You will be working in a cloud and data engineering role in various telecommunication, public transportation and energy utility projects. You will design and implement solutions for various cases from customer decisions, customer 360 view, data ingestion and analytical model building. You will helping clients transition from on-premise data solutions into a cloud environment.

In your typical day, you may:

• Configure and add additional pipelines in existing API data flow using Python, Terraform and Linux
• Build Ingestion scripts and configuration using Python and Linux for multiple sources
• Use AWS services like EC2 instance, Batch, cloud watch and SNS notification
• Update and incorporate logic for changed data capture using SQL on AWS Redshift
• Enhance existing auditing framework to handle multiple file ingestion using Python
• Ingest near real-time stream data using AWS Kinesis ingestion
• Use docker images and WDL in a containerised solution for a cost-effective ingestion solution
• Document and analyse containerised ingestion solution
• Build, schedule, and deployment of ETL job using SQL
• Run data science training sessions for intermediate and advanced topics that include time series forecasting and NLP
• Build analytical models to capture business logic
• Flatten nested JSON files and ingestion into HDFS location using Pyspark
• Build HIVE external tables on the Hadoop ecosystem
• Lead data engineering solutions to build customer segmenation for RFM models
• Build data fusion and sanity check models in data pipelines using Pyspark

You are someone with:

At least 4 years' experience in data and cloud engineering, such as:

• Software engineering - API building using Terraform Pythin and Linux
• Data engineering - Python, Pyspark, Java, Scala, SQL, Linux, Docker, Crontab, WDL
• Databricks - build data fusion and sanity checks using Pyspark and Spark SQL
• Snowflake - build customer segmentation for RFM models
• AWS Cloud engineering - EC2, batch, cloud formation, s3, Kinesis, Redshift, Athena, SQS
• Data warehousing - Oracle EXA data, Oracle ODI, Oracle EDQ
• Data science - machine learning models (random Forrest, SWM) and statistical models
• Designing of HDFS to AWS data pipeline using configuration-based ingestions
• ETL jobs for golden records and customer 360 view

Why Deloitte?

At Deloitte, we create positively differentiated work experiences that enable our people to feel valued and achieve their full potential. Deloitte Australia opens the door to a career that can cross borders virtually and physically across Asia Pacific to gain experience and access projects beyond Australia’s borders. We value difference, and embrace people with diverse backgrounds, experiences, gender identities, abilities and thinking styles. Knowing that people work best in a variety of ways, we are happy to discuss alternative arrangements if the working pattern you are looking for is not specifically indicated.

We’re committed to continually building a safe and respectful workplace, where all our people feel appreciated and accepted. Through the creation of endorsed employee-led diversity networks which promote cultural, disability, LGBTI+, Aboriginal and Torres Strait Islander people and gender equality, we’re leading the way to shape an environment where everybody can thrive.

We are proud to have been recognised for our efforts in inspiring change and accelerating progress – check out our careers site for recent recognition in this space.

Next steps

Sound like the role for you? Apply now.

#LI-DNI

By applying to this job, you will be assessed against the Deloitte Global Talent Standards. We’ve designed these standards to provide our clients with a consistent and exceptional Deloitte employee experience globally.

At Deloitte, we know we’re at our best when we look out for one another; prioritise respect, fairness, development and wellbeing; foster an inclusive culture and embrace diversity in all forms. All qualified applicants will receive consideration for employment regardless of their background, experience, identity, ability or thinking style, and if you need assistance or an accommodation during the application process for accessibility reasons this is available upon request.

The preferred candidate will be subject to background screening by Deloitte or by their external third-party provider.