Educational requirements: Bachelor
English requirements: Competent English
Requirements for skilled employment experience for years: 3-5 years
Required residence status: Temporary visa, Permanent resident, Citizen
Accept remote work: unacceptable
Essential skills/experience required:
Strong experience as a big data engineer / Developer Programmer / Analyst Programmer working with Hadoop
Solid experience working with Spark, Hive etc
Programming experience with either Scala, Java or python
Excellent written & verbal communication skills
You will be responsible for:
Responsible for the development of Data Analysis tools, analytics reporting and real-time analysis systems.
Work closely with the team to develop well architected & tested code that support the business requirements.
Recommend technologies to use to take advantage of development capabilities for new and existing projects.
Promote and ensure that developed code is well tested and stable.
Work closely & collaboratively with other data platform software engineers within the team and wider business to ensure integrations with their systems.
Liaise with project stakeholders to ensure timely and cost effective delivery of initiatives.
Be responsible for developing documentation that communicates effectively to the relevant stakeholders.
Hands on Big Data SQL variants (Hive-QL, Snowflake ANSI, Redshift SQL)
Python and Spark and one or more of its API (PySpark, Spark SQL, Scala), Bash/Shell scripting
Source code control - GitHub, VSTS etc.
Big Data technologies Hadoop stack such as HDFS, Hive, Impala, Spark etc, and cloud Big Data warehouses - RedShift, Snowflake etc.
Control, coordinate and undertake a range of ICT Services functions in the support and enhancement of systems and the integration of technical solutions.
Guide the development of new techniques that support policy development and implementation
Lead application development projects within ICT Services to meet defined outcomes.
Work with other developers and business units to propose high quality system solutions to meet business goals
Provide support including analysis, development, testing and code review for multiple bespoke applications
