Qualifications
- 5+ years' experience working in Data Engineering and Warehousing.
- 3 -5 years' experience integrating data into analytical platforms
- Experience in ingestion technologies (e.g. Sqoop, Flume), processing technologies (Spark/Scala) and storage (e.g. HDFS, HBase, Hive)
- Experience in data profiling, source-target mappings, ETL development, SQL optimization, testing and implementation
- Expertise in streaming frameworks (Kafka/Spark Streaming/Storm) essential
- Experience in building Spark Sql and Spark Data Frame API based applications.
- Experience managing structured and unstructured data types
Data Platform Engineer — Spark, Kafka & ETL employer: Pyramid Global Technologies
Pyramid Global Technologies is an exceptional employer, offering a dynamic work culture in the heart of Sydney that fosters innovation and collaboration. Employees benefit from comprehensive training programs and growth opportunities within the cybersecurity domain, ensuring they stay at the forefront of industry advancements. With a commitment to work-life balance and a supportive team environment, this role provides a meaningful chance to contribute to critical projects while developing your career.
Contact Details:
Pyramid Global Technologies Recruitment Team
