We are seeking an experienced Data Engineer to join a dynamic team operating within a complex data integration environment. The ideal candidate will possess strong technical expertise combined with the ability to work with partially documented and quality-challenged data sources. This role involves diagnosing data issues, producing detailed documentation, and effectively communicating technical findings to stakeholders at all levels.
Key Responsibilities:
- Work with undocumented and partially defective data extracts, diagnosing issues systematically.
- Develop and maintain data pipelines using core Azure services and modern architecture patterns.
- Produce formal documentation and communicate technical issues clearly to non-technical stakeholders.
- Profile large datasets, identify data quality issues, and develop solutions.
- Collaborate with teams using version control tools such as Azure DevOps or GIT.
Required Skills and Experience:
- Expert-level SQL development, including complex transformations and data analysis.
- Proficiency in Python and PySpark with hands-on pipeline development experience.
- Practical experience implementing Medallion architecture across multiple data layers.
- Advanced knowledge of Power BI, including semantic modeling, DAX, and visual development.
- Deep understanding of dimensional modeling techniques and their implementation.
- Hands-on data profiling and diagnosis of large, undocumented datasets.
- Experience with version control systems, particularly Azure DevOps or GIT.
- Metadata-driven or framework-based ELT experience, particularly with Azure Synapse or Azure Data Factory.
- Familiarity with Microsoft Dynamics CRM and Dataverse, including data quality issues and GUID generation patterns.
Data Engineer employer: Talent International
At Talent International, we pride ourselves on being an exceptional employer within the higher education sector, offering a dynamic work environment that fosters critical thinking and innovation. Our commitment to employee growth is evident through our supportive culture, where you will have the opportunity to engage with diverse stakeholders and tackle complex business challenges. With a focus on collaboration and professional development, we ensure that our team members are equipped to thrive in their roles while making a meaningful impact in the education landscape.
