Senior Data Warehouse Engineer

--Nexio--

Job Description

Job Title:

Data Warehouse Engineer

Remote Work Model:

Hybrid

Contract duration:

6 months (renewable) 

Location:

Bryanston, Gauteng

Requirement:

We are seeking an experienced Senior Data Warehouse Engineer to join our team and take a leading role in the DDW (Data Warehouse) Replacement + Migration initiative on the Azure platform. As a Senior Data Warehouse Engineer, you will be responsible for designing, implementing, and managing the data warehouse infrastructure, as part of the replacement and migration process. Your expertise in data warehouse architecture, ETL (Extract, Transform, Load) processes, data modelling, and cube development will be crucial in ensuring a successful transition to Azure and optimizing data storage, integration, and reporting capabilities.

Job Description:

  • Lead the design, implementation, and management of the data warehouse infrastructure for the DDW Replacement + Migration solution on Azure, adhering to best practices and ensuring scalability, performance, security, and data integrity.
  • Collaborate with stakeholders, including business users and technical teams, to understand requirements and translate them into an effective data warehouse architecture.
  • Design and develop ETL processes using Azure data integration services such as Azure Data Factory, Azure Databricks, or Azure Synapse Pipelines to extract, transform, and load data from various sources into the data warehouse.
  • Utilize data modelling techniques and tools to design efficient data structures and schemas, including both tabular and multidimensional models for cube development.
  • Implement and manage cubes using Azure Analysis Services or SQL Server Analysis Services to provide efficient data storage, aggregation, and query performance for reporting and analytics.
  • Optimize SQL queries, data transformation logic, and cube processing to enhance data loading and query performance.
  • Configure and manage Azure services such as Azure SQL Database, Azure Data Lake Storage, Azure Analysis Services, and Azure Synapse Analytics (formerly SQL Data Warehouse) to support the data warehouse infrastructure.
  • Collaborate with security teams to ensure proper data access controls, encryption, and compliance with data privacy regulations.
  • Monitor and troubleshoot data warehouse performance issues, identify bottlenecks, and optimize resource utilization.
  • Collaborate with cross-functional teams to integrate data warehouse solutions with reporting and visualization tools such as Power BI to enable meaningful data insights and reporting capabilities.
  • Stay updated with the latest Azure technologies, data warehouse best practices, and industry trends to drive continuous improvement and innovation in the data warehouse solution.

Requirements:

  • Bachelor's degree in Computer Science, Information Systems, or a related field (or equivalent experience).
  • Minimum of 7-10 years of experience in data warehouse development and management, with significant exposure to cube development.
  • Expertise in designing and implementing data warehouse solutions on the Azure platform.
  • Proficiency in Azure data integration services such as Azure Data Factory, Azure Databricks, or Azure Synapse Pipelines.
  • Extensive experience with data modelling techniques and tools, including cube development using Azure Analysis Services or SQL Server Analysis Services.
  • Strong SQL skills and experience with SQL-based databases.
  • In-depth knowledge of Azure services such as Azure SQL Database, Azure Data Lake Storage, Azure Analysis Services, and Azure Synapse Analytics
  • Familiarity with Power BI or other business intelligence tools for data visualization and reporting.
  • Proven ability to optimize data loading, transformation, and query performance within a data warehouse environment.
  • Solid understanding of data warehouse concepts, data integration methodologies, and ETL processes.
  • Strong problem-solving and troubleshooting skills related to data warehouse performance and integration issues.
  • Excellent communication and collaboration skills to work effectively with cross-functional teams and stakeholders.
  • Azure certifications, such as Azure Data Engineer or Azure Solutions Architect, are highly desirable.

List of Tools:

  • Azure Data Factory
  • Azure Databricks
  • Azure Synapse Pipelines
  • Azure SQL Database
  • Azure Data Lake Storage
  • Azure Analysis Services
  • SQL Server Analysis Services
  • Power BI

​  

 

Data Warehouse concepts
Familiarity with Power BI
Proficiency in Azure Data Integration Services
Designing and Implementing Data Warehouse Solutions
Data Warehouse Development and Management Expertise