As a Data Engineer, you'll play a crucial role in managing and transforming data for the company. You'll work with various tools to build efficient data pipelines and ensure data is accessible and usable for reporting and analysis.
The Data Engineer position at Swan iT Recruitment Ltd in Cape Town involves designing, building, and maintaining data pipelines. You will primarily work with Azure Data Factory and Databricks to ensure that data flows smoothly from various sources to the desired destinations. Your role will be essential in transforming raw data into a format that can be easily analyzed and reported on.
In your day-to-day work, you will write SQL for data modeling and transformation, which is crucial for creating effective reporting layers. Additionally, you will have the opportunity to integrate APIs, which will enhance the functionality of the data systems you build. Your experience with Azure DevOps will be beneficial, although it is not mandatory.
This role is ideal for someone who enjoys working with data and has a solid understanding of data engineering principles. You should be comfortable with coding and have a knack for problem-solving. The position requires a proactive mindset and the ability to work independently while also collaborating with other team members to achieve common goals.
Key responsibilities include: • Designing and building ETL/ELT data pipelines • Writing SQL for data transformation and reporting • Integrating APIs to enhance data systems • Maintaining and optimizing existing data processes
If you are passionate about data and have experience with the necessary tools, this role could be a great fit for you.
You'll be taken to the original listing on PNet to apply.