Data Engineering

Introduction

Data Engineering is quite a broad area. In my perspective, it is a role that transforms data into a useful format for analysis by other roles such as Data Scientists or Data Analysts.

Resources

• Microsoft Excel

• Pandas is an open source Python library which in simple terms, provides Excel-like programmatic functions to your datasets. To use pandas, familiarity with the Numpy library is important as they can be used together.

• AWS Data Lake