Data Engineer
In a nutshell, a data engineer transforms data into a useful format for analysis. Data engineers focus on the applications and harvesting of big data.
They may be experts in:
- System architecture
- Programming
- Database design and configuration
- Interface and sensor configuration
More than any other professional working in data science, data engineers have to be hands-on with the tools of the trade such as: Hive, Hadoop, Spark, NoSQL, and other high-tech tools for data storage and manipulation
Concepts of data architecture and pipeline design are even more important. They must have a solid conceptual understanding of:
- Data models
- Relational and non-relational database design
- Information flow
- Query execution and optimization
- Comparative analysis of data stores
- Logical operations