Data Engineer

In a nutshell, a data engineer transforms data into a useful format for analysis. Data  engineers focus on the applications and harvesting of big data. 

They may be experts in:

• System architecture
• Programming
• Database design and configuration
• Interface and sensor configuration

More than any other professional working in data science, data engineers have to be hands-on with the tools of the trade such as: Hive, Hadoop, Spark, NoSQL, and other high-tech tools for data storage and manipulation 

Concepts of data architecture and pipeline design are even more important. They must have a solid conceptual understanding of:

• Data models
• Relational and non-relational database design
• Information flow
• Query execution and optimization
• Comparative analysis of data stores
• Logical operations