Switching career to data engineering

<p>Shweta Bharti</p>

Switching career to data engineering

Shweta Bharti

Microsoft Corporation, USA

: J Comput Eng Inf Technol

Abstract

Having switched the career from Electronics Engineer to Data Engineer myself, I would talk about what one needs to know before he/she decides to switch the career to Data Engineering or Data Science, where lies the distinction between Data Engineering and Data Science and how they are not the same, the day to day challenges faced by data engineers and how using different Python libraries, those challenges can be solved easily.

A significant part of the talk would be a case study (based upon my work-experience) about how data engineering skills can help geneticist in a pharmaceutical industry. In this case study, I would also introduce OnToma - a python module, which was used by the company and made things simpler for geneticists to understand the relation between a disease and corresponding genetic mutation in a person. If time permits, I would also like to point out how Data Visualization tools in Python make life easy for Data Scientists and would briefly talk about some of the data visualization libraries (mainly Plotly).

This research work is mainly targeted to motivate people for having Data Engineering career and to those who are planning to switch their career to Data Engineering. Another agenda is to make people aware how Data Engineering is not just related to IT, Banking and eCommerce, it's extremely helpful in genetics area as well. I would introduce some tools that one needs to start with of they plan to switch to Data Engineering field. I have given a talk on similar pattern in AnitaB.org (URL: https://www.youtube. com/watch?v=MmC-9cTKhI0), so the entire duration of the talk would be under 30 minutes.