Will Deep Learning Change How Teams Execute Big Data Projects?

As data continues to be produced in ever increasing quantities, and technologies such as high performance computing continue to be enhanced, the number of big data projects using advanced neural network machine learning, often referred to as deep learning, continues to increase. Unfortunately, while much has been written on the use of deep learning algorithms in terms of generating insightful analysis, much less has been written about the project management process methodologies that could enable teams to more effectively and efficiently »do» big data deep learning projects. Specifically, the rapid growth in the use of deep learning techniques might introduce new challenges with respect to how to execute a big data deep learning project, due to how deep learning models can learn features automatically. For example, feature engineering and model evaluation phases of big data projects might grow in importance, while other areas, such as model selection, might decrease in importance. Hence, this paper discusses the key research questions relating the potential impact of the use of deep learning on how teams should execute big data projects.