Data Science

From Wikipedia, the free encyclopedia

Not to be confused with information science.

Machine learning and data mining
Problems[show]
Supervised learning (classification • regression) [show]
Clustering[show]
Dimensionality reduction[show]
Structured prediction[show]
Anomaly detection[show]
Neural nets[show]
Reinforcement learning[show]
Theory[show]
Machine-learning venues[show]
Related articles[show]
Machine learning portal
v t e

Data science, also known as data-driven science, is an interdisciplinary field about scientific methods, processes, and systems to extract knowledge or insights from data in various forms, either structured or unstructured,^[1][2] similar to data mining.

Data science is a "concept to unify statistics, data analysis and their related methods" in order to "understand and analyze actual phenomena" with data.^[3] It employs techniques and theories drawn from many fields within the broad areas of mathematics, statistics, information science, and computer science, in particular from the subdomains of machine learning, classification, cluster analysis, data mining, databases, and visualization.

Turing award winner Jim Gray imagined data science as a "fourth paradigm" of science (empirical, theoretical, computational and now data-driven) and asserted that "everything about science is changing because of the impact of information technology" and the data deluge.^[4][5]

When Harvard Business Review called it "The Sexiest Job of the 21st Century"^[6] the term became a buzzword, and is now often applied to business analytics,^[7] or even arbitrary use of data, or used as a sexed-up term for statistics.^[8] While many university programs now offer a data science degree, there exists no consensus on a definition or curriculum contents.^[7] Because of the current popularity of this term, there are many "advocacy efforts" surrounding it.^[9]

Contents

  [hide] 

• 1History
• 2Criticism
• 3Data scientist
• 4Software
• 5References
• 6Further reading

History[edit]

Data science process flowchart from "Doing Data Science", Cathy O'Neil and Rachel Schutt, 2013

The term "data science" (originally used interchangeably with "datalogy") has existed for over thirty years and was used initially as a substitute for computer science by Peter Naur in 1960. In 1974, Naur published Concise Survey of Computer Methods, which freely used the term data science in its survey of the contemporary data processing methods that are used in a wide range of applications.

In 1996, members of the International Federation of Classification Societies (IFCS) met in Kobe for their biennial conference. Here, for the first time, the term data science is included in the title of the conference ("Data Science, classification, and related methods"),^[10] after the term was introduced in a roundtable discussion by Chikio Hayashi.^[3]

In November 1997, C.F. Jeff Wu gave the inaugural lecture entitled "Statistics = Data Science?"^[11] for his appointment to the H. C. Carver Professorship at the University of Michigan.^[12] In this lecture, he characterized statistical work as a trilogy of data collection, data modeling and analysis, and decision making. In his conclusion, he initiated the modern, non-computer science, usage of the term "data science" and advocated that statistics be renamed data science and statisticians data scientists.^[11] Later, he presented his lecture entitled "Statistics = Data Science?" as the first of his 1998 P.C. Mahalanobis Memorial Lectures.^[13] These lectures honor Prasanta Chandra Mahalanobis, an Indian scientist and statistician and founder of the Indian Statistical Institute.

In 2001, William S. Cleveland introduced data science as an independent discipline, extending the field of statistics to incorporate "advances in computing with data" in his article "Data Science: An Action Plan for Expanding the Technical Areas of the Field of Statistics," which was published in Volume 69, No. 1, of the April 2001 edition of the International Statistical Review / Revue Internationale de Statistique.^[14] In his report, Cleveland establishes six technical areas which he believed to encompass the field of data science: multidisciplinary investigations, models and methods for data, computing with data, pedagogy, tool evaluation, and theory.

In April 2002, the International Council for Science: Committee on Data for Science and Technology (CODATA)^[15] started the Data Science Journal,^[16] a publication focused on issues such as the description of data systems, their publication on the internet, applications and legal issues.^[17] Shortly thereafter, in January 2003, Columbia University began publishing The Journal of Data Science,^[18] which provided a platform for all data workers to present their views and exchange ideas. The journal was largely devoted to the application of statistical methods and quantitative research. In 2005, The National Science Board published "Long-lived Digital Data Collections: Enabling Research and Education in the 21st Century" defining data scientists as "the information and computer scientists, database and software and programmers, disciplinary experts, curators and expert annotators, librarians, archivists, and others, who are crucial to the successful management of a digital data collection" whose primary activity is to "conduct creative inquiry and analysis."^[19]

In the 2012 Harvard Business Review article "Data Scientist: The Sexiest Job of the 21st Century",^[6] DJ Patil claims to have coined this term in 2008 with Jeff Hammerbacher to define their jobs at LinkedIn and Facebook, respectively. He asserts that a data scientist is "a new breed", and that a "shortage of data scientists is becoming a serious constraint in some sectors", but describes a much more business oriented role.

In 2013, the IEEE Task Force on Data Science and Advanced Analytics^[20] was launched, and the first international conference: IEEE International Conference on Data Science and Advanced Analytics was launched in 2014.^[21] In 2014, the American Statistical Association section on Statistical Learning and Data Mining renamed its journal to "Statistical Analysis and Data Mining: The ASA Data Science Journal" and in 2016 changed its section name to "Statistical Learning and Data Science".^[9] In 2015, the International Journal on Data Science and Analytics^[22] was launched by Springer to publish original work on data science and big data analytics. In 2013, the first "European Conference on Data Analysis (ECDA)" was organised in Luxembourg, establishing the European Association for Data Science (EuADS) in August 2015. In September 2015 the Gesellschaft für Klassifikation (GfKl) added to the name of the Society "Data Science Society" at the third ECDA conference at the University of Essex, Colchester, UK.

Criticism[edit]

Although use of the term "data science" has exploded in business environments, many academics and journalists see no distinction between data science and statistics. Writing in Forbes, Gil Press argues that data science is a buzzword without a clear definition and has simply replaced “business analytics” in contexts such as graduate degree programs.^[7] In the question-and-answer section of his keynote address at the Joint Statistical Meetings of American Statistical Association, noted applied statistician Nate Silver said, “I think data-scientist is a sexed up term for a statistician....Statistics is a branch of science. Data scientist is slightly redundant in some way and people shouldn’t berate the term statistician.”^[8]

Additionally, multiple researchers and analysts state that data scientists alone are far from being sufficient in granting companies a real competitive advantage^[23] and consider data scientists as one of the four job families companies require to leverage Big Data effectively, namely: Business Analysts, Data Scientists, Big Data Developers and Big Data Engineers.^[24]

Data scientist[edit]

This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed. (January 2017) (Learn how and when to remove this template message)

Data scientists use their data and analytical ability to find and interpret rich data sources; manage large amounts of data despite hardware, software, and bandwidth constraints; merge data sources; ensure consistency of datasets; create visualizations to aid in understanding data; build mathematical models using the data; and present and communicate the data insights/findings. They are often expected to produce answers in days rather than months, work by exploratory analysis and rapid iteration, and to produce and present results with dashboards (displays of current values) rather than papers/reports, as statisticians normally do.^[25] Data science is not only about technology and mathematics—effective data scientists require a combination of technical skills and soft skills to turn data into actionable insight.^[26]

"Data scientist" has become a popular occupation with Harvard Business Review dubbing it "The Sexiest Job of the 21st Century"^[6] and McKinsey & Company projecting a global excess demand of 1.5 million new data scientists.^[27] Universities are offering masters courses in data science.^[28] Shorter private bootcamps are also offering data science certificates including student-paid programs like General Assembly to employer-paid programs like The Data Incubator.^[29]

Software[edit]

See also: List of statistical packages

In the 2010–2011 time frame, data science software reached an inflection point where open source software started supplanting proprietary software.^[30] The use of open source software enables modifying and extending the software, and it allows sharing of the resulting algorithms.^[31][32][33]

References[edit]

1. Jump up^ Dhar, V. (2013). "Data science and prediction". Communications of the ACM. 56 (12): 64. doi:10.1145/2500499.
2. Jump up^ Jeff Leek (2013-12-12). "The key word in "Data Science" is not Data, it is Science". Simply Statistics.
3. ^ Jump up to:^a b Hayashi, Chikio (1998-01-01). "What is Data Science? Fundamental Concepts and a Heuristic Example". In Hayashi, Chikio; Yajima, Keiji; Bock, Hans-Hermann; Ohsumi, Noboru; Tanaka, Yutaka; Baba, Yasumasa. Data Science, Classification, and Related Methods. Studies in Classification, Data Analysis, and Knowledge Organization. Springer Japan. pp. 40–51. ISBN 9784431702085. doi:10.1007/978-4-431-65950-1_3.
4. Jump up^ Stewart Tansley; Kristin Michele Tolle (2009). The Fourth Paradigm: Data-intensive Scientific Discovery. Microsoft Research. ISBN 978-0-9825442-0-4.
5. Jump up^ Bell, G.; Hey, T.; Szalay, A. (2009). "COMPUTER SCIENCE: Beyond the Data Deluge". Science. 323 (5919): 1297–1298. ISSN 0036-8075. doi:10.1126/science.1170411.
6. ^ Jump up to:^a b c Davenport, Thomas H.; Patil, DJ (Oct 2012), Data Scientist: The Sexiest Job of the 21st Century, Harvard Business Review
7. ^ Jump up to:^a b c "Data Science: What's The Half-Life Of A Buzzword?". Forbes. 2013-08-19.
8. ^ Jump up to:^a b "Nate Silver: What I need from statisticians". Statistics Views. 23 Aug 2013.
9. ^ Jump up to:^a b Talley, Jill (2016-06-01). "ASA Expands Scope, Outreach to Foster Growth, Collaboration in Data Science". AMSTATNEWS. American Statistical Association. Retrieved 2017-02-04.
10. Jump up^ Press, Gil. "A Very Short History Of Data Science".
11. ^ Jump up to:^a b Wu, C. F. J. (1997). "Statistics = Data Science?" (PDF). Retrieved 9 October 2014.
12. Jump up^ "Identity of statistics in science examined". The University Records, 9 November 1997, The University of Michigan. Retrieved 12 August 2013.
13. Jump up^ "P.C. Mahalanobis Memorial Lectures, 7th series". P.C. Mahalanobis Memorial Lectures, Indian Statistical Institute. Archived from the original on 26 Feb 2017. Retrieved 18 Jul 2017.
14. Jump up^ Cleveland, W. S. (2001). Data science: an action plan for expanding the technical areas of the field of statistics. International Statistical Review / Revue Internationale de Statistique, 21–26
15. Jump up^ International Council for Science : Committee on Data for Science and Technology. (2012, April). CODATA, The Committee on Data for Science and Technology. Retrieved from International Council for Science : Committee on Data for Science and Technology: http://www.codata.org/
16. Jump up^ Data Science Journal. (2012, April). Available Volumes. Retrieved from Japan Science and Technology Information Aggregator, Electronic: http://www.jstage.jst.go.jp/browse/dsj/_vols
17. Jump up^ Data Science Journal. (2002, April). Contents of Volume 1, Issue 1, April 2002. Retrieved from Japan Science and Technology Information Aggregator, Electronic: http://www.jstage.jst.go.jp/browse/dsj/1/0/_contents
18. Jump up^ The Journal of Data Science. (2003, January). Contents of Volume 1, Issue 1, January 2003. Retrieved from http://www.jds-online.com/v1-1
19. Jump up^ National Science Board. "Long-Lived Digital Data Collections Enabling Research and Education in the 21st Century". National Science Foundation. Retrieved 30 June 2013.
20. Jump up^ "IEEE Task Force on Data Science and Advanced Analytics".
21. Jump up^ "2014 IEEE International Conference on Data Science and Advanced Analytics".
22. Jump up^ "Journal on Data Science and Analytics".
23. Jump up^ Miller, Steven (2014-04-10). "Collaborative Approaches Needed to Close the Big Data Skills Gap". Journal of Organization Design. 3 (1): 26–30. ISSN 2245-408X. doi:10.7146/jod.9823.
24. Jump up^ De Mauro, Andrea; Greco, Marco; Grimaldi, Michele; Ritala, Paavo. "Human resources for Big Data professions: A systematic classification of job roles and required skill sets". Information Processing & Management. doi:10.1016/j.ipm.2017.05.004.
25. Jump up^ Nguyen, Thomson. "Data scientists vs data analysts: Why the distinction matters". Retrieved 2 October 2015.
26. Jump up^ "The most important skills of data scientists". TEDx. Retrieved 2017-07-19.
27. Jump up^ "Big data: The next frontier for innovation, competition, and productivity".
28. Jump up^ "Big Data Analytics Masters". Information Week. Retrieved 2016-02-22.
29. Jump up^ "NY gets new bootcamp for data scientists: It’s free, but harder to get into than Harvard". Venture Beat. Retrieved 2016-02-22.
30. Jump up^ Chalef, Daniel (2016-03-20). "Data Science Tools – Are Proprietary Vendors Still Relevant?". kdnuggets.com. Retrieved 2016-11-07.
31. Jump up^ Asay, Matt. "For data scientists, the big money is in open source". TechRepublic. Retrieved 6 November 2016.
32. Jump up^ Jones, M. Tim. "Data science and open source". IBM DeveloperWorks. IBM. Retrieved 6 November 2016.
33. Jump up^ Talbert, Neera. "Open Source Software Fuels a Revolution in Data Science". insideBIGDATA. Retrieved 6 November 2016.

Further reading[edit]

Wikimedia Commons has media related to Data science.

Wikibooks has more on the topic of: Data science

• Conway, Drew; White, John Myles (February 2012). Machine Learning for Hackers. O'Reilly Media. ISBN 978-1449303716.
• O'Neil, Cathy; Schutt, Rachel (October 2013). Doing Data Science. O'Reilly Media. ISBN 978-1449358655.
• Russel, Matthew A. (October 2013). Mining the Social Web, 2nd Edition. O'Reilly Media. ISBN 978-1449367619.

Categories: 

• Information science
• Computer occupations
• Computational fields of study
• Data analysis