T-brain: a collaboration platform for data scientists

Chao Chun Yeh*, Sheng An Chang, Yi Chin Chu, Xuan Yi Lin, Yichiao Sun, Jiazheng Zhou, Shih-Kun Huang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

When data were generated easily and rapidly with mobile services and computing power can increase on demand with the cloud computation service, data scientists who work with huge data can solve challenging problems. Smart intelligent applications such as Go, healthcare and self-driving vehicles show great improvement recently. In addition to those problems, there are still more complex problem such as weather impacts analysis, financial crisis prediction and crime prevention and so on. To overcome those challenging problems, many crossdisciplinarity or interdisciplinary experts have to collaborate for the solutions. In the paper, we propose a collaboration platform and a system design for data scientists to share data, write analytic scripts and discuss topics related with those problems. In current status, eleven dataset were collect ed such as spam mail, malware data, honeynet log, Hadoop workload log and some other open data and based on those dataset and improvement local cache design (i.e., average response time improvement 92.36% and request availability improvement 70%). With the platform, many education and competition activities can be hold successfully on the collaboration platform.

Original languageEnglish
Title of host publicationSecurity with Intelligent Computing and Big-data Services
EditorsShiuh-Jeng Wang, Sheng-Lung Peng, Valentina Emilia Balas, Ming Zhao
PublisherSpringer Verlag
Pages295-309
Number of pages15
ISBN (Print)9783319764504
DOIs
StatePublished - 1 Jan 2018
EventInternational Conference on Security with Intelligent Computing and Big-data Services, SICBS 2017 - Hualien City, Taiwan
Duration: 15 Dec 201717 Dec 2017

Publication series

NameAdvances in Intelligent Systems and Computing
Volume733
ISSN (Print)2194-5357

Conference

ConferenceInternational Conference on Security with Intelligent Computing and Big-data Services, SICBS 2017
CountryTaiwan
CityHualien City
Period15/12/1717/12/17

Keywords

  • Collaboration platform
  • Data scientist
  • Docker
  • Jupyter

Fingerprint Dive into the research topics of 'T-brain: a collaboration platform for data scientists'. Together they form a unique fingerprint.

Cite this