Cengiz Gunay, Anca Doloc-MihuT6: Computational neuroscience projects often involve a large number of simulations for parameter search of computer models, which generates a large amount of data. With the advances in computer hardware, software methods, and cloud computing opportunities making this task easier, the amount of collected data has exploded, similar to what has been happening in many fields. High-performance computing (HPC) methods have been used in the computational neuroscience field for a while. However, the use of novel data science and big data methods are less frequent. In this tutorial, we will review established HPC methods and introduce novel data science tools to be used in computational neuroscience workflows, starting from the industry standard of Apache Hadoop (
https://hadoop.apache.org/) to newer tools, such as Apache Spark (
https://spark.apache.org/). These tools can be used for either model simulation or post-processing and analysis of the generated data. To visualize the data, we will review novel web-based interactive dashboard technologies mostly based on Javascript and Python.
Discussion Link on NeuroStars for comments
Tutorial Website with links to slides and other materials
Zoom MeetingLink: https://us02web.zoom.us/j/82504212352
Meeting ID: 825 0421 2352
Password: 758607
Feedback form, please give us some feedback after the tutorial! Thanks :)
Session 1: Spark Server Info:
- IP address: (taken offline)
- Look for download files here spark-key (for Mac and Linux) and spark-windows.ppk (for Windows)