Codes
In the spirit of open science, we strive to make datasets and codes available to the public. Codes are often posted on the lab's GitHub page, available here. Links to individual student repositories are also listed in their relevant papers.
Databases
- PhySyQX: This dataset is described in [C92] "R. Gupta, H. Banville, T. Falk, PhySyQX: A Database for Physiological Evaluation of Synthesized Speech Quality-of-Experience, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), 2015." The multi-modal database was developed for neuro-physiological identification of the human factors which influence user perceived QoE and also to probe into the users' internal quality formation processes. The database utilizes neuro-physiological tools, such as electroencephalography and functional near infrared spectroscopy, to record users' brain activity while experiencing synthesised speech produced from various commercially available TTS systems.
- PASS Feature Dataset or the PASS Raw Dataset: This dataset is described in [J88] "M. Parent, I. Albuquerque, A. Tiwari, R. Cassani, J. Gagnon, D. Lafond, S. Tremblay, and T. Falk, PASS: A Multimodal Database of Physical Activity and Stress for Mobile Passive Body/Brain-Computer Interface Research, Frontiers in Neuroscience, 14:542934, Dec. 2020." This is a multimodal database of Physical Activity and StresS collected from 48 participants. Participants performed tasks of varying stress levels at three different activity levels and provided quantitative ratings of their perceived stress and fatigue levels. To manipulate stress, two video games (i.e., a calm exploration game and a survival game) were used. Peripheral physical activity (electrocardiography, electrodermal activity, breathing, skin temperature) as well as cerebral activity (electroencephalography) were measured throughout the experiment. The PASS database, including raw data, extracted features, and subjective ratings is available.
- WAUC Dataset: This dataset is described in [J87] "I. Albuquerque, A. Tiwari, M. Parent, J. Gagnon, D. Lafond, S. Tremblay, and T. Falk, “WAUC: A Multi-Modal Database for Mental Workload Assessment under Physical Activity”, Frontiers in Neuroscience, 14:549524, Dec. 2020." This multimodal database of mental Workload Assessment Under physical aCtivity was collected from 48 participants who performed the NASA Revised Multi-Attribute Task Battery II under three different activity level conditions. Physical activity was manipulated by changing the speed of a stationary bike or a treadmill. During data collection, six neural and physiological modalities were recorded, namely: electroencephalography, electrocardiography, breathing rate, skin temperature, galvanic skin response, and blood volume pulse, in addition to 3-axis accelerometry. Moreover, participants were asked to answer the NASA Task Load Index questionnaire after each experimental section, as well as rate their physical fatigue level on the Borg fatigue scale. In order to bring our experimental setup closer to real-world situations, all signals were monitored using wearable, off-the-shelf devices. In this paper, we describe the adopted experimental protocol, as well as validate the subjective, neural, and physiological data collected. The WAUC database, including the raw data and features, subjective ratings, and scripts to reproduce the experiments are available here.