Working-memory load decoding model inspired by brain cognition based on cross-frequency coupling
Working memory, a fundamental cognitive function of the brain, necessitates the evaluation of cognitive load intensity due to limited cognitive resources. Optimizing cognitive load can enhance task performance efficiency by preventing resource waste and overload. Therefore, identifying working memor...
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-02-01
|
| Series: | Brain Research Bulletin |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S0361923025000188 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1825206934411673600 |
|---|---|
| author | Jing Zhang Tingyi Tan Yuhao Jiang Congming Tan Liangliang Hu Daowen Xiong Yikang Ding Guowei Huang Junjie Qin Yin Tian |
| author_facet | Jing Zhang Tingyi Tan Yuhao Jiang Congming Tan Liangliang Hu Daowen Xiong Yikang Ding Guowei Huang Junjie Qin Yin Tian |
| author_sort | Jing Zhang |
| collection | DOAJ |
| description | Working memory, a fundamental cognitive function of the brain, necessitates the evaluation of cognitive load intensity due to limited cognitive resources. Optimizing cognitive load can enhance task performance efficiency by preventing resource waste and overload. Therefore, identifying working memory load is an essential area of research. Deep learning models have demonstrated remarkable potential in identifying the intensity of working memory load. However, existing neural networks based on electroencephalogram (EEG) decoding primarily focus on temporal and spatial characteristics while neglecting frequency characteristics. Drawing inspiration from the role of cross-frequency coupling in the hippocampal region, which plays a crucial role in advanced cognitive processes such as working memory, this study proposes a Multi-Band Multi-Scale Hybrid Sinc Convolutional Neural Network (MBSincNex). This model integrates multi-frequency and multi-scale Sinc convolution to facilitate time-frequency conversion and extract time-frequency information from multiple rhythms and regions of the EEG data with the aim of effectively model the cross-frequency coupling across different cognitive domains. Due to its unique structural design, the proposed model proficiently extracts features in temporal, frequency, and spatial domains while its feature extraction capability is validated through post-hoc interpretability techniques. On our collected three-class working memory dataset, the proposed model achieved higher classification accuracy compared to other state-of-the-art methods. Furthermore, by analyzing the model’s classification performance during different stages of working memory processes, this study emphasizes the significance of the encoding phase and confirms that behavioral response does not accurately reflect cognitive load. |
| format | Article |
| id | doaj-art-30ac51e85c59460b9148e713884eedbc |
| institution | Kabale University |
| issn | 1873-2747 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Brain Research Bulletin |
| spelling | doaj-art-30ac51e85c59460b9148e713884eedbc2025-02-07T04:46:43ZengElsevierBrain Research Bulletin1873-27472025-02-01221111206Working-memory load decoding model inspired by brain cognition based on cross-frequency couplingJing Zhang0Tingyi Tan1Yuhao Jiang2Congming Tan3Liangliang Hu4Daowen Xiong5Yikang Ding6Guowei Huang7Junjie Qin8Yin Tian9School of Life and Health Information Science and Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaSchool of Life and Health Information Science and Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaSchool of Life and Health Information Science and Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaCollege of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaCollege of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaSchool of Life and Health Information Science and Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaSchool of Life and Health Information Science and Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaSchool of Life and Health Information Science and Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaSchool of Life and Health Information Science and Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaSchool of Life and Health Information Science and Engineering, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; Institute for Advanced Sciences, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; Guangyang Bay Laboratory, Chongqing Institute for Brain and Intelligence, Chongqing 400064, China; Corresponding author at: No. 2 Chongwen Road, Nanshan Avenue, Nan'an District, Chongqing 400065, China.Working memory, a fundamental cognitive function of the brain, necessitates the evaluation of cognitive load intensity due to limited cognitive resources. Optimizing cognitive load can enhance task performance efficiency by preventing resource waste and overload. Therefore, identifying working memory load is an essential area of research. Deep learning models have demonstrated remarkable potential in identifying the intensity of working memory load. However, existing neural networks based on electroencephalogram (EEG) decoding primarily focus on temporal and spatial characteristics while neglecting frequency characteristics. Drawing inspiration from the role of cross-frequency coupling in the hippocampal region, which plays a crucial role in advanced cognitive processes such as working memory, this study proposes a Multi-Band Multi-Scale Hybrid Sinc Convolutional Neural Network (MBSincNex). This model integrates multi-frequency and multi-scale Sinc convolution to facilitate time-frequency conversion and extract time-frequency information from multiple rhythms and regions of the EEG data with the aim of effectively model the cross-frequency coupling across different cognitive domains. Due to its unique structural design, the proposed model proficiently extracts features in temporal, frequency, and spatial domains while its feature extraction capability is validated through post-hoc interpretability techniques. On our collected three-class working memory dataset, the proposed model achieved higher classification accuracy compared to other state-of-the-art methods. Furthermore, by analyzing the model’s classification performance during different stages of working memory processes, this study emphasizes the significance of the encoding phase and confirms that behavioral response does not accurately reflect cognitive load.http://www.sciencedirect.com/science/article/pii/S0361923025000188Delayed matching-to-sampleCross-frequency couplingSinc convolution layerWorking memoryEEG decodingInterpretability |
| spellingShingle | Jing Zhang Tingyi Tan Yuhao Jiang Congming Tan Liangliang Hu Daowen Xiong Yikang Ding Guowei Huang Junjie Qin Yin Tian Working-memory load decoding model inspired by brain cognition based on cross-frequency coupling Brain Research Bulletin Delayed matching-to-sample Cross-frequency coupling Sinc convolution layer Working memory EEG decoding Interpretability |
| title | Working-memory load decoding model inspired by brain cognition based on cross-frequency coupling |
| title_full | Working-memory load decoding model inspired by brain cognition based on cross-frequency coupling |
| title_fullStr | Working-memory load decoding model inspired by brain cognition based on cross-frequency coupling |
| title_full_unstemmed | Working-memory load decoding model inspired by brain cognition based on cross-frequency coupling |
| title_short | Working-memory load decoding model inspired by brain cognition based on cross-frequency coupling |
| title_sort | working memory load decoding model inspired by brain cognition based on cross frequency coupling |
| topic | Delayed matching-to-sample Cross-frequency coupling Sinc convolution layer Working memory EEG decoding Interpretability |
| url | http://www.sciencedirect.com/science/article/pii/S0361923025000188 |
| work_keys_str_mv | AT jingzhang workingmemoryloaddecodingmodelinspiredbybraincognitionbasedoncrossfrequencycoupling AT tingyitan workingmemoryloaddecodingmodelinspiredbybraincognitionbasedoncrossfrequencycoupling AT yuhaojiang workingmemoryloaddecodingmodelinspiredbybraincognitionbasedoncrossfrequencycoupling AT congmingtan workingmemoryloaddecodingmodelinspiredbybraincognitionbasedoncrossfrequencycoupling AT lianglianghu workingmemoryloaddecodingmodelinspiredbybraincognitionbasedoncrossfrequencycoupling AT daowenxiong workingmemoryloaddecodingmodelinspiredbybraincognitionbasedoncrossfrequencycoupling AT yikangding workingmemoryloaddecodingmodelinspiredbybraincognitionbasedoncrossfrequencycoupling AT guoweihuang workingmemoryloaddecodingmodelinspiredbybraincognitionbasedoncrossfrequencycoupling AT junjieqin workingmemoryloaddecodingmodelinspiredbybraincognitionbasedoncrossfrequencycoupling AT yintian workingmemoryloaddecodingmodelinspiredbybraincognitionbasedoncrossfrequencycoupling |