WEKO3
アイテム
Generative Replay Inspired by Hippocampal Memory Indexing for Continual Language Learning
http://hdl.handle.net/10061/0002000462
http://hdl.handle.net/10061/0002000462e6aa18da-4799-4c7e-a15e-1be04b65d132
| アイテムタイプ | 会議発表論文 / Conference Paper(1) | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 公開日 | 2024-06-07 | |||||||||||
| タイトル | ||||||||||||
| タイトル | Generative Replay Inspired by Hippocampal Memory Indexing for Continual Language Learning | |||||||||||
| 言語 | ||||||||||||
| 言語 | eng | |||||||||||
| 資源タイプ | ||||||||||||
| 資源タイプ | conference paper | |||||||||||
| アクセス権 | ||||||||||||
| アクセス権 | open access | |||||||||||
| 著者 |
Maekawa, Aru
× Maekawa, Aru
× 上垣外, 英剛× Funakoshi, Kotaro
× Okumura, Manabu
|
|||||||||||
| 抄録 | ||||||||||||
| 内容記述タイプ | Abstract | |||||||||||
| 内容記述 | Continual learning aims to accumulate knowledge to solve new tasks without catastrophic forgetting for previously learned tasks. Research on continual learning has led to the development of generative replay, which prevents catastrophic forgetting by generating pseudo-samples for previous tasks and learning them together with new tasks. Inspired by the biological brain, we propose the hippocampal memory indexing to enhance the generative replay by controlling sample generation using compressed features of previous training samples. It enables the generation of a specific training sample from previous tasks, thus improving the balance and quality of generated replay samples. Experimental results indicate that our method effectively controls the sample generation and consistently outperforms the performance of current generative replay methods. | |||||||||||
| 書誌情報 |
en : Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics p. 930-942, 発行日 2023-05-02 |
|||||||||||
| 会議情報 | ||||||||||||
| 会議名 | Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics | |||||||||||
| 開始年 | 2023 | |||||||||||
| 開始月 | 05 | |||||||||||
| 開始日 | 02 | |||||||||||
| 終了年 | 2023 | |||||||||||
| 終了月 | 05 | |||||||||||
| 終了日 | 06 | |||||||||||
| 開催地 | Dubrovnik | |||||||||||
| 開催国 | HRV | |||||||||||
| 出版者 | ||||||||||||
| 出版者 | Association for Computational Linguistics | |||||||||||
| 出版者版DOI | ||||||||||||
| 関連タイプ | isReplacedBy | |||||||||||
| 識別子タイプ | DOI | |||||||||||
| 関連識別子 | https://doi.org/10.18653/v1/2023.eacl-main.65 | |||||||||||
| 出版者版URI | ||||||||||||
| 関連タイプ | isReplacedBy | |||||||||||
| 識別子タイプ | URI | |||||||||||
| 関連識別子 | https://aclanthology.org/2023.eacl-main.65/ | |||||||||||
| 権利 | ||||||||||||
| 権利情報Resource | http://creativecommons.org/licenses/by/4.0/ | |||||||||||
| 権利情報 | $00A92023 Association for Computational Linguistics | |||||||||||
| 著者版フラグ | ||||||||||||
| 出版タイプ | NA | |||||||||||
