Hyperbolic Graph Convolutional Network Relation Extraction Model Combining Dependency Syntax and Contrastive Learning
Abstract In current relation extraction tasks, when the input sentence structure is complex, the performance of in-context learning methods based on large language model is still lower than that of traditional pre-train fine-tune models. For complex sentence structures, dependency syntax information...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Springer
2025-02-01
|
| Series: | International Journal of Computational Intelligence Systems |
| Subjects: | |
| Online Access: | https://doi.org/10.1007/s44196-025-00738-2 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823861658524581888 |
|---|---|
| author | Jinzhe Li |
| author_facet | Jinzhe Li |
| author_sort | Jinzhe Li |
| collection | DOAJ |
| description | Abstract In current relation extraction tasks, when the input sentence structure is complex, the performance of in-context learning methods based on large language model is still lower than that of traditional pre-train fine-tune models. For complex sentence structures, dependency syntax information can provide effective prior text structure information for relation extraction. However, most studies are affected by the noise in the syntactic information automatically extracted by natural language processing toolkits. Additionally, traditional pre-training encoders have issues such as an overly centralized representation of word embedding for high-frequency words, which adversely affects the model to learn contextual semantic information. To address proposed problem, the paper proposes a Hyperbolic Graph Convolutional Network Relation Extraction Model Combine Dependency Syntax and Contrastive Learning. Based on the hyperbolic graph neural network, dependent syntactic information and information optimization strategies are introduced to solve the problem of word embedding concentration. Simultaneously, to mitigate the impact of noise in dependency syntax information on the relation extraction task, a contrastive learning approach is employed. After the model learns context semantics separately in the original dependency syntax information and dependency syntax information with added random noise, it maximizes the mutual information between entity words to assist the model in distinguishing noise in dependency syntax. The experiments indicate that the proposed model in this paper can effectively enhance the performance of relation extraction on public datasets, especially achieving significantly higher precision on datasets with complex sentence structures compared to in-context learning. |
| format | Article |
| id | doaj-art-8f660c0966b245048e8f5ceeabb1336f |
| institution | Kabale University |
| issn | 1875-6883 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | Springer |
| record_format | Article |
| series | International Journal of Computational Intelligence Systems |
| spelling | doaj-art-8f660c0966b245048e8f5ceeabb1336f2025-02-09T12:53:48ZengSpringerInternational Journal of Computational Intelligence Systems1875-68832025-02-0118112510.1007/s44196-025-00738-2Hyperbolic Graph Convolutional Network Relation Extraction Model Combining Dependency Syntax and Contrastive LearningJinzhe Li0Information Center, Civil Aviation General HospitalAbstract In current relation extraction tasks, when the input sentence structure is complex, the performance of in-context learning methods based on large language model is still lower than that of traditional pre-train fine-tune models. For complex sentence structures, dependency syntax information can provide effective prior text structure information for relation extraction. However, most studies are affected by the noise in the syntactic information automatically extracted by natural language processing toolkits. Additionally, traditional pre-training encoders have issues such as an overly centralized representation of word embedding for high-frequency words, which adversely affects the model to learn contextual semantic information. To address proposed problem, the paper proposes a Hyperbolic Graph Convolutional Network Relation Extraction Model Combine Dependency Syntax and Contrastive Learning. Based on the hyperbolic graph neural network, dependent syntactic information and information optimization strategies are introduced to solve the problem of word embedding concentration. Simultaneously, to mitigate the impact of noise in dependency syntax information on the relation extraction task, a contrastive learning approach is employed. After the model learns context semantics separately in the original dependency syntax information and dependency syntax information with added random noise, it maximizes the mutual information between entity words to assist the model in distinguishing noise in dependency syntax. The experiments indicate that the proposed model in this paper can effectively enhance the performance of relation extraction on public datasets, especially achieving significantly higher precision on datasets with complex sentence structures compared to in-context learning.https://doi.org/10.1007/s44196-025-00738-2Relation extractionDependency tree-driven relation extractionContrastive learningHyperbolic graph convolutional network |
| spellingShingle | Jinzhe Li Hyperbolic Graph Convolutional Network Relation Extraction Model Combining Dependency Syntax and Contrastive Learning International Journal of Computational Intelligence Systems Relation extraction Dependency tree-driven relation extraction Contrastive learning Hyperbolic graph convolutional network |
| title | Hyperbolic Graph Convolutional Network Relation Extraction Model Combining Dependency Syntax and Contrastive Learning |
| title_full | Hyperbolic Graph Convolutional Network Relation Extraction Model Combining Dependency Syntax and Contrastive Learning |
| title_fullStr | Hyperbolic Graph Convolutional Network Relation Extraction Model Combining Dependency Syntax and Contrastive Learning |
| title_full_unstemmed | Hyperbolic Graph Convolutional Network Relation Extraction Model Combining Dependency Syntax and Contrastive Learning |
| title_short | Hyperbolic Graph Convolutional Network Relation Extraction Model Combining Dependency Syntax and Contrastive Learning |
| title_sort | hyperbolic graph convolutional network relation extraction model combining dependency syntax and contrastive learning |
| topic | Relation extraction Dependency tree-driven relation extraction Contrastive learning Hyperbolic graph convolutional network |
| url | https://doi.org/10.1007/s44196-025-00738-2 |
| work_keys_str_mv | AT jinzheli hyperbolicgraphconvolutionalnetworkrelationextractionmodelcombiningdependencysyntaxandcontrastivelearning |