Li Tang


2020

pdf bib
UZH at SemEval-2020 Task 3: Combining BERT with WordNet Sense Embeddings to Predict Graded Word Similarity Changes
Li Tang
Proceedings of the Fourteenth Workshop on Semantic Evaluation

CoSimLex is a dataset that can be used to evaluate the ability of context-dependent word embed- dings for modeling subtle, graded changes of meaning, as perceived by humans during reading. At SemEval-2020, task 3, subtask 1 is about ”predicting the (graded) effect of context in word similarity”, using CoSimLex to quantify such a change of similarity for a pair of words, from one context to another. Here, a meaning shift is composed of two aspects, a) discrete changes observed between different word senses, and b) more subtle changes of meaning representation that are not captured in those discrete changes. Therefore, this SemEval task was designed to allow the evaluation of systems that can deal with a mix of both situations of semantic shift, as they occur in the human perception of meaning. The described system was developed to improve the BERT baseline provided with the task, by reducing distortions in the BERT semantic space, compared to the human semantic space. To this end, complementarity between 768- and 1024-dimensional BERT embeddings, and average word sense vectors were used. With this system, after some fine-tuning, the baseline performance of 0.705 (uncentered Pearson correlation with human semantic shift data from 27 annotators) was enhanced by more than 6%, to 0.7645. We hope that this work can make a contribution to further our understanding of the semantic vector space of human perception, as it can be modeled with context-dependent word embeddings in natural language processing systems.

2004

pdf bib
Document Re-ranking Based on Automatically Acquired Key Terms in Chinese Information Retrieval
Lingpeng Yang | Donghong Ji | Li Tang
COLING 2004: Proceedings of the 20th International Conference on Computational Linguistics

pdf bib
A Model of Semantic Representations Analysis for Chinese Sentences
Li Tang | Donghong Ji | Lingpeng Yang | Yu Nie
Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC’04)

pdf bib
Building a Conceptual Graph Bank for Chinese Language
Donghong Ji | Li Tang | Lingpeng Yang
Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC’04)

pdf bib
Document Re-ranking based on Global and Local Terms
Lingpeng Yang | DongHong Ji | Li Tang
Proceedings of the Third SIGHAN Workshop on Chinese Language Processing

pdf bib
A Large-Scale Semantic Structure for Chinese Sentences
Li Tang | Donghong Ji | Lingpeng Yang
Proceedings of the Third SIGHAN Workshop on Chinese Language Processing