Completion and parsing Chinese sentences using cogent confabulation

Zhe Li, Qinru Qiu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

Among different languages' sentence completion and parsing, Chinese is of great difficulty. Chinese words are not naturally separated by delimiters, which imposes extra challenge. Cogent confabulation based sentence completion has been proposed for English. It fills in missing words in an English sentence while maintains the semantic and syntactic consistency. In this work, we improve the cogent confabulation model and apply it to sentence completion in Chinese. Incorporating trained knowledge in parts-of-speech tagging and Chinese word compound segmentation, the model does not only fill missing words in a sentence but also performs linguistic analysis of the sentence with a high accuracy. We further investigate the optimization of the model and trade-offs between accuracy and training/recall complexity. Experimental results show that the optimized model improves recall accuracy by 9% and reduces training and recall time by 18.6% and 53.7% respectively.

Original languageEnglish (US)
Title of host publicationIEEE SSCI 2014 - 2014 IEEE Symposium Series on Computational Intelligence - CCMB 2014: 2014 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages31-38
Number of pages8
ISBN (Electronic)9781479945504
DOIs
StatePublished - Jan 23 2014
Event2014 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain, CCMB 2014 - Orlando, United States
Duration: Dec 9 2014Dec 12 2014

Other

Other2014 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain, CCMB 2014
CountryUnited States
CityOrlando
Period12/9/1412/12/14

Keywords

  • Chinese sentence completion
  • cogent confabulation
  • mutual information
  • parts-of-speech tagging
  • word segmentation

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computational Theory and Mathematics
  • Human-Computer Interaction
  • Modeling and Simulation

Fingerprint Dive into the research topics of 'Completion and parsing Chinese sentences using cogent confabulation'. Together they form a unique fingerprint.

  • Cite this

    Li, Z., & Qiu, Q. (2014). Completion and parsing Chinese sentences using cogent confabulation. In IEEE SSCI 2014 - 2014 IEEE Symposium Series on Computational Intelligence - CCMB 2014: 2014 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain, Proceedings (pp. 31-38). [7020691] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CCMB.2014.7020691