Loading...
| Friend's email | |
| Your name | |
| Your email | |
| enter code | |
This page was sent successfuly
Bookmark
Review List
883 viewed
PEN: Parallel English-Persian news corpus
Farajian, M. A
- Type of Document: Article
- Publisher: 2011
- Abstract:
- Parallel corpora are the necessary resources in many multilingual natural language processing applications, including machine translation and cross-lingual information retrieval. Manual preparation of a large scale parallel corpus is a very time consuming and costly procedure. In this paper, the work towards building a sentence-level aligned English-Persian corpus in a semi-automated manner is presented. The design of the corpus, collection, and alignment process of the sentences is described. Two statistical similarity measures were used to find the similarities of sentence pairs. To verify the alignment process automatically, Google Translator was used. The corpus is based on news resources available online and consists of about 30, 000 formal sentence pairs
- Keywords:
- Alignment ; Parallel corpus ; Statistical machine translation ; Cross-lingual information retrieval ; Machine translations ; Natural language processing applications ; Parallel corpora ; Semi-automated ; Similarity measure ; Statistical machine translation ; Alignment ; Artificial intelligence ; Computational linguistics ; Natural language processing systems ; Software agents
- Source: Proceedings of the 2011 International Conference on Artificial Intelligence, ICAI 2011, 18 2011 through 21 July 2011 ; Volume 2 , July , 2011 , Pages 523-528 ; 9781601321855 (ISBN)
- URL: http://www.lidi.info.unlp.edu.ar/WorldComp2011-Mirror/ICA4953.pdf