The UCLA Written Chinese Corpus

We are pleased to announce the release of the second edition of the UCLA Written Chinese Corpus (UCLA2), which has been expanded to one million words.

The UCLA Written Chinese Corpus is designed as a Chinese counterpart for the FLOB and Frown corpora of British and American English for contrastive research, as well as a recent update of the Lancaster Corpus of Mandarin Chinese (LCMC) for diachronic studies of possible changes in written Chinese over the past decade. Since this period is of special significance because of the impact of the Internet on language, especially on Chinese, the corpus is an excellent complement to LCMC.

The samples in the corpus are all collected from written modern Chinese available from the internet, during the period of 2000-2012, though some texts may have been converted from paper-based publications in earlier years. File types are matched as closely as possible to the Brown corpus model, with some variations (e.g. adventure fictions) to accommodate Chinese characteristics, while the proportions for different text categories may vary from the English counterparts and LCMC. The genres covered and their sample sizes (in terms of tokens including punctuation marks) in the two editions of the UCLA Written Chinese Corpus are shown as in the table below. 

Code Genre Tokens in first edition (UCLA1) Tokens in second edition (UCLA2)
A Press: reportage

84302

88933
B Press: editorials 25155 58284
C Press: reviews 32223 35018
D Religion 5885 41308
E Skills, trades and hobbies 8925 55662
F Popular lore 24854 69664
G Essays and biographies 71169 164686
H Misc. (reports and official documents) 65705 65705
J Academic prose 27652 150507
K General fiction 40999 85912
L Mystery and detective stories 85317 85912
M Science fiction 60378 60378
N Adventure stories 55253 58144
P Romantic fiction 66849 66849
R Humour 32968 32968
Total number of tokens 687634 1119930

The corpus is Unicode and XML-compliant. Each corpus file is composed of a corpus header and a text body. The header gives general information of a corpus file. In the body part, paragraphs, sentences and tokens are marked up, with each sentence numbered and each token annotated for part of speech.

The UCLA Chinese Corpus is a product of the joint effort of Professor Hongyin Tao (University of California Los Angeles) and Dr. Richard Xiao (UCREL of Lancaster University). Funding for this project was provided to Hongyin Tao by the UCLA Academic Senate during the academic years 2003-2005, while Richard Xiao was supported by the UK Economic and Social Research Council (Award Reference RES-000-23-0553). We are also obliged to Iris Li, Haiyong Liu, and Hui Zhang, and Danjie Su for their assistance in data collection.

The UCLA2 corpus is distributed free of charge for use in non-profit-making research.  For licencing information, please refer to the LCMC licence. Click here to have a look at the POS tagset. the corpus can be accessed online via the CQP web interface (username and password are both test, which allows access to the whole corpus and the full functionality of the tool) hosted at Beijing Foreign Studies University.

The UCLA Chinese Corpus can be cited as:

Tao, Hongyin and Richard Xiao (2012) The UCLA Chinese Corpus (2nd edition). UCREL, Lancaster.

Tao, Hongyin and Richard Xiao (2007) The UCLA Chinese Corpus (1st edition). UCREL, Lancaster.

 

Disclaimer: We give no warranties that the UCLA corpus will be suitable for any particular purpose and  accept no responsibility for any technical limitations of the corpus or software.

 

Created and maintained by Richard Xiao 2013