Size: 2301
Comment:
|
Size: 2954
Comment:
|
Deletions are marked like this. | Additions are marked like this. |
Line 25: | Line 25: |
== Reuters - NIST Corpus == Reuters newswire from 1996-08-20 to 1997-08-19. * RCV1 - 810,000 Reuters, English Language News stories. * RCV2 - 487,000 Reuters News stories in thirteen languages (Dutch, French, German, Chinese, Japanese, Russian, Portuguese, Spanish, Latin American Spanish, Italian, Danish, Norwegian, and Swedish) To use this corpus you as an individual must sign a license agreement, which is then kept on file in the lab. After signing you will be added to the `reuters` Unix group on the HLP system. This corpus is not available on the CS system. See [http://trec.nist.gov/data/reuters/reuters.html] for more detail. |
Stay up-to-date with the corpora@cs email list
You may want to subscribe to our corpora mailing list (just ask Benjamin Van Durme to add you to the list). This list distributess information about our corpus environment. You can also use it ask/answer questions about the local corpus environment. There are several groups that use corpora. At the very least you will find useful tools and corpora in /p/hlp/ and /p/nl/ (the natural language processing group in CS). There is also a [http://www.cs.rochester.edu/research/speech/ldc.html corpus inventory] and [http://www.cs.rochester.edu/research/cisd/resources/acquisitions.rss RSS feed]. You can use a web browser or email client with built-in RSS capabilities (e.g. Mozilla Firefox, Mozilla Thunderbird), a web-based aggregator (e.g. on My Yahoo!, Google), or a standalone aggregator. We have added further corpora on /p/hlp/corpora/ and more is to come. An updated page reflecting our corpus and software inventory is in the works.
Corpora
1. Gigaword
- Chinese
2. Parsed Switchboard
You must be a member of the pswbd Unix group to access this corpus.
3. TGrep2able
Corpora that have been processed to make them usable with the TGrep2 tool. See [wiki:Self/HlpLab/CorpusTools Corpus Tools] for more info on TGrep2.
4. TIGER Corpora
5. Tiger2 Corpus
6. Reuters - NIST Corpus
Reuters newswire from 1996-08-20 to 1997-08-19.
- RCV1 - 810,000 Reuters, English Language News stories.
- RCV2 - 487,000 Reuters News stories in thirteen languages (Dutch, French, German, Chinese, Japanese, Russian, Portuguese, Spanish, Latin American Spanish, Italian, Danish, Norwegian, and Swedish)
To use this corpus you as an individual must sign a license agreement, which is then kept on file in the lab. After signing you will be added to the reuters Unix group on the HLP system. This corpus is not available on the CS system.
See [http://trec.nist.gov/data/reuters/reuters.html] for more detail.
7. Treebanks
Title |
File |
LDC Catalog number/Original name |
Language |
#word |
#sentence |
#story |
Original format |
Arabic Treebank Part 1 V3 |
ATB1_V3/ |
LDC2005T02 |
Arabic |
145386 |
|
734 |
|
Arabic Treebank Part 2 V2 |
ATB2_V2/ |
LDC2004T02 |
Arabic |
144199 |
|
501 |
|
Arabic Treebank Part 3 V1 |
ATB3_V1/ |
LDC2004T11 |
Arabic |
340281 |
|
600 |
|
Chinese Treebank V5.1 |
ChineseTreebank5.1/ |
LDC2005T01U01 |
Chinese |
507222 |
|
18782 |
|
Prague Dependency Treebank 2.0 |
pdt_2/ |
LDC2006T01 |
Czech |
2000000 |
|
|
|
Danish Dependency Treebank V1.0 |
ddt1.0/ |
ddt-1.0.tar |
Danish |
|
|
5540 |
|
NEGRA corpus V2.0 |
Negra2.0/ |
negra-corpus.tar.gz |
German |
|
|
20602 |
export/Penn Treebank |
Merge files |
mrg/ |
|
|
|
|
|
|