[wiki:HlpLab/LSA09/Syllabus Syllabus] | [wiki:HlpLab/LSA09/Assignments Assignments] | [wiki:HlpLab/LSA09/People People] | [wiki:HlpLab/LSA09/CorporaTutorials Corpora & Tutorials] | [wiki:HlpLab/LSA09/References References] | [http://lsa2009.berkeley.edu/courses/lsa125.html Offical LSA course page]

Corpora and Tutorials

1. Logging onto the corpus server

To do your corpus work, you'll have to log onto the corpus server via SSH. Mac users and those of you using the Windows computers in the computer facilities on campus are all set. For those of you bringing private laptops that run Windows and don't already have an ssh/scp program, please download and install one, e.g. PuTTY (http://www.chiark.greenend.org.uk/~sgtatham/putty/) or OpenSSH (http://sourceforge.net/projects/sshwindows/files/OpenSSH%20for%20Windows%20-%20Release/setupssh381-20040709.zip).

To log onto the corpus server:

ssh <username>@174.129.205.212

Usernames and passwords will be distributed in the first class meeting.

...and if you don't know what any of this means, don't panic - we'll have a tutorial during the first week of class where we'll explain how to log on to the server and use basic Unix commands.

2. Unix Tutorial

If you don't have any experience with Unix (or if you want to refresh your memory), there will be a tutorial on Tuesday, 7/7, at 6pm in 212 Wheeler Hall. We'll go through basic commands that you need to navigate a Unix system. All corpus work will be done on a Unix system, so if you don't feel comfortable with Unix, please come to the tutorial! If you have a laptop, bring it along. If you don't, there will also be computers available in the room.

You can download a very basic Unix/vi/tgrep2/regular expressions cheatsheet here: attachment:cheatsheet.txt

3. Available Corpora

The following corpora are available on the server for TGrep2 searches:

• Arabic Treebank (/corpora/TGrep2able/arabic-collapsed.t2c.gz)
• British National Corpus (full) (/corpora/TGrep2able/BNC.parsed.t2c.gz)
• British National Corpus (spoken) (/corpora/TGrep2able/BNC_spoken.parsed.t2c.gz)
• British National Corpus (written) (/corpora/TGrep2able/BNC_written.parsed.t2c.gz)
• Brown Corpus (/corpora/TGrep2able/brown.t2c.gz)
• Chinese Trebank (/corpora/TGrep2able/chtb6.t2c.gz)
• NEGRA (/corpora/TGrep2able/negra.t2c.gz)
• Switchboard Corpus (/corpora/TGrep2able/sw.backtrans.convid_020607.t2c.gz)
• TIGER (/corpora/TGrep2able/tiger.t2c.gz)
• Wall Street Journal (/corpora/TGrep2able/wsj_mrg.t2c.gz)

4. TGrep2

Here is the TGrep2 User Manual with information on how to run TGrep2, Tgrep2 options and pattern syntax, how to create MACRO files, etc. attachment:TGrep2Manual.pdf

For the Penn Treebank Bracketing Conventions: http://bulba.sdsu.edu/jeanette/thesis/PennTags.html

5. R Tutorials

This guide is a brief schematic introduction to computing in the R language. Basic statistical concepts such as variables, descriptive statistics, scales, reasoning, hypothesis testing and power analysis are defined and explained. attachment:StatsNotes1.pdf, attachment:StatsNotes2.pdf.

Also, consider out [wiki:HlpLab/StatsCourses lab-internal stats tutorials] with R-scripts, reading suggestions, etc. There also are a [http://hlplab.wordpress.com couple of posts on our HLP lab blog] about visualization, model fitting, common issues, snippets of R code, etc. The easiest way to find what you're looking for is to just enter it as a search term on the blog page linked above.

Finally, if you decide to make R your choice for data analysis, we recommend that you enroll to the [https://ling.ucsd.edu/mailman/listinfo.cgi/r-lang R-lang email list]. It's low-traffic, and directed at language researchers. The perfect place to ask questions.

AttachList

[wiki:HlpLab/LSA09/Syllabus Syllabus] | [wiki:HlpLab/LSA09/Assignments Assignments] | [wiki:HlpLab/LSA09/People People] | [wiki:HlpLab/LSA09/CorporaTutorials Corpora & Tutorials] | [wiki:HlpLab/LSA09/References References] | [http://lsa2009.berkeley.edu/courses/lsa125.html Offical LSA course page]