Note that there separate sets of assignments for CS 451/651 and CS 431/631. Make sure you work on the correct asssignments!

CS 431/631 Assignments

Assignment 2 due 2:30pm February 6

This assignment requires you to compute statistics over tokens in the text of Shakespeare's plays, as you did for Assignment 1. However, instead of performing the analysis purely in Python, you will use Spark (with a Python driver program).

For this assignment, you will no longer be able to use the Compute Canada Jupyter hub, since it does not provide access to a Spark installation. Instead, you should use the Waterloo CS Jupyter hub at https://jupyter.student.cs.uwaterloo.ca:8000. To log in to the CS hub, you need to use your password for the CS student computing environment, not your WatIAM password. If you do not know your CS student computing password, you can reset it using this page. This will require you to authenticate using your WatIAM userid and password, to prove that you are you. You will then be able to set your CS student computing password. You can choose the same password that you use for WatIAM, or a different one.

You may wish to create a folder on the CS Jupyter hub to hold all of your CS431/631 work, as you did on the Compute Canada hub. For this assignment, you will need to upload the following files to your working folder on the hub:

• Shakespeare.txt: the complete text of Shakespeare's plays
• simple_tokenize.py: a simple Python module for tokenizing text
• A2.ipynb: this is the starter notebook for A2.

As usual, open the starter notebook on the hub to get started working on the assignment.

Submitting Assignment 2

Starting with this assignment, you should use Marmoset, rather than e-mail, to submit your assignment. The advantage of this is that it allows you to confirm your submission, and to update your submission if necessary.

To submit A2, use the following steps:

1. Download your A2.ipynb file from the CS hub to your computer.
2. Change the name of your file from A2.ipynb to A2-xxxxxxxx.ipynb, where xxxxxxxx is your UW student ID number.
3. Log in to Marmoset at https://marmoset.student.cs.uwaterloo.ca/ using your WatIAM password, and upload your re-named notebook file. Use the submit link for Assignment 2 to upload. You can see your previous submissions using the view link. You may submit multiple times - we will mark your latest (pre-deadline) submission.

Back to top