forked from lintool/bigdata-2017w
-
Notifications
You must be signed in to change notification settings - Fork 0
/
organization.html
303 lines (245 loc) · 13.5 KB
/
organization.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
<!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
<meta name="description" content="Course homepage for CS 489 Big Data Infrastructure (Winter 2017) at the University of Waterloo">
<meta name="author" content="Jimmy Lin">
<title>Big Data Infrastructure</title>
<!-- Bootstrap -->
<link href="css/bootstrap.min.css" rel="stylesheet">
<!-- IE10 viewport hack for Surface/desktop Windows 8 bug -->
<link href="css/ie10-viewport-bug-workaround.css" rel="stylesheet">
<style>
body {
padding-top: 60px; /* 60px to make the container go all the way to the bottom of the topbar */
}
</style>
<!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries -->
<!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
<!--[if lt IE 9]>
<script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
<script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
<![endif]-->
</head>
<body>
<nav class="navbar navbar-inverse navbar-fixed-top">
<div class="container">
<div class="navbar-header">
<button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#navbar" aria-expanded="false" aria-controls="navbar">
<span class="sr-only">Toggle navigation</span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
</button>
</div>
<div id="navbar" class="collapse navbar-collapse">
<ul class="nav navbar-nav">
<li><a href="index.html">Overview</a></li>
<li class="active"><a href="organization.html">Organization</a></li>
<li><a href="syllabus.html">Syllabus</a></li>
<li><a href="assignments.html">Assignments</a></li>
<li><a href="software.html">Software</a></li>
</ul>
</div><!--/.nav-collapse -->
</div>
</nav>
<div class="container">
<div class="page-header">
<div style="float: right"/><img src="images/waterloo_logo.png"/></div>
<h1>Organization <small>CS 489/698 Big Data Infrastructure (Winter 2017)</small></h1>
</div>
<h3>Staff</h3>
<p>The instructor for this course is Jimmy Lin. If you're interested
in my research, here
is <a href="https://cs.uwaterloo.ca/~jimmylin/">my homepage</a>. The
course TAs are Libo Gao, Kareem El Gebaly, and Ripul Jain.</p>
<p>If you have general questions, post on Piazza. If you have personal
concerns, send email to
uwaterloo-bigdata-2017w-staff@googlegroups.com, which will reach the
instructor and the TAs. General questions sent to the mailing list
will be redirected to Piazza. Unless you specifically have a reason to
email me directly, you're better off emailing the staff list since the
TAs may be able to help you directly (and in fact, for routine issues
I'll forward your email to the staff list anyway).</p>
<h3>Course Materials</h3>
<p>The most recent version of all materials for this course will be
posted on this website, including the syllabus, readings, slides, and
assignments. Please check the site frequently for updates.</p>
<p>See the <a href="software.html">"software" page</a> for
instructions on getting access to MapReduce and Spark. Throughout this
course, you'll also be using <a href="http://bespin.io">Bespin</a>,
which is a software library that contains reference implementations of
"big data" algorithms in MapReduce and Spark.</p>
<p>The textbooks for this course are:</p>
<ul>
<li><a href="http://mapreduce.cc/">Data-Intensive Text Processing with MapReduce</a> by Jimmy Lin and Chris Dyer [<a href="http://lintool.github.com/MapReduceAlgorithms/ed1n/MapReduce-algorithms.pdf">PDF</a>]</li>
<li><a href="http://shop.oreilly.com/product/0636920033448.do">Hadoop: The Definitive Guide</a> (4th Edition) by Tom White [<a href="http://hadoopbook.com/">Book website</a>]</li>
<li><a href="http://shop.oreilly.com/product/0636920028512.do">Learning Spark</a> by Holden Karau, Andy Konwinski, Patrick Wendell, Matei Zaharia</lli>
</ul>
<p style="padding-top: 20px; padding-bottom: 20px">
<img height="200" src="images/MR-cover.jpg"/>
<img height="200" src="images/Hadoop-cover.jpg"/>
<img height="200" src="images/Spark-cover.jpg"/>
</p>
<p>Note that the two O'Reilly books are <i>optional but
recommended</i>. They are mostly there to help you with the mechanics
of MapReduce and Spark (API, command-line invocations, etc.). However,
the same material can be found from a multitude of freely-available
sources on the web (although not organized as well).</p>
<p>Readings from other sources such as research papers will be
assigned as appropriate.</p>
<h3>Grading</h3>
<p>Components of the final grade for CS 489 are as follows:</p>
<div style="width: 30%">
<table class="table table-striped">
<thead>
<tr><td><b>Component</b></td><td style="text-align:right"><b>Weight</b></td></tr>
</thead>
<tbody>
<tr><td>Assignment 0</td> <td style="text-align:right">7%</td></tr>
<tr><td>Assignment 1</td> <td style="text-align:right">8%</td></tr>
<tr><td>Assignment 2</td> <td style="text-align:right">8%</td></tr>
<tr><td>Assignment 3</td> <td style="text-align:right">8%</td></tr>
<tr><td>Assignment 4</td> <td style="text-align:right">12%</td></tr>
<tr><td>Assignment 5</td> <td style="text-align:right">12%</td></tr>
<tr><td>Assignment 6</td> <td style="text-align:right">12%</td></tr>
<tr><td>Assignment 7</td> <td style="text-align:right">8%</td></tr>
<tr><td>Final Exam</td> <td style="text-align:right">25%</td></tr>
<tr><td><b>Total</b></td> <td style="text-align:right">100%</td></tr>
</tbody>
</table>
</div>
<p><b>The homework assignments are to be completed individually.</b>
See below section on Academic Integrity. Assignments are due before
the class indicated on the <a href="syllabus.html">syllabus</a> (i.e.,
1:00pm).</p>
<p><b>Late policy:</b> For assignments up to 24 hours late, we will
take the grade you would have gotten and multiply it by 0.75 (i.e.,
25% reduction). For assignments more than 24 hours late but less than
48 hours late, we will take the grade you have gotten and multiply it
by 0.5 (i.e., 50% reduction). Assignments more than 48 hours late will
not be accepted. By assumption, we will mark your assignment at the
deadline if you want us to "hold off" on marking (and take the
late penalty), you <b>must</b> let us know, and you <b>must</b> let us
know when the assignment is ready for marking so we can compute the
late penalty appropriately. Email the staff mailing list for these
communications.</p>
<p><b>Assignment marking reappraisal requests:</b> If you believe we
have made an error marking your assignment, you may request that your
assignment be reappraised. Please email staff with the request
detailing the issue. Note that for each request, the <i>entire</i>
assignment will be reconsidered, in addition to the highlighted
issues. This means that your grade might be adjusted up or
down—the latter case if we found an error that was missed the
first time.</p>
<p>Components of the final grade for CS 698 are as follows:</p>
<div style="width: 30%">
<table class="table table-striped">
<thead>
<tr><td><b>Component</b></td><td style="text-align:right"><b>Weight</b></td></tr>
</thead>
<tbody>
<tr><td>Assignments</td> <td style="text-align:right">60%</td></tr>
<tr><td>Final Exam</td> <td style="text-align:right">20%</td></tr>
<tr><td>Final Project</td> <td style="text-align:right">20%</td></tr>
<tr><td><b>Total</b></td> <td style="text-align:right">100%</td></tr>
</tbody>
</table>
</div>
<p>The relative weight of each assignment is the same as it is in the
CS 489 breakdown. CS 698 includes an additional <i>group</i> final
project.</p>
<h3>Academic Integrity</h3>
<p>All work in this course is to be done individually unless otherwise
noted (e.g., the group final project for CS 698).</p>
<p>The penalty for plagiarism (first offense) is an assigned grade of
0 for that particular component <i>and</i> a 10% reduction of the
final grade. Note that this penalty applies to both the individual(s)
giving as well as the individual(s) receiving the assistance. In
addition, a letter detailing the offense will be sent to the Associate
Dean of Undergraduate Studies, meaning that subsequent offenses will
carry more severe penalties, up to suspension or expulsion.</p>
<p>To avoid inadvertently plagiarizing, you should discuss assignment
issues with other students only in a very broad and high-level
fashion. Do not take notes during such discussions and do not looking
at anyone else's code, on screen or on paper. If you find yourself
stuck, contact the TAs or the instructor for help. You are allowed to
search the web for information about <i>general issues</i>, but do not
try to search for solutions online (or ask for help online on mailing
lists or in forums such as StackOverflow, etc.). The assignments are
designed so that solutions are not available online, but if you
inadvertently stumble onto a solution to any of the assignments, do
not look at it. If you do find a solution online, however, please let
us know—we will appreciate it and not construe it as plagiarism
(unless, of course, you actually do copy the solution).</p>
<p>Senate Undergraduate Council has asked us to post the following
paragraphs:</p>
<p><b>Academic Integrity:</b> In order to maintain a culture of
academic integrity, members of the University of Waterloo community
are expected to promote honesty, trust, fairness, respect and
responsibility.</p>
<p><b>Grievance:</b> A student who believes that a decision affecting
some aspect of his/her university life has been unfair or unreasonable
may have grounds for initiating a
grievance. Read <a href="http://www.adm.uwaterloo.ca/infosec/Policies/policy70.htm">Policy
70 - Student Petitions and Grievances, Section 4</a>.
<p><b>Discipline:</b> A student is expected to know what constitutes
academic integrity, to avoid committing academic offenses, and to take
responsibility for his/her actions. A student who is unsure whether an
action constitutes an offense, or who needs help in learning how to
avoid offenses (e.g., plagiarism, cheating) or about "rules" for group
work/collaboration should seek guidance from the course professor,
academic advisor, or the Undergraduate Associate Dean. When misconduct
has been found to have occurred, disciplinary penalties will be
imposed
under <a href="http://www.adm.uwaterloo.ca/infosec/Policies/policy71.htm">Policy
71 - Student Discipline</a>. For information on categories of offenses
and types of penalties, students should refer to that policy.
<p><b>Avoiding Academic Offenses:</b> Most students are unaware of the
line between acceptable and unacceptable academic behaviour,
especially when discussing assignments with classmates and using the
work of other students. For information on commonly misunderstood
academic offenses and how to avoid them, students should refer to the
<a href="http://www.math.uwaterloo.ca/navigation/Current/cheating_policy.shtml">Faculty
of Mathematics Cheating and Student Academic Discipline Policy</a>.
<p><b>Appeals:</b> A student may appeal the finding and/or penalty in
a decision made under Policy 70 - Student Petitions and Grievances
(other than regarding a petition) or Policy 71 - Student Discipline if
a ground for an appeal can be
established. Read <a href="http://www.adm.uwaterloo.ca/infosec/Policies/policy72.htm">Policy
72 - Student Appeals</a>.
<h3>Accommodations</h3>
<p><b>Illness policy:</b> From time to time students become ill or
have ongoing medical conditions that prevent them from meeting
academic obligations. For these cases, please consult
the <a href="https://uwaterloo.ca/registrar/final-examinations/examination-regulations-and-related-matters">university
policy</a>.</p>
<p><b>Accommodations for Religious Holidays and Other Special
Circumstances.</b> Students wishing to discuss accommodations for
religious holidays on dates that assignments are due, or other
circumstances not addressed in this course information page, should
discuss those circumstances with me before the third class session in
order to permit adequate time for planning. Only accommodations for
unforeseeable circumstances will be considered after that date.</p>
<p><b>Note for students with
disabilities:</b> <a href="http://uwaterloo.ca/disability-services">AccessAbility
Services</a>, located in Needles Hall, collaborates with all academic
departments to arrange appropriate accommodations for students with
disabilities without compromising the academic integrity of the
curriculum. If you require academic accommodations to lessen the
impact of your disability, please register with them at the beginning
of each academic term.</p>
</div>
<p style="padding-top:100px" />
</div><!-- /.container -->
<!-- jQuery (necessary for Bootstrap's JavaScript plugins) -->
<script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.3/jquery.min.js"></script>
<!-- Include all compiled plugins (below), or include individual files as needed -->
<script src="js/bootstrap.min.js"></script>
<!-- IE10 viewport hack for Surface/desktop Windows 8 bug -->
<script src="js/ie10-viewport-bug-workaround.js"></script>
</body>
</html>