-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathnew.tag
More file actions
167 lines (164 loc) · 7.86 KB
/
new.tag
File metadata and controls
167 lines (164 loc) · 7.86 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
<new>
<div if={status=="loading"} class="valign-wrapper" style="width: 100%; height: 100%">
<spinner size="big" class="center-align" style="margin: auto"></spinner>
</div>
<div if={status=="welcome"}>
<div class="row">
<div class="col s12 center-align">
<h3>Welcome to the outlier detection.</h3>
<a class="waves-effect waves-light btn-large" style="margin-top: 1em" onclick={onNewExercise}><i class="material-icons left">fiber_new</i>Start a new exercise</a>
<a class="waves-effect waves-light btn-large" style="margin-top: 1em" onclick={onContinueExercise}><i class="material-icons left">restore</i>Continue an existing exercise</a>
</div>
</div>
</div>
<div if={status=="getuser"}>
<div class="row">
<div class="col s12 m6">
<div class="card">
<div class="card-content">
<span class="card-title">Start a new exercise</span>
<div class="input-field">
<i class="material-icons prefix">account_circle</i>
<input id="name" ref="name" type="text" class="validate" required="" oninput={checkFields}>
<label class="active" for="name">Your nickname</label>
</div>
<div class="input-field">
<i class="material-icons prefix">language</i>
<select ref="language" required="" onchange={checkFields}>
<option value="" disabled selected>Choose your language</option>
<option value="CS">Czech</option>
<option value="EN">English</option>
<option value="ET">Estonian</option>
<option value="FR">French</option>
<option value="DE">German</option>
<option value="IT">Italian</option>
<option value="SK">Slovak</option>
</select>
<label>Select your language</label>
Is your language not listed? Let us know at <a href="mailto:inquiries@sketchengine.eu">inquiries@sketchengine.eu</a> if you would like to volunteer to translate an initial dataset of 800 words.
</div>
</div>
<div class="card-action" if={formComplete}>
<a href="javascript:void(0)" onclick={getNewExercise}>Continue</a>
</div>
</div>
</div>
</div>
</div>
<div if={status=="continue"}>
<div class="row">
<div class="col s12 m6">
<div class="card">
<div class="card-content">
<span class="card-title">Continue an existing exercise</span>
<div class="input-field">
<i class="material-icons prefix">confirmation_number</i>
<input id="name" ref="exercise_id" type="text" class="validate" required="" pattern="[a-fA-F0-9]\{32\}" oninput={checkExID}>
<label class="active" for="name">Your unique exercise ID (16 characters)</label>
</div>
</div>
<div class="card-action" if={exIDComplete}>
<a href="javascript:void(0)" onclick={goExercise}>Continue</a>
</div>
</div>
</div>
</div>
</div>
<div if={status=="start"}>
<div class="row">
<div class="col s12">
<div class="card">
<div class="card-content">
<span class="card-title">Welcome {name}</span>
You are about to start a new exercise. Your exercise ID is <h5>{id}</h5> and
you can return to this exercise later through this <a href="https://milos.sketchengine.co.uk/outlier_detection/#exercise{id}">link</a> or from the main page by entering your exercise ID.
<h5>Your task</h5>
<ul class="browser-default" style="color: black">
<li>You will be presented 9 words.</li>
<li>Your task is to choose an <em>outlier</em>. An outlier is a word that does not fit based on its meaning or sense.</li>
<li>Examples:<br> <em>blue, red, green, yellow, orange, black, brown, white, table</em>. Obviously, the last word is the outlier: all the others are names of colours.<br>
<em>bricklayer, lawyer, shop assistant, gentleman, waitress, metheorologist</em>. <em>Gentleman</em> is an outlier because it is not a job.</li>
</ul>
<h5>Why should I do it?</h5>
<ul class="browser-default" style="color: black">
<li>Your answers will be used for the evaluation of automatically built thesauri in order to improve the methods for their automatic generation.</li>
<li>Examples of distributional thesauri: <a href="https://www.sketchengine.eu/guide/thesaurus-synonyms-antonyms-similar-words/">a word-sketch based one</a> and <a href="https://embeddings.sketchengine.co.uk/">a word-embeddings based one</a>.</li>
<li>The key reason for taking the task manually is to detect issues in the dataset which will manifest themselves by low inter-annotator agreement.</li>
</ul>
<h5>How long does it take?</h5>
<ul class="browser-default" style="color: black">
<li>About 10 minutes.</li>
</ul>
<h5>What happens with the data?</h5>
<ul class="browser-default" style="color: black">
<li>The resulting dataset will be openly available under the <a href="https://creativecommons.org/licenses/by-sa/4.0/legalcode">CC-BY-SA 4.0 licence</a> in the <a href="https://github.com/elexis-eu">ELEXIS GitHub repository</a>.</li>
<li>We will also publish anonymized statistics on the inter-annotator agreement evaluation.</li>
<li>By taking the exercise you agree that your answers can be stored and used to improve the outlier detection datasets.</li>
</ul>
<h5>Can I take the exercise in a language that is not my mother tongue</h5>
<ul class="browser-default" style="color: black">
<li>Please do not! While your knowledge of the second language might be excellent, you decisions might be motivated differently than those of native speakers.</li>
</ul>
<h5>Can I take mutliple turns?</h5>
<ul class="browser-default" style="color: black">
<li>Please do not because your next turn could be affected by the data you have seen already.</li>
</ul>
<p>
<label for="agree">
<input type="checkbox" id="agree" onchange={agreeChanged} ref="agree"/>
<span class="red-text"><strong>I HAVE READ THIS AND I AGREE</strong></span>
</label>
</p>
</div>
<div class="card-action" if={agreed}>
<a href="javascript:void(0)" onclick={startExercise}>Start exercise</a>
</div>
</div>
</div>
</div>
</div>
<script>
this.status = "welcome";
this.formComplete = false;
this.exIDComplete = false;
this.agreed = false;
agreeChanged() {
this.agreed = !!this.refs.agree.checked;
}
onNewExercise(e) {
this.status = "getuser";
this.update();
$('select').formSelect();
}
onContinueExercise(e) {
this.status = "continue";
this.update();
}
checkFields(e) {
var name = this.refs.name.value;
var lang = this.refs.language.value;
this.formComplete = (name && lang);
}
checkExID(e) {
this.exIDComplete = this.refs.exercise_id.checkValidity()
}
goExercise(e) {
route("/exercise/" + this.refs.exercise_id.value);
}
getNewExercise(e) {
var name = this.refs.name.value;
var lang = this.refs.language.value;
this.status = "loading";
this.update();
$.get("exercise.cgi?action=new&name=" + encodeURIComponent(name) + "&lang=" + lang).done((data) => {
this.status = "start";
this.name = name;
this.id = data["id"];
this.update();
})
}
startExercise(e) {
route("exercise/" + this.id)
}
</script>
</new>