tradeoff/index.html at main · ResponsiblyAI/tradeoff · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
<!--
@license
Copyright 2020 Google. All Rights Reserved.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->

<!DOCTYPE html>

<html>

<head>
  <meta charset="utf-8">
  <meta name="viewport" content="width=device-width, initial-scale=1">

  <!-- <link rel="apple-touch-icon" sizes="180x180" href="https://pair.withgoogle.com/images/favicon/apple-touch-icon.png">
  <link rel="icon" type="image/png" sizes="32x32" href="https://pair.withgoogle.com/images/favicon/favicon-32x32.png">
  <link rel="icon" type="image/png" sizes="16x16" href="https://pair.withgoogle.com/images/favicon/favicon-16x16.png">
  <link rel="mask-icon" href="https://pair.withgoogle.com/images/favicon/safari-pinned-tab.svg" color="#00695c">
  <link rel="shortcut icon" href="https://pair.withgoogle.com/images/favicon.ico"> -->

  <script>
    !(function () {
      var url = window.location.href
      if (url.slice(-1) != '/' && !url.includes('.html')) window.location = url + '/'
    })()
  </script>

  <title>Child Maltreatment Hotline</title>
  <meta property="og:title" content="Child Maltreatment Hotline">
  <meta property="og:url" content="https://tradeoff.responsibly.ai">


  <meta name="og:description" content="TBD">


  <link rel="stylesheet" type="text/css" href="/style_global.css">

  <link href='https://fonts.googleapis.com/css?family=Roboto+Slab:400,500,700|Roboto:700,500,300' rel='stylesheet'
    type='text/css'>
  <link href="https://fonts.googleapis.com/css?family=Google+Sans:400,500,700" rel="stylesheet">

  <meta name="viewport" content="width=device-width">
</head>

<body>
  <div class='header'>
    <!-- <div class='header-left'> -->
    <a href='https://teach.responsibly.ai/'>
      <img src='https://learn.responsibly.ai/assets/logo.png' style='width: 150px'></img>
    </a>
    <!-- <a href='../'>Explorables</a> -->
    <!-- </div> -->
  </div>

  <h1 class='headline'>Child Maltreatment Hotline</h1>
  <div class="post-summary">TBD</div>

<link rel="stylesheet" href="/third_party/weepeople.css">
<link rel="stylesheet" href="/graph-scroll.css">
<link rel="stylesheet" href="/style.css">

<div id='container' class='container-1'>
    <div id='graph'></div>
    <div id='sections'>


        <div>
            <h1>Child Maltreatment Hotline</h1>

            <p>Following the increased volume of child maltreatment cases during the Covid-19 pandemic, and in light of
                limited
                resources, a Special Committee seeks input from various stakeholders on the design of an Automated
                Decision System (ADS)
                using machine learning for identifying children at risk of maltreatment. The screening system will focus
                on calls placed
                to a hotline, where information of child maltreatment is disclosed to social-worker interns.


            <p>Based on the call and on additional information logged in the system or pulled from government and public
                databases, the
                system will automatically decide which calls to write off as not requiring any additional action, and
                which calls to
                flag as requiring an additional investigation to be performed by a certified social worker.


        </div>


        <div>
            <h3>Ground Truth</h3>

            <p>In our data, 30% of the children are at risk <wee class='sick'>a</wee>. Children at risk are those that
                would be removed from home by the child protection agency within two years from the
                call. The other 70% of them are not at risk <wee class='well'>b</wee>.
        </div>


        <div>
            <h3>Model Predictions</h3>


            <p>In a perfect world, only calls regarding children at risk would be <bg class='sick'>flagged as ones
                    requiring an additional
                    investigation</bg>, and only calls regarding children that are actually not at risk would be <bg>
                    flagged
                    as not requiring an
                    additional investigation</bg>.

        </div>


        <div>
            <h3>Model Mistakes</h3>

            <p>But models (and also humans) aren't perfect.

            <p>The model might make a mistake and not flag a child who is at risk <wee class='sick bg-well'>c</wee>.

            <p>Or the opposite: the model might flag a child as one at risk <wee class='well bg-sick'>f</wee>, while in
                fact they are not at risk and no additional investigation is required.
        </div>


        <div>
            <h3>Never Miss Child at Risk...</h3>

            <p>One approach would be to have the model flag children at risk “aggressively”, such that close calls would
                be decided as
                “at risk”, and so the model will rarely miss a child at risk.

            <p>We can evaluate this model by counting the number of children who are correctly and incorrectly flagged
                as children at
                risk:

            <div class='metrics'></div>

        </div>


        <div>
            <h3>... Or Avoid Unnecessary Investigations?</h3>

            <p>On the other hand, certified social workers would be allocated to cases where no further investigation is
                required,
                resulting in wasting public resources and also in unnecessarily burdening families of children who are
                not truly at
                risk.

            <div class='metrics'></div>

            <p>These issues and trade-offs in model optimization aren't new, but they're brought into focus when we have
                the ability to
                fine-tune exactly how aggressively the model works when flagging children as being at risk or not.

        </div>

        <div>
            <h3>Improve Prediction Power</h3>

            <p>Sometimes it is useful to gather additional data to improve the predictive power of the model.
            <p>But do all data sources contribute equally? What are the meanings and consequences in terms of rights and
                values?

            <div class='metrics'></div>
            <br>


            <form>
                <input type="checkbox" id="child-protection" name="child-protection" value=".2" checked disabled>
                <label for="child-protection">Previous child protection records</label><br>

                <input type="checkbox" id="bio" name="bio" value=".2" checked disabled>
                <label for="bio">Family’s demographics records</label><br>

                <input type="checkbox" id="behavioral-health" name="behavioral-health" value=".1" checked disabled>
                <label for="behavioral-health">Parents’ behavioral health records</label><br>

                <input type="checkbox" id="criminal" name="criminal" value=".1" disabled>
                <label for="criminal">Parents’ criminal records</label><br>

                <input type="checkbox" id="social-benefits" name="social-benefits" value=".05" disabled>
                <label for="social-benefits">Parents’ social benefits records</label><br>

                <input type="checkbox" id="employment" name="employment" value=".1" disabled>
                <label for="employment">Parents’ employment records</label><br>

                <input type="checkbox" id="credit-score" name="credit-score" value=".05" disabled>
                <label for="credit-score">Parents’ credit score records</label><br>

                <input type="checkbox" id="social-media" name="social-media" value=".25" disabled>
                <label for="social-media">Family members’ social media profiles</label><br>
            </form>


        </div>

        <div>
            <h3>Putting it all Together</h3>

            <p>Now it is your turn to decide (1) which data sources to use and which to exclude; and (2) how
                aggressively the model is
                when flagging a call about a child at risk.


            <div class='metrics'></div>

            <br>

            <form id="datasources">

                <input type="checkbox" id="child-protection" name="child-protection" value=".2" checked>
                <label for="child-protection">Previous child protection records</label>
                <span data-tooltip="Previous calls to hotline, investigation and reports on each family member.">
                    <i class="fa-solid fa-circle-info icon"></i>
                </span>
                <br>

                <input type="checkbox" id="bio" name="bio" value=".2">
                <label for="bio">Family’s demographics records</label>
                <span data-tooltip="Age, race, ethnicity, gender, marital status, number of children and address.">
                    <i class="fa-solid fa-circle-info icon"></i>
                </span>
                <br>

                <input type="checkbox" id="behavioral-health" name="behavioral-health" value=".1">
                <label for="behavioral-health">Parents’ behavioral health records</label>
                <span data-tooltip="Medication prescriptions, counseling session start and stop times, results of clinical tests, diagnosis, symptoms and prognosis.">
                    <i class="fa-solid fa-circle-info icon"></i>
                </span>
                <br>

                <input type="checkbox" id="criminal" name="criminal" value=".1">
                <label for="criminal">Parents’ criminal records</label>
                <span data-tooltip="Arrests, criminal charges and the disposition of those charges.">
                    <i class="fa-solid fa-circle-info icon"></i>
                </span>
                <br>

                <input type="checkbox" id="social-benefits" name="social-benefits" value=".05">
                <label for="social-benefits">Parents’ social benefits records</label>
                <span data-tooltip="Past and current support from government  social welfare services and agencies.">
                    <i class="fa-solid fa-circle-info icon"></i>
                </span>
                <br>

                <input type="checkbox" id="employment" name="employment" value=".1">
                <label for="employment">Parents’ employment records</label>
                <span data-tooltip="Past and current employment, including start and end dates, employer name and job title.">
                    <i class="fa-solid fa-circle-info icon"></i>
                </span>
                <br>

                <input type="checkbox" id="credit-score" name="credit-score" value=".05">
                <label for="credit-score">Parents’ credit score records</label>
                <span data-tooltip="Credit scores, credit accounts, payment history, account balances, bankruptcies.">
                    <i class="fa-solid fa-circle-info icon"></i>
                </span>
                <br>

                <input type="checkbox" id="social-media" name="social-media" value=".25">
                <label for="social-media">Family members’ social media profiles</label>
                <span data-tooltip="Social media username and publicly available information in all social media platforms.">
                    <i class="fa-solid fa-circle-info icon"></i>
                </span>
                <br>

            </form>

            <br>
            <div class='slider threshold'></div>
            <i id='adjust-text'> Try adjusting how aggressive the model is in flagging a call about child at
                risk</i>
        </div>


    </div>
</div>
</div>
</div>

<br><br><br><br><br><br>

<h3>Credits</h3>

<p><a href="https://teach.responsibly.ai/">Teach Responsible AI Together</a>

<p>Adopted from <a href="https://pair.withgoogle.com/explorables/">AI Explorable</a> by <a
        href="https://pair.withgoogle.com/">PAIR</a>, made by <a href="https://roadtolarissa.com/">Adam Pearce</a>,
    licensed <a href="https://github.com/PAIR-code/ai-explorables">Apache License 2.0</a>.


<p>Silhouettes from <a href='https://github.com/propublica/weepeople'>ProPublica's Wee People</a>.


    <script src='/third_party/seedrandom.min.js'></script>
    <script src='/third_party/d3_.js'></script>
    <script src='/third_party/swoopy-drag.js'></script>
    <script src='/third_party/topojson-server.js'></script>
    <script src='/third_party/topojson-client.js'></script>
    <script src='/third_party/misc.js'></script>
    <script src='/annotations.js'></script>

    <script src='/students.js'></script>
    <script src='/sel.js'></script>
    <script src='/slider.js'></script>
    <script src='/mini.js'></script>
    <script src='/metrics.js'></script>
    <script src='/slides.js'></script>
    <script src='/sim-params.js'></script>
    <script src='/data-sources.js'></script>
    <script src='/gs.js'></script>
    <script src='/init.js'></script>

    <link rel="stylesheet" href="/base-rate/style.css">
    <script src='/base-rate/script.js'></script>

    <link rel="stylesheet" type="text/css" href="/tooltip.css">
    <script src="https://kit.fontawesome.com/994e94b7a6.js" crossorigin="anonymous"></script>

    <!-- <script src='../third_party/recirc.js'></script> -->
</body>

<!-- <script async src="https://www.googletagmanager.com/gtag/js?id=UA-138505774-1"></script>
<script>
  if (window.location.origin === 'https://pair.withgoogle.com') {
    window.dataLayer = window.dataLayer || [];
    function gtag() { dataLayer.push(arguments); }
    gtag('js', new Date());
    gtag('config', 'UA-138505774-1');
  }
</script> -->


</html>