<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body>
<div>Dear Heather, all,</div>
<div><br>
</div>
<div>Just a few comments below in your post.</div>
<div><br>
</div>
<div>Jeroen Bosman</div>
<div><br>
</div>
<div style="font-size:100%;color:#000000"><!-- originalMessage -->
<div>-------- Original message --------</div>
<div>From: Heather Morrison <Heather.Morrison@uottawa.ca> </div>
<div>Date: 13/07/2018 17:54 (GMT+01:00) </div>
<div>To: "Global Open Access List (Successor of AmSci)" <goal@eprints.org> </div>
<div>Subject: Re: [GOAL] Why translating all scholarly knowledge for non-specialists using AI is complicated
</div>
<div><br>
</div>
</div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Helvetica,sans-serif">
<p style="margin-top:0; margin-bottom:0">Further questions / comments for Jason Priem (JP) and anyone who cares to participate...</p>
<p style="margin-top:0; margin-bottom:0"><br>
</p>
<div>
<div dir="ltr">
<div>JP: So the first part will be the annotation of difficult words in the text, which is just a mash-up of basic named-entity recognition and Wikipedia/Wikidata definitions. Pretty easy, pretty safe. </div>
<div><br>
</div>
<div>HM: Q1: to clarify, we are talking about peer-reviewed journal articles, right? You are planning to annotate journal articles that are written and vetted by experts using definitions that are developed by anyone who chooses to participate in Wikipedia
/ Wikidata, i.e. annotating works that are carefully vetted by experts using the contributions of non-experts?</div>
<div><br>
</div>
<div>》》》 It is too simple to use a dichotomy of experts-non experts. This is a graded difference. Also it is very incorrect to suppose that Wikipedia is not also contributed to by experts. There are numerous examples of active and emeritus scholars editing
lots of science articles in wikipedia. You might even find that definitions used in the journal articles themselves are sourced from wikipedia.</div>
<div><br>
</div>
<div>Q2: who made the decision that this is safe, and how was this decision made?</div>
<div><br>
</div>
<div>Comments: </div>
<div><br>
</div>
<div>I submit that this is not safe. There are reasons for careful vetting of expertise, through a long process of education and examination, review in the process of hiring, making decisions about tenure, promotion, and grant applications, and then peer review
and editing of the work of those qualified to have their work considered. Mine is not an elitist perspective. There are areas where the expertise does not lie in the academy at all; examples include traditional knowledge and native languages. </div>
<div><br>
</div>
<div>If the author has not given permission, this is a violation of the author's moral rights under copyright. This includes all CC licensed works except CC-0. </div>
<div><br>
</div>
<div><br>
</div>
<div>》》》 Interesting but questionable angle. If this is generated on the fly just as with litteral translation tools and not published I do not see how it would be a violation. The plain language explanations could also be posted as 'comments': "we think this
abstracts means ....". </div>
<div><br>
</div>
<div>JP: Another set of features will be automatically categorizing trials as to whether they are double-blind RCTs or not, and automatically finding systematic reviews. These are all pretty easy technically, and pretty unlikely to point people in the wrong
directions. But the start adding value right away, making it easier for laypeople to engage with the literature.</div>
<div><br>
</div>
<div>HM: this does not seem problematic and seems likely to be primarily useful to scholars. I am not opposed to your project, just the assumption that a two-year project is sufficient to create a real-world system to translate all scholarly knowledge for the
lay reader. </div>
<div><br>
</div>
<div>JP: From there we'll move on to the harder stuff like the automatic summarization. Cautiously, and iteratively. We certainly won't be rolling anything out to everyone right away. It's a two-year grant, and we're looking at that as two years of continued
development, with constant feedback from users as well as experts in the library and public outreach worlds. If something doesn't work, we throw it away. Part of the process.</div>
<div><br>
</div>
<div>HM: this is highly problematic. A cautious and iterative approach is wise; however this is not feasible in the context of a two-year grant. May I suggest a small pilot project? Try this with a few articles in an area where at least one member of your team
has a doctorate. Take the time to evaluate the summaries. If they look okay to your team, plan a larger evaluation project involving other experts and the lay readers you are aiming to engage (because what an expert thinks a summary says may not be the same
as how a non-expert would interpret the same summary). </div>
<div><br>
</div>
<div>Thank you for posting openly about the approach and for the opportunity to comment. </div>
<div><br>
</div>
</div>
<div class="x_gmail_extra">
<div class="x_gmail_quote">
<blockquote class="x_gmail_quote" style="margin:0 0 0 .8ex; border-left:1px #ccc solid; padding-left:1ex">
<div lang="EN-US">
<div class="x_m_331536712358961416WordSection1">
<div>
<div class="x_h5">
<div id="x_m_331536712358961416divtagdefaultwrapper">
<div>
<div>
<p><span style="font-size:12.0pt; color:black">best,<u></u><u></u></span></p>
<p><span style="font-size:12.0pt; color:black"><u></u> <u></u></span></p>
<div id="x_m_331536712358961416Signature">
<div id="x_m_331536712358961416divtagdefaultwrapper">
<p><span style="font-size:12.0pt; color:black">Heather Morrison<u></u><u></u></span></p>
<p><span style="font-size:12.0pt; color:black">Associate Professor, School of Information Studies, University of Ottawa<u></u><u></u></span></p>
<p><span style="font-size:12.0pt; color:black">Professeur Agrégé, École des Sciences de l'Information, Université d'Ottawa<u></u><u></u></span></p>
<p><span style="font-size:12.0pt; color:black"><a href="mailto:Heather.Morrison@uottawa.ca" id="LPlnk282571" class="OWAAutoLink">Heather.Morrison@uottawa.ca</a><u></u><u></u></span></p>
<p><span style="font-size:12.0pt; color:black"><a href="https://uniweb.uottawa.ca/?lang=en#/members/706" id="LPlnk830851" class="OWAAutoLink" target="_BLANK">https://uniweb.uottawa.ca/?<wbr>lang=en#/members/706</a><u></u><u></u></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
_</blockquote>
</div>
<div class="x_gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr"></div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>