<html><head><meta http-equiv="Content-Type" content="text/html charset=windows-1252"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><blockquote type="cite"><div lang="EN-GB" link="blue" vlink="purple"><div class="WordSection1" style="page: WordSection1;"><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">Only Scientific Members who are affiliated with an accredited university and have at least</span></div></div></div></blockquote><blockquote type="cite"><div lang="EN-GB" link="blue" vlink="purple"><div class="WordSection1" style="page: WordSection1;"><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">5 publications assigned to their ORCID account may officially review an article at ScienceOpen. </span></div></div></div></blockquote><div><br></div>So being <span style="color: rgb(31, 73, 125); font-family: Calibri, sans-serif; font-size: 11pt;">affiliated with an accredited university and having at least 5 publications makes </span><div><span style="color: rgb(31, 73, 125); font-family: Calibri, sans-serif; font-size: 11pt;">anyone a specialist qualified to review anyone's research?</span><div><div><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 15px;"><br></span></font></div><div><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 15px;">The criterion for peership might have to be a trifle more exacting than that even before we</span></font></div><div><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 15px;">raise once again the niggling question of answerability...</span></font></div><div><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 15px;"><br></span></font></div><div><span style="font-family: 'Times New Roman'; font-size: 14px;">Harnad, S. (1990) Scholarly Skywriting and the Prepublication Continuum of Scientific Inquiry </span></div><div><i style="font-family: 'Times New Roman'; font-size: 14px;">Psychological Science</i><span style="font-family: 'Times New Roman'; font-size: 14px;"> 1: 342 - 343 (reprinted in </span><i style="font-family: 'Times New Roman'; font-size: 14px;">Current Contents</i><span style="font-family: 'Times New Roman'; font-size: 14px;"> 45: 9-13, November 11 1991). </span></div><div><a href="http://cogprints.org/1581/" style="font-family: 'Times New Roman'; font-size: 14px;"><span class="s9" style="color: rgb(24, 65, 170);">http://cogprints.org/1581/</span></a><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 15px;"><br></span></font><div><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 15px;"><br></span></font></div><div><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 15px;">Stevan Harnad</span></font></div><div><font color="#1f497d" face="Calibri, sans-serif"><span style="font-size: 15px;"><br></span></font><div><div>On Aug 22, 2014, at 4:41 AM, Jennifer Smith <<a href="mailto:jesmith@sgul.ac.uk">jesmith@sgul.ac.uk</a>> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div lang="EN-GB" link="blue" vlink="purple" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><div class="WordSection1" style="page: WordSection1;"><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">Hi All<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);"> </span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">As list members probably know, Frontiers In … have a slightly different<span class="Apple-converted-space"> </span><a href="http://www.frontiersin.org/about/reviewsystem" style="color: purple; text-decoration: underline;">method of reviewing</a><span class="Apple-converted-space"> </span>than traditional peer review model.<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);"> </span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">I noticed recently another alternative model for reviewing, at ScienceOpen (based on having an academic ID, in this case, ORCiD):<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);"> </span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">“Comments and Reviews require registration via ORCID<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);"> </span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">Everybody can read, download and share your article. Commenting, rating and reviewing,</span></div></div></div></blockquote><blockquote type="cite"><div lang="EN-GB" link="blue" vlink="purple" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><div class="WordSection1" style="page: WordSection1;"><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">however, requires previous registration via ORCID. Only Scientific Members who are</span></div></div></div></blockquote><blockquote type="cite"><div lang="EN-GB" link="blue" vlink="purple" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><div class="WordSection1" style="page: WordSection1;"><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">affiliated with an accredited university and have at least 5 publications assigned to their</span></div></div></div></blockquote><blockquote type="cite"><div lang="EN-GB" link="blue" vlink="purple" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><div class="WordSection1" style="page: WordSection1;"><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">ORCID account may officially review an article at ScienceOpen. Commenting requires</span></div></div></div></blockquote><blockquote type="cite"><div lang="EN-GB" link="blue" vlink="purple" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><div class="WordSection1" style="page: WordSection1;"><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">at least 1 publication. Please refer to our User Categories for a detailed description. In</span></div></div></div></blockquote><blockquote type="cite"><div lang="EN-GB" link="blue" vlink="purple" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><div class="WordSection1" style="page: WordSection1;"><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">any case, please consult our Peer Review Guidelines and Guidelines for Commenting</span></div></div></div></blockquote><blockquote type="cite"><div lang="EN-GB" link="blue" vlink="purple" style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><div class="WordSection1" style="page: WordSection1;"><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">before writing a review or commenting on papers.”<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);"> </span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);"><a href="http://about.scienceopen.com/how-does-it-work/#more-9" style="color: purple; text-decoration: underline;">http://about.scienceopen.com/how-does-it-work/#more-9</a><o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);"> </span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">Interesting times to see what develops and is taken up.<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);"> </span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">Kind regards,<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);"> </span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">Jennifer<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);"> </span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">Jennifer Smith<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">Research Publications Librarian<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">Library<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">Information Services<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">St George's University of London<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">E:<span class="Apple-converted-space"> </span><a href="mailto:jesmith@sgul.ac.uk" style="color: purple; text-decoration: underline;">jesmith@sgul.ac.uk</a><o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);">T: +44 (0)20 8725 5393<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);"> </span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><b><span lang="EN-US" style="font-size: 10pt; font-family: Tahoma, sans-serif;">From:</span></b><span lang="EN-US" style="font-size: 10pt; font-family: Tahoma, sans-serif;"><span class="Apple-converted-space"> </span>Repositories discussion list [<a href="mailto:JISC-REPOSITORIES@JISCMAIL.AC.UK" style="color: purple; text-decoration: underline;">mailto:JISC-REPOSITORIES@JISCMAIL.AC.UK</a>]<span class="Apple-converted-space"> </span><b>On Behalf Of<span class="Apple-converted-space"> </span></b>Stevan Harnad<br><b>Sent:</b><span class="Apple-converted-space"> </span>21 August 2014 20:19<br><b>To:</b><span class="Apple-converted-space"> </span><a href="mailto:JISC-REPOSITORIES@JISCMAIL.AC.UK" style="color: purple; text-decoration: underline;">JISC-REPOSITORIES@JISCMAIL.AC.UK</a><br><b>Subject:</b><span class="Apple-converted-space"> </span>Crowd-Sourced Peer Review: Substitute or Supplement?<o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><o:p> </o:p></div><div><div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><b><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(51, 51, 51);">Harnad, S. (2014) </span><a href="http://blogs.lse.ac.uk/impactofsocialsciences/2014/08/21/crowd-sourced-peer-review-substitute-or-supplement/" style="color: purple; text-decoration: underline;">Crowd-Sourced Peer Review: Substitute or supplement for the current outdated system?</a></b><b><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(51, 51, 51);"> <em><span style="font-family: Verdana, sans-serif;">LSE Impact Blog</span></em> 8/21 </span></b><o:p></o:p></div></div><div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><o:p> </o:p></div></div><div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(51, 51, 51);">EXCERPT:</span><o:p></o:p></div></div><div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><o:p> </o:p></div></div><div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(51, 51, 51);">If, </span><a href="http://www.wired.co.uk/news/archive/2014-08/13/google-science-would-we-need-it" style="color: purple; text-decoration: underline;"><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(0, 51, 102);">as rumoured</span></a><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(51, 51, 51);">, google builds a platform for depositing unrefereed research papers for “peer-reviewing” via</span><a href="https://en.wikipedia.org/wiki/Crowdsourcing" style="color: purple; text-decoration: underline;"><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(0, 51, 102);">crowd-sourcing</span></a><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(51, 51, 51);">, can this create a <em><span style="font-family: Verdana, sans-serif;"><a href="https://www.google.ca/?gws_rd=ssl#q=harnad+%22peer+review%22+substitute+supplement" style="color: purple; text-decoration: underline;"><span style="color: rgb(0, 51, 102);">substitute</span></a></span></em> for classical peer-review or will it merely <em><span style="font-family: Verdana, sans-serif;"><a href="https://www.google.com/webhp?tbm=blg&gws_rd=ssl#q=site:openaccess.eprints.org+%22peer+review%22+substitute+supplement&tbm=blg" style="color: purple; text-decoration: underline;"><span style="color: rgb(0, 51, 102);">supplement</span></a></span></em> classical peer review with crowd-sourcing?</span><o:p></o:p></div></div><div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><o:p> </o:p></div></div><div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(51, 51, 51);">... no one knows whether crowd-sourced peer-review, even if it could work, would be scaleable or sustainable.</span><o:p></o:p></div></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(51, 51, 51);"><br>The key questions are hence:</span><o:p></o:p></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><em><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(51, 51, 51);">1. Would all (most? many?) authors be willing to post their unrefereed papers publicly (and in place of submitting them to journals!)?</span></em><i><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(51, 51, 51);"><br><br><em><span style="font-family: Verdana, sans-serif;">2. Would all (most? many?) of the posted papers attract referees? competent experts?</span></em><br><br><em><span style="font-family: Verdana, sans-serif;">3. Who/what decides whether the refereeing is competent, and whether the author has adequately complied? (Relying on a <a href="http://www0.cs.ucl.ac.uk/staff/L.Capra/publications/ubicrowd11.pdf" style="color: purple; text-decoration: underline;"><span style="color: rgb(0, 51, 102);">Wikipedia-style cadre of 2nd-order crowd-sourcers</span></a> who gain authority recursively in proportion to how much 1st-order crowd-sourcing they have done — rather than on the basis of expertise — sounds like a way to generate Wikipedia quality, but not peer-reviewed quality…)</span></em><br><br><br><em><span style="font-family: Verdana, sans-serif;">4. If any of this actually happens on any scale, will it be sustainable?</span></em><br><br><em><span style="font-family: Verdana, sans-serif;">5. Would this make the landscape (unrefereed preprints, referee comments, revised postprints) as navigable and useful as classical peer review, or not?</span></em></span></i><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(51, 51, 51);"><o:p></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(51, 51, 51);">My own prediction (based on nearly a quarter century of </span><a href="http://users.ecs.soton.ac.uk/harnad/Temp/bbs.valedict.html" style="color: purple; text-decoration: underline;"><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(0, 51, 102);">umpiring</span></a><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(51, 51, 51);"> both classical peer review and open peer commentary) is that crowdsourcing will provide an excellent supplement to classical peer review but not a substitute for it. Radical implementations will simply end up re-inventing classical peer review, but on a much faster and more efficient PostGutenberg platform. We will not realize this, however, until all of the peer-reviewed literature has first been made open access. And for that it is not sufficient for Google merely to provide a platform for authors to put their unrefereed papers, because most authors don’t even put their refereed papers in their institutional repositories until it is mandated by their institutions and funders.</span><o:p></o:p></div><div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><o:p> </o:p></div></div><div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;"><a href="http://openaccess.eprints.org/index.php?/archives/1121-Crowd-Sourced-Peer-Review-Substitute-or-Supplement.html" style="color: purple; text-decoration: underline;">http://openaccess.eprints.org/index.php?/archives/1121-Crowd-Sourced-Peer-Review-Substitute-or-Supplement.html</a></div></div></div></div></div></blockquote></div><br></div></div></div></div></body></html>