<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body dir="auto">
<div>hi Eric,</div>
<div><br>
</div>
<div>It is good to see a discussion of this topic. Some preliminary thoughts:</div>
<div><br>
</div>
<div>The journal-level peer review process involved in the SSHRC Aid to Scholarly Journals is a type of model I suggest others look at. The primary questions have nothing to do with metrics, but rather are qualitative, whether a high standard of review is met.
There likely are similar models elsewhere - I am sure that one needs to fit within the academic community to be part of Scielo, for example. Research to gather information on what people are doing would be helpful. Regional or discipline-based approaches would
make sense.</div>
<div><br>
</div>
<div>I question the need for a universal list, and for metrics-based approaches. Whether a contribution to our knowledge is sound and important and whether it has an immediate short-term impact are two completely separate questions. My perspective is that work
is needed on the impact of metrics-based approaches. </div>
<div><br>
</div>
<div>The important questions for scholars in any discipline should be "what to read" and "where to publish", not any metric, traditional or alternative. I think we scholars ourselves should take responsibility for the lists and recommending journals for indexing
rather than leaving such questions to the commercial sector.</div>
<div><br>
</div>
<div>Heather</div>
<div><br>
On Oct 3, 2015, at 11:25 AM, "Éric Archambault" <<a href="mailto:eric.archambault@science-metrix.com">eric.archambault@science-metrix.com</a>> wrote:<br>
<br>
</div>
<blockquote type="cite">
<div>
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi List<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi list<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">My previous efforts rapidly went off-topic, so I’m making a second effort to reload the questions to the list with the hope of receiving more input on this
important topic.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Back to our still largely unaddressed problem, I am re-inviting people to contribute ideas, focussing away from individuals.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">What is the best way to deal with the question of assessing the practices of publishers and journals (for subscription only, hybrid and open access journals)?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Should it be done through a negative list listing journals/publishers with deceptive practices?
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Should it be done through a positive list of best-practice journals?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Should it be done through an exhaustive list comprising all scholarly quality-reviewed journals (peer-review is somewhat restrictive as different fields have
different norms).<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Personally, I think the latter is the way to go. Firstly, there is currently no exhaustive list of reviewed scholarly journals. Though we sent astronauts to
the moon close to half a century ago, we are still largely navigating blind on evidence-based decision-making in science. No one can confidently say how many active journals there are the world over. We need an exhaustive list. Secondly, I think journals and
publishers should not be examined in a dichotomous manner; we need several criteria to assess their practice and the quality of what is being published.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">What metrics do we need to assess journal quality, and more specifically`:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-What metrics of scholarly impact should be used (that is, within the scholarly community impact – typically the proprietary Thomson Journal Impact Factor has
been the most widely used even though it was designed at the same time as we sent astronauts to the moon and has pretty much never been updated since -- full disclosure: Science-Metrix is a client of Thomson Reuters’s Web of Science raw data; competing indicators
include Elsevier’s SNIP and SCIMAGO’s SJR, both computed with Scopus data and available for free for a few years but with comparatively limited uptake -- full disclosure: Science-Metrix is a client of Elsevier’s Scopus raw data; note also that bibliometrics
practices such as CWTS, iFQ and Science-Metrix compute their own version of these journal impact indicators using WoS and/or Scopus data)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-What metrics of outreach should be used (e.g. use by the public, government, enterprises – typically these are covered by so-called “alternative metrics”)?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-What metrics of peer-review and quality-assessment effectiveness should be used?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-What other metrics would be relevant?
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Perhaps before addressing the above questions we should examine these two questions:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Why do we need such a list?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">What are the use cases for such a list?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">The following “how” questions are very important too:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-How should such a list be produced?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">-How will it be sustainable?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Finally the “who” question:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Who should be contributing the list?
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> -A Wikipedia-sort of crowdsourced list?
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> -Should only experts be allowed to contribute to the list? Librarians? Scholars? Anyone?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> -A properly funded not-for-profit entity?
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> -Corporate entities vying for a large market share?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thank you for your input,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Éric<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
</div>
</div>
</div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="FR-CA" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:FR-CA">Eric Archambault, Ph.D.<o:p></o:p></span></b></p>
<p class="MsoNormal"><span lang="FR-CA" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:FR-CA">President and CEO | Président-directeur général<o:p></o:p></span></p>
<p class="MsoNormal"><b><span lang="FR-CA" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#7F7F7F">Science-Metrix & 1science<o:p></o:p></span></b></p>
<p class="MsoNormal"><span lang="FR-CA" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:FR-CA">1335, Mont-Royal E<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="ES-MX" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:FR-CA">Montréal, QC H2J 1Y6</span><span lang="FR-CA" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:FR-CA">
- </span><span lang="ES-MX" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:FR-CA">Canada</span><span lang="FR-CA" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:FR-CA"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="FR-CA" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:FR-CA"> <o:p></o:p></span></p>
<p class="MsoNormal"><span lang="FR-CA" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:FR-CA">E-mail:
</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><a href="mailto:eric.archambault@science-metrix.com" title="mailto:eric.archambault@science-metrix.comblocked::mailto:eric.archambault@science-metrix.com"><span lang="ES-MX" style="color:#548DD4">eric.archambault@science-metrix.com</span></a></span><u><span lang="FR-CA" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#0066CC;mso-fareast-language:FR-CA"><o:p></o:p></span></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D;mso-fareast-language:FR-CA">Web: </span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><a href="http://www.science-metrix.com/"><span lang="FR-CA" style="color:#548DD4">science-metrix.com</span></a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">
</span><u><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#548DD4"><a href="http://1science.com">1science.com</a><o:p></o:p></span></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</blockquote>
<blockquote type="cite">
<div><span>_______________________________________________</span><br>
<span>GOAL mailing list</span><br>
<span><a href="mailto:GOAL@eprints.org">GOAL@eprints.org</a></span><br>
<span><a href="http://mailman.ecs.soton.ac.uk/mailman/listinfo/goal">http://mailman.ecs.soton.ac.uk/mailman/listinfo/goal</a></span><br>
</div>
</blockquote>
</body>
</html>