<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-GB" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Hi Hugo,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">What is the very top line of the bin/oai/harvest function?
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">I’d expect to see something like<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">#!/usr/bin/perl -w -I/opt/eprints3/perl_lib<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Which tells the perl interpreter where to look for stuff – the bit after the –I might be wrong for your installation which looks like
it’s in /data/eprints ?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">It may well not solve the main error, but it should save you having to do the ‘Export’ command first.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Alan<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> eprints-tech-bounces@ecs.soton.ac.uk [mailto:eprints-tech-bounces@ecs.soton.ac.uk]
<b>On Behalf Of </b>Hugo F. Alrøe via Eprints-tech<br>
<b>Sent:</b> 28 January 2019 12:28<br>
<b>To:</b> eprints-tech@ecs.soton.ac.uk<br>
<b>Subject:</b> [EP-tech] help on running OAI Harvester 1.04 in eprints 3.3.16 on Ubuntu 17.10<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Hi all,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">We are trying to develop a method of harvesting a couple of other open archives into the Organic Eprints archive, using the OAI Harvester 1.04 package from <a href="https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffiles.eprints.org%2F798%2F&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfd95111b019e42477d5c08d6852781b7%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&sdata=fLbfskfqvDcMTe%2BHlsAuAIwMwpwh3yrFUGQsLjcp%2BQ8%3D&reserved=0" originalSrc="http://files.eprints.org/798/" shash="J5MHjNE9wTqbHxkIHYgJSrzhXNegr40WssANxL8lpxNJX8RUvt/LVvbF4VL+MMoq33FbqEQjePRjVf94EMpv9CBmC0mfw38oPimd1f49HE15ExDgnBPBN9GwRb1K01uh5seUrOy+y7/WnuFRz/y1Z4NPFgH3HwzwhT+xq3/an/k=">http://files.eprints.org/798/</a> .
I am working on a development server running eprints 3.3.16 on Ubuntu 17.10. At first, I try to harvest from the live Organic Eprints archive, since this has a working oai interface (at
<a href="https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Forgprints.org%2Fcgi%2Foai2&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfd95111b019e42477d5c08d6852781b7%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&sdata=AMFaMvHCagWwG5IGhLZhJRSQWP5jBwVG1uDuo3V90Qg%3D&reserved=0" originalSrc="http://orgprints.org/cgi/oai2" shash="XK+f4uFcibY79E5iQa9RuopzQLnguwqL9GktYGHZXiwKxt4iUgOo7dMlZXPvCWe/ifcZflUa1e9Z+DZTQwFJO6AqoXDc2CtTTI9kYmATis/RKSbrqBrKV94oPKb8vz9FBp82w0a8XNfdEqYUx8DK5Ugb4N0ERS/qMgjfriZG5dA=">
http://orgprints.org/cgi/oai2</a> ).<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I am now able to run the harvest script, but I get the error: <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Can't locate object method "is_error" via package "HTTP::OAI::Record" at /data/eprints/archives/orgprints/cfg/plugins/EPrints/Plugin/Import/OAIPMH.pm line 232, <DATA> line 717.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I have tried to locate the error, but without luck so far, so it would be great if you could give me some indications as to where the error might be located. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Here is some more detailed information that might be of help:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">To avoid a "Can't locate EPrints.pm in @INC" error, I run: <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">> export PERL5LIB=/data/eprints/perl_lib<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">before running the harvest command.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I run the script with the command:<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">> bin/oai/harvest orgprints --plugin=OAIPMH::OAI_DC --conf=orgprints<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I get past the interactive dialogue:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Are you sure you want to make bulk changes to the eprint table in the orgprints repository [yes/no]<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">? yes<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">But then I get the error:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Can't locate object method "is_error" via package "HTTP::OAI::Record" at /data/eprints/archives/orgprints/cfg/plugins/EPrints/Plugin/Import/OAIPMH.pm line 232, <DATA> line 717.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Line 232 is in the sub create_eprint section, and line 229 contains "is error", but I am not able to see whether the error has to do with the creation of new eprints records or whether it comes from something earlier in the process. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I have tried inserting some statements to print variables in the OAIPMH.pm file, and the script reads the relevant configuration options (at least I have tried printing from and metadataPrefix), and it seems to retrieve at least an OAI
identifier before it fails (I can print "$id" around line 113 in OAIPMH.pm and get "oai:<a href="https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Forgprints.org%3A34351&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfd95111b019e42477d5c08d6852781b7%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&sdata=REbNsbe3fXsllYV7tPbbryF9IdeUJ%2BweU1Niyffa6%2FI%3D&reserved=0" originalSrc="http://orgprints.org:34351" shash="XF9WmdfPPlQypNVvQ1elUC/hP6TfpEEz96UIvOFgSPUt+SG4vJbXYRUXu80I1zHF9YOYXbMHu+58zW34YEVlaRQiOxjzQbe9wlXzPR+tv0WmZ6shHInH7AVg5YeN56ym8NGSDRBvnju98g4a55B27DK6Scv0P83fB9a8ZuEIjIM=">orgprints.org:34351</a>"
before the error, which is a correct eprint id for the date). I can also see that the script gets past the get_eprint line (by printing some text after line 115 - my $eprint = $self->get_eprint( $id ); ), so I guess it retrieves an EPrint object as well. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">The script has some lines that seems to write to an error log, but I cannot find such a log in either of the usual var directories. The apache error log and the orgprints log do not have any information relevant to the harvest script.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">The configuration so far is very simple. I have copied the relevant "Stub OAI Harvesting" section from
<a href="https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foai_harvester.pl&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfd95111b019e42477d5c08d6852781b7%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&sdata=U0zXwHAPuc9q94cUZT9PubL0jEIcOAxdT0mwJ8Me1T4%3D&reserved=0" originalSrc="http://oai_harvester.pl" shash="Hfwwpyx4jjDvgSk55DBOzCMkxGlokEiPxrIma3LMpcFvNMibf4ADXVJ0JejjxdeXGKk9On1m29kbZ66E30I1WyTCITToksDx7vFtoDfIY91c2yE9EmwJAJT1t03jIwOx0Txrh4N7c+ZFhgg3ZtG3EEHOL11aPnNTQbw0LluDrpY=">
oai_harvester.pl</a> to a new configuration file <a href="https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fz_oai_harvester_orgprints.pl&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfd95111b019e42477d5c08d6852781b7%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&sdata=A65T%2FCsv3dVY5St2qIWjsdh4hLVLML1JOmYFmNZ%2F0cw%3D&reserved=0" originalSrc="http://z_oai_harvester_orgprints.pl" shash="p24YWzv0gyOJn9sGjIr81aoRz41xB0z2G86TDd6y4wJi4hgEhXOj4bM2Udl2P4gVDF+uoeE4Fb4xgLNBCZ+1EFiR9uhSju2sT8D6fxz/mDtXvrK3v9X8nqDpgexYaF4IsNN8HaviQJeOqSPDDH2gE3UHzV9ygI7xRb3IJrkUCtg=">
z_oai_harvester_orgprints.pl</a> as shown below. I have also tried uncommenting the metadataPrefix and the default_values part to set a userid, and to make a user with this id in the development archive, but this does not make any difference with regard to
the error.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<div>
<p class="MsoNormal">$c->{oai_harvester}->{orgprints} = {<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> url => '<a href="https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Forgprints.org%2Fcgi%2Foai2&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfd95111b019e42477d5c08d6852781b7%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&sdata=AMFaMvHCagWwG5IGhLZhJRSQWP5jBwVG1uDuo3V90Qg%3D&reserved=0" originalSrc="http://orgprints.org/cgi/oai2" shash="XK+f4uFcibY79E5iQa9RuopzQLnguwqL9GktYGHZXiwKxt4iUgOo7dMlZXPvCWe/ifcZflUa1e9Z+DZTQwFJO6AqoXDc2CtTTI9kYmATis/RKSbrqBrKV94oPKb8vz9FBp82w0a8XNfdEqYUx8DK5Ugb4N0ERS/qMgjfriZG5dA=">http://orgprints.org/cgi/oai2</a>',
# compulsory<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"># set => 'test_set', # optional<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> from => '2019-01-26', # optional, format is YYYY-MM-DD<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"># 'until' => '2019-01-27', # optional<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"># metadataPrefix => 'oai_dc', # optional, should be set by the OAIPMH/* plugin<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"># default_values => sub { # optional, gives a chance to set default values<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"># my( $session, $epdata, $header ) = @_;<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">#<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"># $epdata->{userid} = 'oai_harvester';<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"># $epdata->{eprint_status} = 'buffer';<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">#<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"># # $epdata->{FIELDNAME} = VALUE;<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"># <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"># },<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">};<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I hope that you can help me move on. My perl skills are quite basic, but I can usually find my way around modifying files.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Best regards<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Hugo<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">-- <o:p></o:p></p>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">Hugo F. Alrøe , PhD, Lead researcher <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">Sciper research, consulting and writing<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">Email: <a href="mailto:hugo.f.alroe@gmail.com" target="_blank">
hugo.f.alroe@gmail.com</a><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">Web: <a href="https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fhugo.alroe.dk&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfd95111b019e42477d5c08d6852781b7%7C4a5378f929f44d3ebe89669d03ada9d8%7C1&sdata=ah0EnyjMyLHeljJNhDjV10Gx75j7Mnpbh0OhMCEr1%2Bw%3D&reserved=0" originalSrc="http://hugo.alroe.dk" shash="dbyR+yiCOee2mV82AouLQggZM7yRUs16H1ZOiCgsD8YJXb6ThUwcRjV+MMCq6q4JvTxn1Utd0lzmpHN34OIKeimseWGAgGWKWlCcX3MUOAEU1RLuYHXeqDLNfTCRbOzGOSiyvtW2yeNCH4uvCSWFK8UV8HRCovyXmAE1mOWi2zk=" target="_blank">hugo.alroe.dk</a><o:p></o:p></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
-- The Open University is incorporated by Royal Charter (RC 000391), an exempt charity in England & Wales and a charity registered in Scotland (SC 038302). The Open University is authorised and regulated by the Financial Conduct Authority in relation to its
secondary activity of credit broking.
</body>
</html>