<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body>
<div style="padding-bottom: 10px; padding-top: 5px;">
<div style="padding:12px; border:1px solid #8D3970; background-color:#F7F9FA; color:#8D3970; font-size:14px; line-height:22px; font-family: Calibri, Arial, Helvetica, sans-serif;">
<strong>CAUTION:</strong> This e-mail originated outside the University of Southampton.
</div>
</div>
<div>
<div dir="ltr">Right it did not take long to refamiliarise myself. The following EPrints record has one file with a semicolon in the file name (";" for the avoidance of doubt). I can access the file on EPrints, but in Elements via Chrome and FireFox I get quite
similar errors.
<div><br>
</div>
<div><b>EPrints Record:</b> <a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Flivrepository.liverpool.ac.uk%2F3008387%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Ccb2b334d55844ae3646708d8d342edf8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637491631708036488%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=z%2BfqZ7377V6QdtMAZYL%2B7j%2BAnjx79yk5QZadPhwqXGE%3D&reserved=0" originalSrc="https://livrepository.liverpool.ac.uk/3008387/" shash="koun0Au8uci/QBHUvI9BQ1MwKi4+qso+pNWzUTS0icpKKiAE5A8MnXJiOR2J09Uf/T0Y+qdRu+hmMzNxVuDo++SY26wAzxFwhUt7sANcc++eSzpz6WXpFyd0WiI962PNy46CqzG5sTzfEDm6UraRjvaR6xtVCTXVlfLdC0pw3zU=">https://livrepository.liverpool.ac.uk/3008387/</a></div>
<div><b>File link/url:</b> <a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Flivrepository.liverpool.ac.uk%2F3008387%2F1%2FInduction%2520with%2520Thymoglobulin%2520in%2520High-Risk%2520Renal%2520Transplant%2520Patients%253B%2520Beauty%2520and%2520the%2520Beast.pdf&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Ccb2b334d55844ae3646708d8d342edf8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637491631708046447%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=bF5DtLQ856L8e8Ub6OEb4rWZm3a4u0Bjx1iKLKvuqyY%3D&reserved=0" originalSrc="https://livrepository.liverpool.ac.uk/3008387/1/Induction%20with%20Thymoglobulin%20in%20High-Risk%20Renal%20Transplant%20Patients%3B%20Beauty%20and%20the%20Beast.pdf" shash="kuf3ZjQy42Wvo+aGFzhMue/+OIzqFV19GyHI8dL5v92fVbmEIcmZl39sOcWjXHwBeWCDAXdJHqLQ4X+OdpWpQnIVGtGy4g2keL8PpTvHs3BPZBm1IVkCH9w7pvmRqTriEUcW7I/Doyhp8hD7Ke5TflzMwz29Ico8Llmv8QZqS+Y=">https://livrepository.liverpool.ac.uk/3008387/1/Induction%20with%20Thymoglobulin%20in%20High-Risk%20Renal%20Transplant%20Patients%3B%20Beauty%20and%20the%20Beast.pdf</a></div>
<div><br>
</div>
<div>In Elements when I go to the record and click the file icon I would expect it to download or open in the browser, instead I get an error:</div>
<div><br>
</div>
<blockquote style="margin:0 0 0 40px;border:none;padding:0px">
<blockquote style="margin:0 0 0 40px;border:none;padding:0px">
<div>The web page at <a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Felements.liverpool.ac.uk%2Frepository.html%3Fcom%3Dget-file%26publication-id%3D220114%26rfid%3Dhttps%253A%252F%252Flivrepository.liverpool.ac.uk%252Frt4eprints%252Ffile%252F106106%252FInduction%252520with%252520Thymoglobulin%252520in%252520High-Risk%252520Renal%252520Transplant%252520Patients%25253B%252520Beauty%252520and%252520the%252520Beast.pdf&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Ccb2b334d55844ae3646708d8d342edf8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637491631708046447%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=RxyqfmTTPnO6v%2B5ixia8YUtIIV%2FQA6dgfFT1T38TGyc%3D&reserved=0" originalSrc="https://elements.liverpool.ac.uk/repository.html?com=get-file&publication-id=220114&rfid=https%3A%2F%2Flivrepository.liverpool.ac.uk%2Frt4eprints%2Ffile%2F106106%2FInduction%2520with%2520Thymoglobulin%2520in%2520High-Risk%2520Renal%2520Transplant%2520Patients%253B%2520Beauty%2520and%2520the%2520Beast.pdf" shash="HiLrTk7rBZ1xa1bCIw3+fXGQvcZoOa+Na1s8mT/fkulArXoQW+fTNC69wliiGH1ZB2FavRzY9S96kvQrbUBqlY6FpIha0/OmemmG2S4sWQ7w+eskRP7PWoeML4am2zRmVcG9uyJFpnUksUFP9yPCJf5eV8ruhDQZV8ttPHNhh1w=">
https://elements.liverpool.ac.uk/repository.html?com=get-file&publication-id=220114&rfid=https%3A%2F%2Flivrepository.liverpool.ac.uk%2Frt4eprints%2Ffile%2F106106%2FInduction%2520with%2520Thymoglobulin%2520in%2520High-Risk%2520Renal%2520Transplant%2520Patients%253B%2520Beauty%2520and%2520the%2520Beast.pdf</a></div>
<div><br>
</div>
</blockquote>
</blockquote>
Going through this with another file on another record that has no ";" in the filename it works as expected.
<div><br>
</div>
<div>Looking at the links from both EPrints and Elements there's some sort of difference in the link to the file:</div>
<div><br>
</div>
<div><a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Flivrepository.liverpool.ac.uk%2F3008387%2F1%2FInduction%2520with%2520Thymoglobulin%2520in%2520High-Risk%2520Renal%2520Transplant%2520Patients%253B%2520Beauty%2520and%2520the%2520Beast.pdf&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Ccb2b334d55844ae3646708d8d342edf8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637491631708046447%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=bF5DtLQ856L8e8Ub6OEb4rWZm3a4u0Bjx1iKLKvuqyY%3D&reserved=0" originalSrc="https://livrepository.liverpool.ac.uk/3008387/1/Induction%20with%20Thymoglobulin%20in%20High-Risk%20Renal%20Transplant%20Patients%3B%20Beauty%20and%20the%20Beast.pdf" shash="kuf3ZjQy42Wvo+aGFzhMue/+OIzqFV19GyHI8dL5v92fVbmEIcmZl39sOcWjXHwBeWCDAXdJHqLQ4X+OdpWpQnIVGtGy4g2keL8PpTvHs3BPZBm1IVkCH9w7pvmRqTriEUcW7I/Doyhp8hD7Ke5TflzMwz29Ico8Llmv8QZqS+Y=">https://livrepository.liverpool.ac.uk/3008387/1/Induction%20with%20Thymoglobulin%20in%20High-Risk%20Renal%20Transplant%20Patients%3B%20Beauty%20and%20the%20Beast.pdf</a>
<div></div>
<div><br>
</div>
<div>https%3A%2F%<a href="https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2F2flivrepository.liverpool.ac.uk%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Ccb2b334d55844ae3646708d8d342edf8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637491631708056406%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=aHrMISX3a00TJAlUP9jip%2FWODhRhsz2kGt7MSwX0k%2FM%3D&reserved=0" originalSrc="http://2flivrepository.liverpool.ac.uk/" shash="wJoRcgvTsCsKuwxaYEBk2JzajNcQx9Mu0lLjiC2k9CvX999T4MRSzXX34/ArCJPsoX0MjGpDSPwLLA9iHjeg/bJoFZs/jYyO4duCccXMlk0QHqTyhCT4jXwh9O998Qx454XV7ew5MCjarkukDZ0FtlAV2bISWz1/WpArL0dMN3o=">2Flivrepository.liverpool.ac.uk</a>%2Frt4eprints%2Ffile%2F106106%2FInduction%2520with%2520Thymoglobulin%2520in%2520High-Risk%2520Renal%2520Transplant%2520Patients%253B%2520Beauty%2520and%2520the%2520Beast.pdf
</div>
</div>
<div><br>
</div>
<div>This is an example of what we get for a working record:</div>
<div><br>
</div>
<div>Eprints: <a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Flivrepository.liverpool.ac.uk%2F3115606%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Ccb2b334d55844ae3646708d8d342edf8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637491631708056406%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=3MIgdMo1nTNJ2lCJ9P94GmzMFKdf9ayhwo8sykQb7qQ%3D&reserved=0" originalSrc="https://livrepository.liverpool.ac.uk/3115606/" shash="BY+YuPd7/NQTI+HycJqWR9vGMUImewa94/iiLfbaFmke4qjLTfByYUaMYl8SXPDtg6aytpA+Q5PMsJp8/FgSIJLGb6pBiJzq2xQYTtHAA1qMAgDCxL2VYDKzLKdgzw0wrJkC8J30rv4P38tcr+TcxoeVNwBgN0TTqhHxtyZt93w=">https://livrepository.liverpool.ac.uk/3115606/</a></div>
<div>EPrints File Link:</div>
<div><a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Flivrepository.liverpool.ac.uk%2F3115606%2F1%2FLee%2520et%2520al%2520Erratum%25202021pdf.pdf&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Ccb2b334d55844ae3646708d8d342edf8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637491631708066347%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ymn9sajHrKb24SfmrdnHOBz2YHLbAYwmS6c49Lig4Q8%3D&reserved=0" originalSrc="https://livrepository.liverpool.ac.uk/3115606/1/Lee%20et%20al%20Erratum%202021pdf.pdf" shash="SC7hFIY1ML+aauurOM7LVxm3U10NHn+haN3+9AcY5Dru/YAi9pnS55jvjTKC/JI3SRmPgrH8OphgcULaZg6VC13aGBahDyAdIttWWO/Pa5IYwJbEa4LT5+9C52VfWs0maTwIxYbXjQwnf5o44fLu0mbqL/VQMuT+oElXQfzAqd0=">https://livrepository.liverpool.ac.uk/3115606/1/Lee%20et%20al%20Erratum%202021pdf.pdf</a><br>
</div>
<div>Elements File Link:</div>
<div><a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Felements.liverpool.ac.uk%2Frepository.html%3Fcom%3Dget-file%26publication-id%3D486086%26rfid%3Dhttps%253A%252F%252Flivrepository.liverpool.ac.uk%252Frt4eprints%252Ffile%252F371659%252FLee%252520et%252520al%252520Erratum%2525202021pdf.pdf&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Ccb2b334d55844ae3646708d8d342edf8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637491631708066347%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ae2mM%2BpgcZvrFYhXpLokSr5%2BbifDUO5sUsPV4gSL0oE%3D&reserved=0" originalSrc="https://elements.liverpool.ac.uk/repository.html?com=get-file&publication-id=486086&rfid=https%3A%2F%2Flivrepository.liverpool.ac.uk%2Frt4eprints%2Ffile%2F371659%2FLee%2520et%2520al%2520Erratum%25202021pdf.pdf" shash="wN1ZBzEbP3Nsw0d5lWJkTDLL0Axsxd7gr+g/hVmxK5XJocEJSo0eB6fFNSx23mTYBduzq+jcl3LNgGyk9lRl3ah3+H8KLyHyMM2EUKllNAyu48AfoGrm7zZDMJBQBtsM4Y1z8ZEcO+RXKytSnNJ0iqjzmzuydFYUtVozHKZzQ0I=">https://elements.liverpool.ac.uk/repository.html?com=get-file&publication-id=486086&rfid=https%3A%2F%2Flivrepository.liverpool.ac.uk%2Frt4eprints%2Ffile%2F371659%2FLee%2520et%2520al%2520Erratum%25202021pdf.pdf</a><br>
</div>
<div><br>
</div>
<div>The only consistent difference is the presence of these characters, but I can't really understand where it's going wrong. I had wanted to take a proper look at it and get in touch with Symplectic, but people have the audacity to keep finding new problems
and giving me more work... We are due to upgrade to RT2 soonish (2nd half of this year probably) and I am hoping all of this goes away with that.</div>
<div><br>
</div>
<div>Thanks,</div>
<div>James</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Wed, Feb 17, 2021 at 12:18 PM James Kerwin <<a href="mailto:jkerwin2101@gmail.com">jkerwin2101@gmail.com</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">Hi David,
<div><br>
</div>
<div>Thank you for your reply. Unfortunately I don't have access to the Elements database(s) but I've explained this issue to our Elements people and hopefully should get a response. Meanwhile, some time ago Mr Salter gave me the means to extract the Elements
xml and transform it via the crosswalks outside of EPrints, so I may do that with the different records and see what we get. Doing this has only just now occurred to me now so I'll give it a go.</div>
<div><br>
</div>
<div>On the subject of the character in question... The error code comes from (I think!):</div>
<div><br>
</div>
<div>eprints3/perl_lib/URI/Escape.pm</div>
<div><br>
</div>
<div>Specifically here in the _fail_hi sub:</div>
<div><br>
</div>
<blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px">
<blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px">
<div>
<blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px">
<div>"sub uri_escape {<br>
my($text, $patn) = @_;<br>
return undef unless defined $text;<br>
if (defined $patn){<br>
unless (exists $subst{$patn}) {<br>
# Because we can't compile the regex we fake it with a cached sub<br>
(my $tmp = $patn) =~ s,/,\\/,g;<br>
eval "\$subst{\$patn} = sub {\$_[0] =~ s/([$tmp])/\$escapes{\$1} || _fail_hi(\$1)/ge; }";<br>
Carp::croak("uri_escape: $@") if $@;<br>
}<br>
&{$subst{$patn}}($text);<br>
} else {<br>
$text =~ s/($Unsafe{RFC3986})/$escapes{$1} || _fail_hi($1)/ge;<br>
}<br>
$text;<br>
}<br>
<br>
sub _fail_hi {<br>
my $chr = shift;<br>
Carp::croak(sprintf "Can't escape \\x{%04X}, try uri_escape_utf8() instead", ord($chr));"<br>
</div>
<div><br>
</div>
</blockquote>
</div>
</blockquote>
</blockquote>
<div>The FULL error log line says:</div>
<div><br>
</div>
<blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px">
<blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px">
<blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px">
<div>Can't escape \\x{2019}, try uri_escape_utf8() instead at /opt/eprints3/perl_lib/URI/Escape.pm line 178.\n\tURI::Escape::_fail_hi('\xe2\x80\x99') called at /opt/eprints3/perl_lib/URI/Escape.pm line 171\n\tURI::Escape::uri_escape('Published by the American
Physical Society under the terms of...') called at (eval 177) line 82\n\tEPrints::Config::uolrepo::__ANON__('dataset', 'EPrints::DataSet=HASH(0x7f21238f9358)', 'repository', 'Symplectic::Wrappers::EPrintsSession=HASH(0x7f2124610710)', 'dataobj', 'EPrints::DataObj::EPrint=HASH(0x7f21285879b0)',
'changed', 'HASH(0x7f212d684f18)') called at /opt/eprints3/perl_lib/EPrints/DataSet.pm line 1517\n\tEPrints::DataSet::run_trigger('EPrints::DataSet=HASH(0x7f21238f9358)', 105, 'dataobj', 'EPrints::DataObj::EPrint=HASH(0x7f21285879b0)', 'changed', 'HASH(0x7f212d684f18)')
called at /opt/eprints3/perl_lib/EPrints/DataObj.pm line 669\n\tEPrints::DataObj::commit('EPrints::DataObj::EPrint=HASH(0x7f21285879b0)', undef) called at /opt/eprints3/perl_lib/EPrints/DataObj/EPrint.pm line 1011\n\tEPrints::DataObj::EPrint::commit('EPrints::DataObj::EPrint=HASH(0x7f21285879b0)')
called at /opt/eprints3/perl_lib/Symplectic/RepoProcess/MetadataManager.pm line 355\n\tSymplectic::RepoProcess::MetadataManager::add_preferred_bibliographic('Symplectic::RepoProcess::MetadataManager=HASH(0x7f2123858468)', 'eprint', 'EPrints::DataObj::EPrint=HASH(0x7f21285879b0)',
'raw_record', 'XML::LibXML::Document=SCALAR(0x7f212858bb60)', 'types', 'ARRAY(0x7f21254315a0)', 'limit_to', 'ARRAY(0x7f21215fceb8)', ...) called at /opt/eprints3/perl_lib/Symplectic/RepoProcess/MetadataManager.pm line 240\n\tSymplectic::RepoProcess::MetadataManager::add_bibliographic('Symplectic::RepoProcess::MetadataManager=HASH(0x7f2123858468)',
'eprint', 'EPrints::DataObj::EPrint=HASH(0x7f21285879b0)', 'publication', 'Symplectic::PubsModel::Publication=HASH(0x7f212d6b7fe8)') called at /opt/eprints3/perl_lib/Symplectic/RepoProcess/IngestWorkflow.pm line 203\n\tSymplectic::RepoProcess::IngestWorkflow::update_metadata('Symplectic::RepoProcess::IngestWorkflow=HASH(0x7f212858f348)',
'eprint', 'EPrints::DataObj::EPrint=HASH(0x7f21285879b0)', 'publication', 'Symplectic::PubsModel::Publication=HASH(0x7f212d6b7fe8)', 'auth_details', 'Symplectic::PubsModel::AuthDetails=HASH(0x7f212d785c38)', 'record', 'Symplectic::RepoModel::PublicationsRecord=HASH(0x7f212c73f510)',
...) called at /opt/eprints3/perl_lib/Symplectic/RepoProcess/PublicationManager.pm line 65\n\tSymplectic::RepoProcess::PublicationManager::get_deposit_representation('Symplectic::RepoProcess::PublicationManager=HASH(0x7f212d7ac290)', 'publication', 'Symplectic::PubsModel::Publication=HASH(0x7f212d6b7fe8)',
'auth_details', 'Symplectic::PubsModel::AuthDetails=HASH(0x7f212d785c38)') called at /opt/eprints3/perl_lib/Symplectic/Process/FileDepositProcessor.pm line 148\n\tSymplectic::Process::FileDepositProcessor::handle('Symplectic::Process::FileDepositProcessor=HASH(0x7f212d6d73b0)',
'pid', 485375, 'auth_details', 'Symplectic::PubsModel::AuthDetails=HASH(0x7f212d785c38)', 'deposit_props', 'Symplectic::PubsModel::DepositProperties=HASH(0x7f212e8a0440)', 'atom', 'CGI::File::Temp=GLOB(0x7f212d7fae08)', ...) called at /opt/eprints3/perl_lib/Symplectic/Handlers/RepositoryHandler.pm
line 235\n\tSymplectic::Handlers::RepositoryHandler::post_handler('session', 'Symplectic::Wrappers::EPrintsSession=HASH(0x7f2124610710)', 'request', 'Apache2::RequestRec=SCALAR(0x7f212e8a77a8)', 'auth_details', 'Symplectic::PubsModel::AuthDetails=HASH(0x7f212d785c38)')
called at /opt/eprints3/perl_lib/Symplectic/Handlers/RepositoryHandler.pm line 109\n\tSymplectic::Handlers::RepositoryHandler::handler_multi('Apache2::RequestRec=SCALAR(0x7f212e8a77a8)', undef) called at /opt/eprints3/perl_lib/Symplectic/Apache/Rewrite.pm
line 98\n\tSymplectic::Apache::Rewrite::__ANON__('Apache2::RequestRec=SCALAR(0x7f212e8a77a8)') called at -e line 0\n\teval {...} called at -e line 0\n</div>
</blockquote>
</blockquote>
</blockquote>
<div><br>
</div>
<div>I'm making some big assumptions, but I THINK the "\\x{%04X}" is saying "take 4 characters from the result of ord($chr) and put them here". I'm possibly very wrong. I think any solution for this needs to belong in the Symplectic code on the repo server.
I don't fancy altering core EPrints code for the sake of this. I'll be in a whole world of hell before I know it. Yesterday when tracing this I ended up at:</div>
<div><br>
</div>
<div>eprints3/symplectic/perl_lib/Symplectic/RepoProcess/MetadataManager.pm</div>
<div><br>
</div>
<div>Reading through the code it appears to identify the preferred record and start processing it. Perhaps this is a good opportunity to intervene and either swap bad characters for good ones or encode/decode "properly" (as if I know what I'm talking about).
Complicated slightly by not being able to thoroughly test it. I suppose another option would be to see what XSLT etc. can do with regard to this and so catch the problem within the crosswalks.</div>
<div><br>
</div>
<div>If we verify the manual record in Elements it gets a higher precedence than the Scopus record and so the problem disappears.</div>
<div><br>
</div>
<div>Regarding the other problem with the file link I will need to refamiliarise myself with it and I'll reply later. Plus this email is already wordy enough as it is!</div>
<div><br>
</div>
<div>Thanks,</div>
<div>James</div>
<div><br>
</div>
<div><br>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Wed, Feb 17, 2021 at 10:31 AM David R Newman <<a href="mailto:drn@ecs.soton.ac.uk" target="_blank">drn@ecs.soton.ac.uk</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<p>Hi James,</p>
<p>I think you would need to look at this field in the Elements record in its database to look how it is being stored differently when there is an import compared to where there is manual entry. As you said I think the problem is in part that text box entries
get parsed and encoded before going into the database but imports do not (or at very least the process between input and output to the Elements database is different). It would be useful to know how they look different in the Elements database as they may
assist making EPrints more resilient to unexpected encodings in future. <br>
</p>
<p>However "\\x{2019}" looks like an escaped version of something that is not particularly valid. If this was "\\u{2019}" this would probably work better as \x I think can only be used to represent a standard ASCII character that can be only two hex digits
like \x3a is a colon ":". \u is used for the extended character set (i.e. UTF-16). \u{2019} in UTF-8 would be \xE2\x80\x99.<br>
</p>
<p>It would be interesting to get a bit more information about your other issue with regular quote marks and semi-colons that are part of the standard ASCII set rather than an extended characters. These really should not be causing a problem.</p>
<p>Regards</p>
<p>David Newman<br>
</p>
<div>On 17/02/2021 09:44, James Kerwin via Eprints-tech wrote:<br>
</div>
<blockquote type="cite">
<div style="padding-bottom:10px;padding-top:5px">
<div style="padding:12px;border:1px solid rgb(141,57,112);background-color:rgb(247,249,250);color:rgb(141,57,112);font-size:14px;line-height:22px;font-family:Calibri,Arial,Helvetica,sans-serif">
<strong>CAUTION:</strong> This e-mail originated outside the University of Southampton.
</div>
</div>
<div>
<div dir="ltr">Hi All,<br>
<div><br>
</div>
<div>This is an Elements/EPrints question. Apologies that it isn't purely EPrints, but this is probably the best place to get an answer. I want to know if others experience this or it's some oddity to our setup.</div>
<div><br>
</div>
<div>We are using RT1 (for now) and EPrints 3.3.14 (also for now until upgrade). Occasionally we get an Elements record that is from Scopus, PubMed etc. that has an odd character in it that prevents upload. When I look in the Apache logs it tells me the problem.
Yesterday's one was the presence of:<br>
<br>
"Unicode Character “’” (U+2019)" <br>
<br>
Which showed in the logs as:<br>
<br>
"Can't escape \\x{2019}, try uri_escape_utf8() instead at /opt/eprints3/perl_lib/URI/Escape.pm"<br>
<br>
Importantly if I copy the problem characters to the manual elements record it doesn't pose a problem. There appears some processing to properly encode characters entered via text box, but not characters dragged in from other sources into Elements.<br>
<br>
I've also had the issue with the files containing "'" or" ";" etc not being accessible via Elements (a very similar, but different problem).<br>
<br>
I found where I COULD fix the former issue, but it involves changing EPrints code when I SHOULD be altering the Symplectic connector code on the repo server.<br>
<br>
Anyway, I'm not specifically looking for a solution, but has anybody else experienced anything similar? If so, does it stop with RT2? I hope to raise a ticket with Symplectic over this eventually.</div>
<div><br>
</div>
<div>Thanks,</div>
<div>James<br>
<br>
<br>
</div>
</div>
</div>
<br>
<fieldset></fieldset>
<pre>*** Options: <a href="http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech" target="_blank">http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech</a>
*** Archive: <a href="https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Ccb2b334d55844ae3646708d8d342edf8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637491631708066347%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=OnDInoQcv5qbHaOdeVIDw2IP77PVYaKjiDxzeAsbgAU%3D&reserved=0" originalSrc="http://www.eprints.org/tech.php/" shash="hq6jiC+UCbXfrOmz9X2A0SW8Eh97yqtaT4tRLWf/HE4dERIJSzcPVM2Q1kBIvvISedsD9ES72zWRtfQpcP1aJ3VP/17XPnaVP7ktP+rP+Ztf2PEIoxntHVI4HcMsT1r5eW6OrGe2KEOhC287QITaGbnuO0Q4fPJd8+StYOt3qJ8=" target="_blank">http://www.eprints.org/tech.php/</a>
*** EPrints community wiki: <a href="https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Ccb2b334d55844ae3646708d8d342edf8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637491631708076308%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=AD4zbIOfzok6fatfQUU8T%2BHYjrnr1V9VZcRI5cyDhr0%3D&reserved=0" originalSrc="http://wiki.eprints.org/" shash="tlXa2fi6MGCfUMHSO5LKaP7Xwsu5jcR1kJTINAZhnX1NZw0tJMItWoSu7GCk1oThp1QHzhqZqd/seZubsS64t0Eiei5qRYRDF9LTEPt2qhJho1zCRA/TREB4MEzA5ByuHl5GCtXpdlnuDTQuHZ0f5IPX5zQOMJs33CZtlLxoeTQ=" target="_blank">http://wiki.eprints.org/</a></pre>
</blockquote>
<div id="gmail-m_8232395957973897161gmail-m_8377127222243325055DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2">
<br>
<table style="border-top:1px solid rgb(211,212,222)">
<tbody>
<tr>
<td style="width:55px;padding-top:13px"><a href="https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.avg.com%2Femail-signature%3Futm_medium%3Demail%26utm_source%3Dlink%26utm_campaign%3Dsig-email%26utm_content%3Demailclient&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Ccb2b334d55844ae3646708d8d342edf8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637491631708076308%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=PCwmvJRXB3Bnm7zBXOTa6OwlouSWMsxJOT0VbEfVds4%3D&reserved=0" originalSrc="http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient" shash="nSgp40TXTLeQMXq4dCSQZVZHqv3GYWa1zF6fj/1beqKWcSdpKcB4sc2sVdb85y9u2THhHX4MKDAjvrHEM1H3wPvYdV1mWVVMIyuzEsBk8gBxUPtBb2OQHRTWuOC6aB6YeHHAY3rsOV31VRsZv9bO9sG9aTAMMajdUTQtePF/4KE=" target="_blank"><img src="https://ipmcdn.avast.com/images/icons/icon-envelope-tick-green-avg-v1.png" alt="" width="46" height="29" style="width: 46px; height: 29px;"></a></td>
<td style="width:470px;padding-top:12px;color:rgb(65,66,78);font-size:13px;font-family:Arial,Helvetica,sans-serif;line-height:18px">
Virus-free. <a href="https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.avg.com%2Femail-signature%3Futm_medium%3Demail%26utm_source%3Dlink%26utm_campaign%3Dsig-email%26utm_content%3Demailclient&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Ccb2b334d55844ae3646708d8d342edf8%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637491631708086270%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=IfTAcPF3Phk%2FPSoMg4vMtkhPhD%2FG%2FTYE3ruusScaCBE%3D&reserved=0" originalSrc="http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient" shash="ND1gJMQy4em7v+F1Amk2xvRQ11P/TioWkyHk+WVzZFiv78e8dRCfOMK61UfbmfrkTVIQHCITrVxmde++Miyc+9Os/b2qEZdBUVfLDodeoC/YXFFIrAmkZoFsjMGdWe/sIshiYIb2n49GnZCNNpyiAoM+ef6I3aX+tRjwNiZlLTw=" style="color:rgb(68,83,234)" target="_blank">
www.avg.com</a> </td>
</tr>
</tbody>
</table>
<a href="#m_8232395957973897161_m_8377127222243325055_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2" width="1" height="1"></a></div>
</div>
</blockquote>
</div>
</blockquote>
</div>
</div>
</body>
</html>