<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Hi David,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Absolutely! This wasn't really meant to be production ready and just a quick experiment. There are multiple ways to do this, you could for instance do some sort of AJAX call and show the results as suggested keywords, or as you say add them via the event queue.
One thing I would probably want to do before putting it in production would be to have some way of monitoring the number of Azure API calls that had been made as, like many services in the cloud, the price you pay depends on how much you use it. I'd probably
want to abstract the service used as well so that people can use their favoured provider (if they have equivalent services).</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Thanks</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Liam<br>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> David R Newman <drn@ecs.soton.ac.uk><br>
<b>Sent:</b> 29 June 2020 10:05<br>
<b>To:</b> eprints-tech@ecs.soton.ac.uk <eprints-tech@ecs.soton.ac.uk>; Liam Green-Hughes <L.E.Green-Hughes@kent.ac.uk><br>
<b>Subject:</b> Re: [EP-tech] Experimental integration with MS Azure Cognitive Services</font>
<div> </div>
</div>
<div>
<p>One thing I forgot to mention was that this call is probably better as an event queue task rather than a before commit trigger. As if you are relying on a third-party application you don't want to be waiting on this before the page can reload. If you are
only send the abstract that is probably going to be fairly rapid. However, sometimes abstracts can be rather long and I can imagine the service being less responsive at times. So you may wait a while before you get a response back, so you can reload the page.
Obviously the disadvantage of having an event queue task is that you will end up with two revisions rather than one. However, your code at the moment suggests this service will only be called once, as once there are keywords it cannot be run again.
<br>
</p>
<p><br>
</p>
<p>Just another thought: If you were to change this so keywords could be updated, obviously you would want to check to see the fields that were being sent for keywords analysis had changed and only call this service if they had. You would also need some code
to parse the current and returned keywords to merge them together.<br>
</p>
<p><br>
</p>
<div class="x_moz-cite-prefix">On 29/06/2020 09:54, David R Newman via Eprints-tech wrote:<br>
</div>
<blockquote type="cite">
<p>Hi Liam,</p>
<p><br>
</p>
<p>Looks interesting. I have been working on improving search on keywords within EPrints by introducing a new Keywords MetaField type that is backwards with the Longtext MetaField that is currently the type with the keywords field. I have also introduced
a Idci (short for ID Case Insentive) field that could be used for keywords when set to be a multiple field. Hopefully, I will be able to make the official release of 3.4.2 that includes these available this week.</p>
<p><br>
</p>
<p>Regards</p>
<p><br>
</p>
<p>David Newman<br>
</p>
<p><br>
</p>
<div class="x_moz-cite-prefix">On 29/06/2020 09:44, Liam Green-Hughes via Eprints-tech wrote:<br>
</div>
<blockquote type="cite"><style type="text/css" style="display:none">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Hi everyone,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
I've been experimenting with integrating EPrints with an off the shelf AI solution to generate keywords. The service I used was the Text Analytics service element of the Microsoft Azure Text Analytics. I've only gone as far as experimenting with the Key Phrases
endpoint so far, but the Named Entities endpoint looks like it could add real value to EPrints records too.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
The integration file is here: <a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fliamgh%2Feprints-ai-expt%2Fblob%2Fmaster%2Fz_azure_keywords.pl&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cb348485790f5492be36008d81c0cb9db%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&sdata=7qG8J3VoMQqbQ%2FRW2PC8JGsDZ5%2FmgLXQIn96lv2qvJk%3D&reserved=0" originalSrc="https://github.com/liamgh/eprints-ai-expt/blob/master/z_azure_keywords.pl" shash="Z/qcOScXfHZ1upEr/vPn1dUPV9H1Omiy+GwDR9HjPQ0pXAqx8Nt3Sw7FIVKeemaefEiCaq4kLu9j7Q1oNVKQViY0i7vQ2wA91EVy1GgCSqOAknXFwqczjeQBcrMPI8bVRZOGEkrg5BKkrkpFz9PrFChLrTFllwj/y3iVkvCQOWA=" originalsrc="https://github.com/liamgh/eprints-ai-expt/blob/master/z_azure_keywords.pl" shash="sB2cZMiaPWHq8v3n0xgKzNXRmpAtc/Uw8tw2+mopHMfymS7wGsvcpWWdKjYw/Yr/ZWwh2jZEbI3Mq5tFLqeoZt7phcfDj6Or1jTuhQ9xo2WqjuN6zDj5L+hE08PObwveXfRKMTE+7+wMO+TxmEYNqt1M8Eayi3V75iBn/Xbxq2A=" id="LPlnk768568">
https://github.com/liamgh/eprints-ai-expt/blob/master/z_azure_keywords.pl</a>. It isn't really production ready, but it is a starting point.<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Let me know your thoughts! <br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Thanks</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Liam<br>
</div>
<br>
<fieldset class="x_mimeAttachmentHeader"></fieldset>
<pre class="x_moz-quote-pre">*** Options: <a class="x_moz-txt-link-freetext" href="http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech">http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech</a>
*** Archive: <a class="x_moz-txt-link-freetext" href="https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cb348485790f5492be36008d81c0cb9db%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&sdata=8jXZaMZARN6EA3H7ZdXi2t0DzZ2XfvP89wszOv8Gn%2BQ%3D&reserved=0" originalSrc="http://www.eprints.org/tech.php/" shash="PDTXbPsy++LmxwsGMQ5Xgmjebdlfuvnde+3SLFu136g+RRIuamkvDgAtuSOqaqfEeuZjPT7UDo+wRKe4I2bPBBinDcQQRv/dVkAceiEUFoPYzrEnvGL79jhtDseHE1E9ei4x5L2Wlj5T8TPLv5K0lpn9DPS9vo28vdI12jthcFQ=" originalsrc="http://www.eprints.org/tech.php/" shash="z36O3bJQV6tdn0EY/HDPAgAZs017VRt2xNehyHi+ng0LTDQQPaFh01KuVdg4Z3FNhWKmvVv46I0AGQQ5qV1nFf8nX8ibdDzOO/yY6UogQrmfBbXzWnQT3QM17aaNkT3SfnZbL8uZ9iHnctV/Q0Eq5gQPcj0Vx8t+UaMXebMwXKY=">http://www.eprints.org/tech.php/</a>
*** EPrints community wiki: <a class="x_moz-txt-link-freetext" href="https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cb348485790f5492be36008d81c0cb9db%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&sdata=e4BrQ0VHL4o8ar%2BuqZHXkXTLMWDmmHBC6GVcqA61RiE%3D&reserved=0" originalSrc="http://wiki.eprints.org/" shash="a0vzghWr/xU0tyDLevGfF1qEB1475JUR5XYu+5hg0W5LOF/KjuRipQU0icYV3hk6t9Z4f7DAT5fkHCvAJOB71Kja77tj7IVV/chzu76QdgVbgd39MlofRIHKjQsG7YvtQBwT8u4rdKX55WhKHtacvHTQv9Q20AqzxYsEaifmfrk=" originalsrc="http://wiki.eprints.org/" shash="kEcMcBkriHlQDsWaQ8kZsPWIXDTyCTH/yzm6/APOmk4AeQUXvBUT660mXO3m1HG0IEHCMJ+d+0LTooqGe2eVy9m9jjJE+EmCWoKDBPEY3caw+WhHXKW0SinAvKiXqifVYZRPSEeyhXVx6eTBZWp6XpZZdN5iO3UPLwhVSSAgZuE=">http://wiki.eprints.org/</a></pre>
</blockquote>
<div id="x_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2"><br>
<table style="border-top:1px solid #D3D4DE">
<tbody>
<tr>
<td style="width:55px; padding-top:13px"><a href="https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.avg.com%2Femail-signature%3Futm_medium%3Demail%26utm_source%3Dlink%26utm_campaign%3Dsig-email%26utm_content%3Demailclient&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cb348485790f5492be36008d81c0cb9db%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&sdata=bpc77TKRqoLmWl4NrKcqytT51hbc8c2DqSSF1PL9P2c%3D&reserved=0" originalSrc="http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient" shash="rZyrCduDOW7+NwHhfTyPOj21t5tS01GMLUXHeU9IzbBscsJtO5vfpWH2OTkOh/oKBELYsEjdUsPPx93wyEhjDtSlXcnlH3AR46QQeSIxcc1C5U57TpYy3lD0wS7swSZvIPsJJF/MM5pyBkCB8SNRc4RBXtqZ435eGCa1FQbqgYQ=" originalsrc="http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient" shash="JT5Gp/DVvh/ZO8DPsizMR7gqVRK7HHr/uUHrO0sL0QkcP8BkFpr9WWVbpZb49ceerqthMWfqc//aTpSxfAowv2QNzG5Fjb3lCmbEPspF3Q+iv+130DXkESLxRvXnJ+qj1+ZccdWfeyH1da+bS8qTqUGcsWPK0B9zQ2cVYLcBu7c=" target="_blank"><img alt="" width="46" height="29" style="width:46px; height:29px" src="https://ipmcdn.avast.com/images/icons/icon-envelope-tick-green-avg-v1.png"></a></td>
<td style="width:470px; padding-top:12px; color:#41424e; font-size:13px; font-family:Arial,Helvetica,sans-serif; line-height:18px">
Virus-free. <a href="https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.avg.com%2Femail-signature%3Futm_medium%3Demail%26utm_source%3Dlink%26utm_campaign%3Dsig-email%26utm_content%3Demailclient&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cb348485790f5492be36008d81c0cb9db%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&sdata=bpc77TKRqoLmWl4NrKcqytT51hbc8c2DqSSF1PL9P2c%3D&reserved=0" originalSrc="http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient" shash="rZyrCduDOW7+NwHhfTyPOj21t5tS01GMLUXHeU9IzbBscsJtO5vfpWH2OTkOh/oKBELYsEjdUsPPx93wyEhjDtSlXcnlH3AR46QQeSIxcc1C5U57TpYy3lD0wS7swSZvIPsJJF/MM5pyBkCB8SNRc4RBXtqZ435eGCa1FQbqgYQ=" originalsrc="http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient" shash="JT5Gp/DVvh/ZO8DPsizMR7gqVRK7HHr/uUHrO0sL0QkcP8BkFpr9WWVbpZb49ceerqthMWfqc//aTpSxfAowv2QNzG5Fjb3lCmbEPspF3Q+iv+130DXkESLxRvXnJ+qj1+ZccdWfeyH1da+bS8qTqUGcsWPK0B9zQ2cVYLcBu7c=" target="_blank" style="color:#4453ea">
www.avg.com</a> </td>
</tr>
</tbody>
</table>
<a href="#x_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2" width="1" height="1"></a></div>
<br>
<fieldset class="x_mimeAttachmentHeader"></fieldset>
<pre class="x_moz-quote-pre">*** Options: <a class="x_moz-txt-link-freetext" href="http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech">http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech</a>
*** Archive: <a class="x_moz-txt-link-freetext" href="https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cb348485790f5492be36008d81c0cb9db%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&sdata=8jXZaMZARN6EA3H7ZdXi2t0DzZ2XfvP89wszOv8Gn%2BQ%3D&reserved=0" originalSrc="http://www.eprints.org/tech.php/" shash="PDTXbPsy++LmxwsGMQ5Xgmjebdlfuvnde+3SLFu136g+RRIuamkvDgAtuSOqaqfEeuZjPT7UDo+wRKe4I2bPBBinDcQQRv/dVkAceiEUFoPYzrEnvGL79jhtDseHE1E9ei4x5L2Wlj5T8TPLv5K0lpn9DPS9vo28vdI12jthcFQ=">http://www.eprints.org/tech.php/</a>
*** EPrints community wiki: <a class="x_moz-txt-link-freetext" href="https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cb348485790f5492be36008d81c0cb9db%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&sdata=e4BrQ0VHL4o8ar%2BuqZHXkXTLMWDmmHBC6GVcqA61RiE%3D&reserved=0" originalSrc="http://wiki.eprints.org/" shash="a0vzghWr/xU0tyDLevGfF1qEB1475JUR5XYu+5hg0W5LOF/KjuRipQU0icYV3hk6t9Z4f7DAT5fkHCvAJOB71Kja77tj7IVV/chzu76QdgVbgd39MlofRIHKjQsG7YvtQBwT8u4rdKX55WhKHtacvHTQv9Q20AqzxYsEaifmfrk=">http://wiki.eprints.org/</a></pre>
</blockquote>
</div>
</body>
</html>