[EP-tech] Message during process_stats IRStat2
David R Newman
drn at ecs.soton.ac.uk
Fri Aug 13 13:37:34 BST 2021
Hi Izwan,
Just to clarify the process_stats script can be run in two different
ways. One is an initial setup that does various one time task and then
processes all of the existing access table records. The other is just
doing an incremental update of stats for the previous day. The latter
should be done via a daily cron job in the eprints crontab. If you are
referring to running the initial setup way, then it might be worth
regenerating the stats from scratch, as over time you may have had a lot
of internal requests over the lifetime of your repository that would now
not be marked as such in your usage stats. However, I don't expect a
regular EPrints repository to make that many internal (i.e. from the
eprints server itself) requests. It would only be if you have some
bespoke functionality running on your repository that will request
abstract pages or download documents. However, if you were referring to
just running the incremental daily update method (for process_stats),
assuming that increment is only a day or a few days, then re-running
this will not make any difference and regenerating all the stats from
scratch would not be worth it, as you probably have very little if any
internal requests in this timeframe.
I get a bit of a feeling that you are not running the process_stats
script on a daily basis to make these incremental updates. Check the
out the wiki page that explains about this and how to setup a cron job:
https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwiki.eprints.org%2Fw%2FIRStats2%23Processing&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492325223%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=Q6Vk8zL9yns5dVdDWcnT3JecKWcPBcdELWkmLzj%2BzOI%3D&reserved=0
Regards
David Newman
On 13/08/2021 13:12, MOHD.IZWAN SALIM wrote:
> *CAUTION:* This e-mail originated outside the University of Southampton.
> Dear David
>
> Should I apply the change and re-run the script?
>
> I already ran it for 2 days?
>
> Is there any different stat after I apply the change?
>
> Regards
>
> *Izwan*
> *UiTM Digital Library
> *https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fir.uitm.edu.my%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492325223%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=u3KSX3%2FSVpld8fpyg8pg4RrV3ZjsJ%2FMzRjQMeP49ygs%3D&reserved=0
> <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fir.uitm.edu.my%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492325223%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=HpRM%2Bax1L%2FakVSl0WMPq5IE8wTECvSGRagOsXPPsbH8%3D&reserved=0>
>
>
> On Fri, Aug 13, 2021 at 4:45 PM David R Newman <drn at ecs.soton.ac.uk
> <mailto:drn at ecs.soton.ac.uk>> wrote:
>
> Hi Izwan,
>
> Looking at the line of code that has the error:
>
> One of the these to variables is not set. As there is a
> comparison involving $hostname further up in the file, it must be
> $self->{host} that is not set. This is earlier set from line 24:
>
> $self->{host} = $self->{session}->config( "host" );
>
> My suspicion is that you have reconfigured your repository to be
> HTTPS only and there only set $c->{securehost} and not $c->{host}
> in your archive's cfg/cfg.d/10_core.pl
> <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2F10_core.pl%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=zs10RudwY9fz6l7hp%2BeeywyFu9%2Fh%2BtjiwRjs5Em6gO0%3D&reserved=0>
> (or some other config file in the same directory). If $c->{host}
> is set to undef this would also return the same error message
> here. To resolve this problem you should go to line 24 of
> /usr/share/eprints/lib/plugins/EPrints/Plugin/Stats/Processor/Access/Referrer.pm
> and add the following line after it:
>
> $self->{host} ||= $self->{session}->config( "securehost" );
>
> This will set $self->{host} to the config value of securehost if
> there is no value set for host. I have had to make various
> amendments to EPrints to support the no $c->{host} set means HTTPS
> only, so that it does not break things that expect it to always be
> set. However, not setting $c->{host} seemed like the most
> intuitive way to allow system administrators to know they have
> configured their repository for HTTPS only.
>
> Unfortunately, there has not been a new release of IRStats 2 since
> these changes were baked into recent versions of EPrints 3.4. In
> part due to this only affecting those who configured there
> repositories for HTTPS only in this way.
>
> Regards
>
> David Newman
>
> On 13/08/2021 09:26, MOHD.IZWAN SALIM via Eprints-tech wrote:
>> *CAUTION:* This e-mail originated outside the University of
>> Southampton.
>> Dear all, I just migrated and upgraded EPrints 3.3.16 to 3.4.3.
>> Everything worked fine until I ran the process_stat --setup for
>> IRSTAT2.
>>
>> The statistic is running (i guess) but it only shows message
>> Use of uninitialized value in string eq at
>> /usr/share/eprints/lib/plugins/EPrints/Plugin/Stats/Processor/Access/Referrer.pm
>> line 84.
>> Use of uninitialized value in string eq at
>> /usr/share/eprints/lib/plugins/EPrints/Plugin/Stats/Processor/Access/Referrer.pm
>> line 84.
>> Use of uninitialized value in string eq at
>> /usr/share/eprints/lib/plugins/EPrints/Plugin/Stats/Processor/Access/Referrer.pm
>> line 84.
>> Access: incremental commit to DB
>>
>> I'm using mysql 8. I want to get rid of that message.
>>
>> Regards
>>
>> *Izwan*
>> *UiTM Digital Library
>> *https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fir.uitm.edu.my%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=Cwua8b3igYwAfnx%2B9BJAhl6mqh19IfSE2XretXjtkJw%3D&reserved=0
>> <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fir.uitm.edu.my%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=Cwua8b3igYwAfnx%2B9BJAhl6mqh19IfSE2XretXjtkJw%3D&reserved=0>*
>> *
>>
>> *PENAFIAN: *E-mel ini dan apa-apa fail yang dihantar
>> bersama-samanya ("Mesej") adalah dihasratkan hanya untuk kegunaan
>> penerima yang dinyatakan di atas dan mungkin mengandungi maklumat
>> yang tidak umum, bermilik, istimewa, sulit dan dikecualikan dari
>> penzahiran di bawah undang-undang yang terpakai termasuklah Akta
>> Rahsia Rasmi 1972. BACA SELANJUTNYA...
>> <https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=JN0UxPiS9oT%2BChzZuuB0GE1j5uv6%2FjGBl%2BEW6FcXX4E%3D&reserved=0>
>>
>> ------------------------------------------------------------------------
>> *DISCLAIMER :*/This e-mail and any files transmitted with it
>> ("Message") is intended only for the use of the recipient(s)
>> named above and may contain information that is non-public,
>> proprietary, privileged, confidential and exempt from
>> disclosure under applicable law including the Official Secrets
>> Act 1972. /READ MORE...
>> <https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=JN0UxPiS9oT%2BChzZuuB0GE1j5uv6%2FjGBl%2BEW6FcXX4E%3D&reserved=0>
>>
>> *** Options:http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech <http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech>
>> *** Archive:https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=1sGV4MqWoPV4JP116mSnIGtGzLUS30CNgbmv%2FxDAZkg%3D&reserved=0 <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=1sGV4MqWoPV4JP116mSnIGtGzLUS30CNgbmv%2FxDAZkg%3D&reserved=0>
>> *** EPrints community wiki:https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=rm2q%2FRqU%2F064sd1UoeIpU3tgMTGSW%2BMNvMcuXVnO2Vk%3D&reserved=0 <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=rm2q%2FRqU%2F064sd1UoeIpU3tgMTGSW%2BMNvMcuXVnO2Vk%3D&reserved=0>
>
> <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.avg.com%2Femail-signature%3Futm_medium%3Demail%26utm_source%3Dlink%26utm_campaign%3Dsig-email%26utm_content%3Demailclient&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=00nrwgLz50YkjI%2Bo94PwYd%2F855xm4W3cHs94oo3in1g%3D&reserved=0>
> Virus-free. https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.avg.com%2F&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=KrdBroCWsChPyeDEslO0Burn7ffZkSWcBhDkkK6CCvY%3D&reserved=0
> <https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.avg.com%2Femail-signature%3Futm_medium%3Demail%26utm_source%3Dlink%26utm_campaign%3Dsig-email%26utm_content%3Demailclient&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=00nrwgLz50YkjI%2Bo94PwYd%2F855xm4W3cHs94oo3in1g%3D&reserved=0>
>
>
>
> *PENAFIAN: *E-mel ini dan apa-apa fail yang dihantar bersama-samanya
> ("Mesej") adalah dihasratkan hanya untuk kegunaan penerima yang
> dinyatakan di atas dan mungkin mengandungi maklumat yang tidak umum,
> bermilik, istimewa, sulit dan dikecualikan dari penzahiran di bawah
> undang-undang yang terpakai termasuklah Akta Rahsia Rasmi 1972. BACA
> SELANJUTNYA...
> <https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=JN0UxPiS9oT%2BChzZuuB0GE1j5uv6%2FjGBl%2BEW6FcXX4E%3D&reserved=0>
>
> ------------------------------------------------------------------------
> *DISCLAIMER :*/This e-mail and any files transmitted with it
> ("Message") is intended only for the use of the recipient(s) named
> above and may contain information that is non-public, proprietary,
> privileged, confidential and exempt from disclosure under
> applicable law including the Official Secrets Act 1972. /READ MORE...
> <https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail.uitm.edu.my%2Findex.php%2Fcomponent%2Fcontent%2Farticle%3Fid%3D2%26Itemid%3D103&data=04%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7C4c314dcb27e94454452608d95e571c7d%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637644550492335179%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=JN0UxPiS9oT%2BChzZuuB0GE1j5uv6%2FjGBl%2BEW6FcXX4E%3D&reserved=0>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ecs.soton.ac.uk/pipermail/eprints-tech/attachments/20210813/4dce8285/attachment-0001.html
More information about the Eprints-tech
mailing list