[EP-tech] IRStats does not show full statistics

[Agung Prasetyo W.]

CAUTION: This e-mail originated outside the University of Southampton.
Hi,

Here are the results of the sql query I ran on my server :
[image.png]

But why doesn't the blue graph appear in the IRStats display for data from January to December 2022?

[image.png]

Regards,
Agung PW


On Mon, Feb 20, 2023 at 7:43 PM John Salter <J.Salter at leeds.ac.uk<mailto:J.Salter at leeds.ac.uk>> wrote:
Hi Agung,
Try running this on the database server:
    SELECT datestamp_year, datestamp_month, COUNT(*) FROM access WHERE datestamp_year = 2023 GROUP BY datestamp_year, datestamp_month;

This will show you how many records there are to process for this year.

It might also be worth checking the database server error logs for any messages?

Cheers,
John

From: eprints-tech-bounces at ecs.soton.ac.uk<mailto:eprints-tech-bounces at ecs.soton.ac.uk> [mailto:eprints-tech-bounces at ecs.soton.ac.uk<mailto:eprints-tech-bounces at ecs.soton.ac.uk>] On Behalf Of Agung Prasetyo W. via Eprints-tech
Sent: 20 February 2023 12:02
To: Alan.Stiles [He/Him/They] <alan.stiles at open.ac.uk<mailto:alan.stiles at open.ac.uk>>
Cc: eprints-tech at ecs.soton.ac.uk<mailto:eprints-tech at ecs.soton.ac.uk>
Subject: Re: [EP-tech] IRStats does not show full statistics

CAUTION: This e-mail originated outside the University of Southampton.
Hi,

Yes, I've run process_stats without --setup but still use --verbose flags. Does this really affect the update from irstats? Because after I run process_stats without the --setup flags, it says there are only 37 records. Does this mean the access table doesn't contain or store the data required by irstats?

Regards,
Agung PW


On Mon, Feb 20, 2023 at 3:51 PM Alan.Stiles [He/Him/They] <alan.stiles at open.ac.uk<mailto:alan.stiles at open.ac.uk>> wrote:
Is your local eprints running the process_stats call nightly via a cron job to update the stats after having been rebuilt from the beginning?

Like your command below, but without the –setup and –verbose flags ?

Alan

From: eprints-tech-bounces at ecs.soton.ac.uk<mailto:eprints-tech-bounces at ecs.soton.ac.uk> <eprints-tech-bounces at ecs.soton.ac.uk<mailto:eprints-tech-bounces at ecs.soton.ac.uk>> on behalf of Agung Prasetyo W. via Eprints-tech <eprints-tech at ecs.soton.ac.uk<mailto:eprints-tech at ecs.soton.ac.uk>>
Date: Sunday, 19 February 2023 at 14:58
To: eprints-tech at ecs.soton.ac.uk<mailto:eprints-tech at ecs.soton.ac.uk> <eprints-tech at ecs.soton.ac.uk<mailto:eprints-tech at ecs.soton.ac.uk>>
Subject: [EP-tech] IRStats does not show full statistics

CAUTION: This mail comes from outside the University. Please consider this before opening attachments, clicking links, or acting on the content.
CAUTION: This e-mail originated outside the University of Southampton.
Hi,

I have around 18000 items in my local repository. 1 month ago, my IRStats displayed complete data up to the last month. Then I moved the eprints to the local server and then ran process_stats repos --setup --verbose and it took almost 3 days.. But as a result, statistics from last month to this month do not appear.
Here's the last process:
--------------------------------------
Access: incremental commit to DB
Access: processed 35700000 records so far.
Saving the state for dataset 'access'
Access: it took 188211 secs to parse 35735180 records ( average = 189.87 records/sec )
Access: 24667016 records kept out of 35735180 ( ratio = 69.03%)
About to process dataset 'history'
Creating table 'irstats2_history'
history: starting from record 0
history: 320571 records to process.
Leaving now
---------------------------
Is there something wrong with my database or maybe or is there a step I missed? Please advise me on what I should do.

Thank you.

Regards,
Agung PW
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.ecs.soton.ac.uk/pipermail/eprints-tech/attachments/20230220/e4c50f72/attachment-0001.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 17513 bytes
Desc: not available
Url : http://mailman.ecs.soton.ac.uk/pipermail/eprints-tech/attachments/20230220/e4c50f72/attachment-0002.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 20642 bytes
Desc: not available
Url : http://mailman.ecs.soton.ac.uk/pipermail/eprints-tech/attachments/20230220/e4c50f72/attachment-0003.png