ISFDB:Configure Nightly Processing

From ISFDB
Jump to navigation Jump to search

Note: the following three files reside in the "nightly" subdirectory under INSTALL_HTML.

Weekly Processing

Configure crontab to run weekly_job.py once a week, e.g.:

00    01    *    *    7    /var/www/html/nightly/weekly_job.py > /dev/null 2>&1

When it runs, this task will regenerate database statistics AND rerun the cleanup reports.

Nightly Processing

Configure crontab to run nightly_job.py once a day EXCEPT when weekly processing runs, e.g.:

00    01    *    *    1-6    /var/www/html/nightly/nightly_job.py > /dev/null 2>&1

When it runs, this task will rerun the cleanup reports.

Monthly Processing

Configure crontab to run monthly_job.py once a month, e.g.:

00    02    7    *    *    /var/www/html/nightly/monthly_job.py > /dev/null 2>&1

When it runs, this task will recreate the "Suspected Duplicate Authors" cleanup report. Note that the algorithm doesn't scale well with the number of author records in the database. It takes a long time and puts a lot of stress on the server, so it should only be run infrequently. At the moment it's commented out on the live server due to performance issues.