User:Fixer

From ISFDB

Jump to: navigation, search

Fixer is a robot account used to create submissions via the Web API. It is currently maintained by User:Ahasuerus.

Contents

ISBNs ready for manual submission

See User:Fixer/Public for lists of books which are ready for manual submission.

How Fixer Works as of 2018-06

Here is how Fixer works as of 2018-06:

  1. The software package known as "Fixer" resides on the ISFDB development server which is different from the main ISFDB server. Fixer can't be moved to the main ISFDB server without a complete rewrite due to many software compatibility issues.
  2. Every month Fixer queries Amazon.com and Amazon UK for new SF books, where "new" means "since Fixer was last run". The captured data is stores in Fixer's internal database, which separate from the main ISFDB database. Note that the data that Amazon sends back to Fixer is not always the same as the data displayed on Amazon's Web pages. Among other things, this means that Fixer doesn't have access to cover artists or anthology editors.
  3. If the ISBN of a newly captured book has been previously submitted to ISFDB or suspended/rejected, then the ISBN is ignored. Otherwise Fixer adds the ISBN and its publication data to the main "queue".
  4. Fixer tries to determine whether to use the US data or the UK data for each ISBN. For example, if Amazon.com says that the publisher is "Baen" and Amazon UK says that the publisher is "Unknown", then Fixer uses the US record. If the data is incomplete or if the publisher is active on both sides of the Atlantic, manual intervention is required.
  5. Fixer uses other online sources to find additional information about the captured ISBNs, notably price data.
  6. For each captured ISBN, Fixer determines whether the ISBN should be automatically suspended. This is currently done for:
    • ISBNs starting with 2-9 (non-English pubs)
    • audio, CD and MP3 books
    • books published by the better known vanity publishers
  7. Note that the data in Fixer's "suspended" queue is not deleted, but it is considered very low priority.
  8. Fixer examines all captured records and separates "high priority" ISBNs from "low priority" ISBNs. High priority ISBNs are associated with major publishers and/or authors who have records in ISFDB.
  9. Fixer massages the captured data, assigning publication format codes, regularizing publisher names, adding publication series (if available) and so on.
  10. The robot maintainer (Ahasuerus as of 2018) reviews the "high priority" list and then the "low priority" list. Comic books, non-genre books, calendars and so on are manually rejected. Books for very young children and other borderline ISBNs are manually suspended. Everything else is assigned to queues 1, 2 or 3. Queue 1 is the highest priority queue for ISBNs associated with major publishers and established authors. Queue 2 is for self-published and other "minor" authors whose other books are already cataloged in ISFDB. Queue 3 is the lowest priority queue and mostly contains books by self-published authors not in ISFDB. Each queue is further subdivided into a "paper" sub-queue and an "ebook" sub-queue based on the book's format.
  11. The robot maintainer uses the Web API to create batches of 10-100 submissions based on what's in queue 1. Some submissions are created using Fixer's ISFDB account. Other submissions are created using the maintainer's account.
  12. Moderators review and approve submissions created using Fixer's account. The robot maintainer reviews and approves submissions created using his account. See Help:How to work with Records Built by Robots and Help:Screen:Moderator#Moderating_Automated_Submissions for a discussion of the challenges associated with processing robotic submissions.
  13. Moderators provide feedback to the robot maintainer if they notice recurring errors in Fixer's logic, e.g. incorrectly regularized publisher names.

Ahasuerus 14:54, 25 June 2018 (EDT)

Activity

Fixer's Internal Queues as of 2018-07-16

Legend:

  • n-p - new (unprioritized) paper books
  • n-e - new ebooks
  • 1-p - queue 1 (high priority) paper books
  • 1-e - queue 1 ebooks
 Month     2018                   2017                   2016
     n-p  n-e  1-p  1-e|   n-p  n-e   1-p  1-e|   n-p   n-e   1-p   1-e|
------------------------------------------------------------------------
 NON 107    0    1    0|    80    0     2    0|    20     0     2     0|
 Jan  80 1443    3    0|     7 1470     1    4|     9  1264     3     3|
 Feb  60 1334    1    5|    14 1387     5    2|    14  1296     0     2|
 Mar  87 1347    4    5|    13 1736     0   10|    16  1387     3     1|
 Apr 126 1438    0    4|    79 1653     0    3|    13  1752     0     6|
 May 211 1351    5    6|    94 1680     0    4|    14  1420     2     6|
 Jun1422 1512   69    7|    77 1549     0    7|     8  1343     2     2|
 Jul 705  930   46    3|   104 1617     0    8|    10  1203     1     3|
 Aug 115  461   11    1|   105 1525     0    3|    98  1382     1     4|
 Sep 845  402  140    0|    18 1463     0    3|    18  1451     1    11|
 Oct 143   23   18    0|    29 1663     1    2|    18  1556     2     6|
 Nov  80    9    8    0|    39 1663    12    1|    24  1425     3    12|
 Dec  35   10    7    0|    48 1612    11    3|    24  1388     1     1|
 Month     2015                   2014                   2013
     n-p  n-e  1-p  1-e|   n-p  n-e   1-p  1-e|   n-p   n-e   1-p   1-e|
------------------------------------------------------------------------
 NON  25    0    1    0|   138    0     0    0|   197     0     0     0|
 Jan  15   75    9    2|    17 1937    23   93|    31  1199     2     2|
 Feb 281  100    6    8|    14 1250    14   22|    88  1060     3    10|
 Mar 300   80    2   33|    19 1280    18   60|    71  1182     0     3|
 Apr 287 1244   11    8|    21 1589    21    7|   106  1290     1     4|
 May 276 1312    8    0|    24 1305    14    7|    78  1108     1     3|
 Jun 266 1271    3    4|    18 1540    20    6|    65  1145     1     2|
 Jul 343 1468    2    0|    10 1392    23    7|    89  1204     2     7|
 Aug 305 1414    1    1|    22 1323    14   11|   106  1109     2    13|
 Sep  53 1509   23    4|    24 1567    34    4|   176  1126     0     6|
 Oct  24 1792   22    5|    32 1858    35    5|    84  1498     4     8|
 Nov   7 1477   17    3|    26 1619    37    7|    94  2178     1     8|
 Dec  24 1693   20    2|    24 1583    24   12|    83  2459     1     5|
 Month     2012                   2011                   2010
     n-p  n-e  1-p  1-e|   n-p  n-e   1-p  1-e|   n-p   n-e   1-p   1-e|
------------------------------------------------------------------------
 NON 409    0    2    0|   552    0     0    0|   759     0     0     0|
 Jan 584  874   12    3|   705  571     0    1|   931   223     0     1|
 Feb  65  873   70    7|   625  670     4    4|   385   237     3     3|
 Mar 883 1030    3    3|   900  698     1    1|   491   300     4     3|
 Apr 846  979    3    0|  1170  697     6    5|   481   324     1     3|
 May 867 1082    4    4|   844  903     4    5|   506   343     0     2|
 Jun 760  996    2    2|   832  921     2    1|   443   418     1     3|
 Jul 708 1168    3    5|   673  978     3    3|   533   476     1     1|
 Aug 901 1116    9    1|   917  992     3   11|   822   500     0     2|
 Sep  85 1211    3    4|   102  745    37    1|   597   489     5     1|
 Oct  83 1375    2   11|    79  821    36   11|   605   530     3     7|
 Nov  74 1049    0    4|    92  873    29    5|   636   482     0     1|
 Dec  71 1237    0    6|    46  855    43    6|  1224   603     2     1|

Note: Queues 2 and 3 contain lower priority ISBNs and are not shown here.

Personal tools