ISFDB:Data Consistency

The Data Consistency project is a place to coordinate efforts to identify and repair data consistencies, including Stray Publications, malformed ISBNs, etc.

Publication Records

Invalid characters in Publication titles

• ISFDB:Invalid characters in Publication titles 14 as of 2007-11-27. Ahasuerus 19:36, 9 Dec 2007 (CST)

Type mismatches

• Need a script that finds book length Publications whose type doesn't match the type of the associated Title records, e.g. "collection" vs. "novel", "novel" vs. "omnibus", etc.

Missing data

• Need a script that finds missing data, e.g. missing page counts, missing pb/tp/hc data, 0000-00-00 dates, etc.

Titles

Safe to auto-merge identical titles?

Related to the Gardner Dozois collection was that for nearly all of the titles I found had two title records that were identical other than one was a parent of the other. If it seems safe it seems it would safe some work to to do a sweep for title records that are identical and to auto-merge them. Marc Kupper 22:25, 22 Dec 2006 (CST)

Tags

It would be nice to standardize user-generated tags.

Synonyms

---

• hard science fiction
• hard sf

---

• history of sf
• history-of-sf

---

• juvenile sf
• juvenile-sf

---

• recursive sf
• meta sf

---

• 'young-adult humorous sf' -> 'humorous sf' + 'young-adult sf'

etc etc

some one should probably come up with a standard then make some filters for input and run the filters on the existing tags.

Authors

Pseudonym consistency

There are 22 authors in the latest dump who are self-pseudonyms (they have a pseudonym record pointing back to themselves):

select ps.pseudo_id, ps.author_id, au.author_canonical
    from pseudonyms ps, authors au
    where ps.author_id = ps.pseudonym and ps.author_id = au.author_id;

There are two pairs of authors who are pseudonyms of each other:

• Avram Davidson (author_id 501) and Ellery Queen (author_id 4921), twice
• Douglas Stapleton (author_id 12921) and Doug Stapleton (author_id 12922)

There may also be longer cycles... WimLewis 22:28, 25 Mar 2007 (CDT)

Title vs. Publication Type Consistency

This section documents mismatches between Title types and associated Publication types:

• Collections:
  • Collection-Novel mismatches
  • Collection-Anthology mismatches
  • Collection-Omnibus mismatches
  • Collection-Other mismatches

• Novels:
  • Novel-Magazine mismatches
  • Novel-Anthology mismatches
  • Novel-Collection mismatches
  • Novel-Other mismatches

• Short fiction:
  • Short fiction-Non-fiction mismatches
  • Short fiction-Novel mismatches

• Non-fiction:
  • Non-fiction-Novel mismatches
  • Non-fiction-Other mismatches

• Other:
• Non-genre mismatches
• Serial mismatches
• Omnibus mismatches
• Anthology mismatches
• Editor mismatches

Pseudonyms in Collections

The following page lists all known Collection Publications that include pseudonymous Titles as of the August 11, 2007 backup. Although this is not always indicative of an error, we estimate that a significant percentage of these occurrences need to be fixed.

• Pseudonyms in Collections NEW as of 2008-05-06

Serial Dates

The following page lists all known Serial records whose Title dates do not match the dates of the Publications that they appeared in as of the 2008-02-10 backup.

• Serial Dates