Efficiency Gains in Rare Book Assessment: Evaluating Generative AI as an Adjunct Approach

Abstract

Months of environmental fluctuations in the rare book storage area compelled the Preservation Department to conduct a condition assessment. To limit the possibility of inattentional blindness and to test the quality of generative AI systems two different generative AI systems were tested against well-trained humans. The test consisted of one-hundred books which were evaluated by humans for damage to the text-block, the spine, the margin/gutter and the paper. The areas were photographed, those photographs and uniform text were input into Gemini Pro and ChatGPT Pro. The human results were compared against Gemini Pro and ChatGPT Pro. Considering generative AI was not designed to perform rare book assessments, the AI systems performed better than expected evaluating the text block, the condition of the paper and suggested preservation actions.

Notes

100 rare books chosen at random Each book was photographed six times in the following areas: Front cover and spine Front endpapers (both) First random set of pages Second random set of pages Back endpapers (both) Back cover and spine

The following data was collected about each book: Barcode Condition of the text block Gutter margin width Paper type and condition Binding type and condition Suggested preservation/conservation actions Damage prior to assessment (Y/N) Foxing Present (Y/N) Prior Water Damage (Y/N)

A human experienced with assessing the condition of rare books evaluated each book. Six photographs were taken of each book and were fed into Gemini and ChatGPT to assess for the same assessments that the human performed.
The prompt that was used: “Using the uploaded images as a guide generate a preservation assessment report using the following parameters: Condition of the text block Gutter margin width Paper type and condition Binding type and condition Suggested preservation and conservation actions for this book”

Rights

CC0 1.0 Universal
http://creativecommons.org/publicdomain/zero/1.0/