Efficiency Gains in Rare Book Assessment: Evaluating Generative AI as an Adjunct Approach
Files
Related Publication Link
Date
Advisor
Related Publication Citation
DRUM DOI
Abstract
Months of environmental fluctuations in the rare book storage area compelled the Preservation Department to conduct a condition assessment. To limit the possibility of inattentional blindness and to test the quality of generative AI systems two different generative AI systems were tested against well-trained humans. The test consisted of one-hundred books which were evaluated by humans for damage to the text-block, the spine, the margin/gutter and the paper. The areas were photographed, those photographs and uniform text were input into Gemini Pro and ChatGPT Pro. The human results were compared against Gemini Pro and ChatGPT Pro. Considering generative AI was not designed to perform rare book assessments, the AI systems performed better than expected evaluating the text block, the condition of the paper and suggested preservation actions.
Notes
100 rare books chosen at random Each book was photographed six times in the following areas: Front cover and spine Front endpapers (both) First random set of pages Second random set of pages Back endpapers (both) Back cover and spine
The following data was collected about each book: Barcode Condition of the text block Gutter margin width Paper type and condition Binding type and condition Suggested preservation/conservation actions Damage prior to assessment (Y/N) Foxing Present (Y/N) Prior Water Damage (Y/N)
A human experienced with assessing the condition of rare books evaluated each book. Six photographs were taken of each book and were fed into Gemini and ChatGPT to assess for the same assessments that the human performed.
The prompt that was used:
“Using the uploaded images as a guide generate a preservation assessment report using the following parameters:
Condition of the text block
Gutter margin width
Paper type and condition
Binding type and condition
Suggested preservation and conservation actions for this book”
URI (handle)
Rights
http://creativecommons.org/publicdomain/zero/1.0/