Cat date restoration 2026

Summary: Incorrect date formats in migrated Sierra data were determined to be the cause of cat dates disappearing from edited instances in FOLIO. The project will correct the date formatting while preserving original cat dates, as well as supplying missing instance status information.

• ~6.5 million migrated catalog records require remediation

• Scope of transformation and loading will necessitate a long time frame

• Work must be done via Data Import because local MARC data is being transformed

• Open questions:

  • Whether to remove the custom mapping that ties Status Updated Date to a MARC value, and if so, what it should map to instead (catalog date vs. processing date).

  • Whether staff can read/write custom mapping via API, or if changes must go through EBSCO.

• Longer term questions:

  • How long will this project take specifically? And can/should it be run during low-impact parts of the calendar (i.e. between semesters, during holidays)

Plan

1. Determine when and how to conduct the transformation and loading

   1. Autumn can contribute to transformations and batch loads

2. Adjust custom mapping rules

   1. Currently instance status updated date is tied to presence of Sierra bib number (a migration need)

   2. Configure so that date is tied to any change in instance status

3. Extract records via API

   1. Use record created date to locate all records migrated on 6/22/2022.

   2. Extract UUIDs

   3. Work in batches using this comprehensive list

4. Set up job profile to:

   1. Update MARC (907 and 998 fields in particular)

   2. Update instance to status “Cataloged”

5. Batch process

   1. Select batch of UUIDs and mark in spreadsheet(s)

   2. Export full MARC SRS in Data Export

   3. Transform in MarcEdit using canned tasks

      1. 907 $b cat date

      2. 998 $b cat date

   4. Load back into FOLIO using designated job profile

• The cataloged date needs to be remediated across all migrated records (~6–6.5 million+). The exact scope is still being confirmed.

• This will be a long‑running effort. While prior bulk edits (e.g., ~1 million loan type fixes via Bulk Edit in a week) provide some reference, this work must be done via Data Import, making it more complex.

• Inventory searching/exporting limits are a challenge:

  • Searching by Record Created Date (e.g., 6/22/22) should surface most affected records; Status Updated Date is not reliable.

  • Exporting UUIDs via Excel/CSV is insufficient for this scale (exports truncated at ~1M records).

  • Lucas will ask Dao to assist with exporting the full dataset via the API.

  •  

•