Load MARCIVE Limimoc Records

Summary: 

These instructions are for loading the Limimoc records that updated the Marcive monthly online records. These online updates are the only updates we receive from Marcive. Update matching instance (no effect on 856 due to MARC field protection). The records are loaded first on CATMAN9 Job Profile by matching on the 001 in the marc records to the Instance OCLC # (marc 035) field. Non-matches create an instance, holdings, and item records for the Library of Michigan location.

Lastly, a webform (https://codeprod.lib.msu.edu/scripts/wf1.php) is used to determine which FOLIO instances have only one holding record attached to the Limmic records. The records are uploaded through the web form to create a separate mrk list that finds the records that only have single holdings records in the file being loaded. The MarcEdit list that is created is run through CATMAN10. They match from the 035 in the marc records to the Instance OCLC # (marc 035) field. The CATMAN10 Job Profile does not have non-match criteria.




Heads up

Procedure is actively being drafted based on work of the MSUL Job Profile Working Group; it will continue to change while the group determines how to compose the necessary job profiles.--7/25/23

Temporary section: JPWG recording 7/24/23 & steps drafted by Lucas Mak

7/24/23 recording overviewing steps below:

https://mediaspace.msu.edu/media/MSUL+Jo+b+Profile+Working+Group+meeting+2023-07-24/1_2xs73b93

CATMAN10 (Lucas test) has been recreated on Test tenant.

The first “reprocessing” step (right after running CATMAN9) will need to extract the instance UUIDs from the Webform and then merge them back into the original LIMIMOC file. Then Extraction of MARC records thru Data Export can only be done after the CATMAN10 has been run once because CATMAN9 won’t update the URL due to MARC field protection (Or we just reuse the file used in the 1st run of CATMAN10 but change the location in 948$a, which is what I have suggested below).


CATMAN9

  • Update matching instance (no effect on 856 due to MARC field protection)
  • Create one set of instance, holdings, and item records for the location in 948$a if existing holdings record(s) is not in the 948$a location


Reprocessing – 1st time

  • Extract instance UUIDs and merge them into the original LIMIMOC file
  • Keep the 948$a location unchanged


CATMAN10 (Lucas test) -- 1st run

  • Update URLs in matching (by instance UUID in 999ff$i) instance (can be instance already in existing when CATMAN9 is run, or new instance created by CATMAN 9)
  • Update URLs in matching (by location in 948$a) holdings record (can be holdings already in existing when CATMAN9 is run, or new holdings created by CATMAN 9)

**Updates done to new instance and holdings created by CATMAN9 are redundant and should not change any record data


Reprocessing – 2nd time

  • Change the 948$a location in the LIMIMOC file


CATMAN10 (Lucas test) -- 2nd run

  • Update URLs in matching (by instance UUID in 999$i) instance
  • Update URLs in matching (by location in 948$a) holdings record (already in existing when CATMAN9 is run; but with a different location than 1st run of CATMAN10 above)
  • Create 2nd set of holdings and item records for location in 948$a (different location than the one in CATMAN9 above)


The key is that the location used in CATMAN9 must be used again in one of the two CATMAN10 loads to make sure both LC and MSU holdings records are updated

Back to top 


Edits to the MarcEdit file are done before the records are loaded into FOLIO. 

  • Open the file  MarcEdit mrk file.
  • Add > “948 \\$a7fdel” string to all the records in the file in order to add Library of Michigan items and holdings if needed.
    • Add  > “948 \\$a7fdel” string to all the records in the file in order to add Library of Michigan items and holdings if needed.
    • Tools > Add/Delete Fields
    • Save changes.
  • Save your mrk file to your desktop as an (*mrc) file adding Load to the end of the name.
  • Compile the mrk File into an mrc file, or click on the Compile MARC image .
  • Name the mrc file the same as the mrk.
  • The mrc file is ready to run through the Data Import, CATMAN9 job profile.

Back to top 


FOLIO Data Import on CatMan9 Job Profile

  • From FOLIO select Data Import app.
  • Drag and drop or click to find the mrc file.

  • Select the Job profile, CATMAN9 - Load Limimoc records to update Marcive monthly online records . . .
  • ACTIONS > RUN.
  • Wait for the file to produce the completed report.

Back to top


Open the LIMIMOC file in MarcEdit to pull out the OCLC Numbers into a separate file.
  • Open MarcEdit > Tools > Export… > Export Tab Delimited Records.
  • Once the “Export Tab Delimited Records” popup opens.
    • Insert the LIMIMOC (mrc) file in the first file path.
    • Save the mrk file on your desktop as a txt file.
    • Copy and paste the txt LIMIMIOC file address into the second file path changing (or change the extension to txt).
    • Click “Next.”
    • Select “001” from the Field box.
    • Click “Add Field.”
    • Click “Export.”
    • Items have been exported > Close Tab Delimited box.

Back to top


Find and open the exported TXT file on your Desktop.

  • Open the txt file with the OCLC numbers on your Desktop.
  • Delete the first row that has “001.”
  • Remove all double quotes by Find and Replace.
  • Save txt file and exit out.


Back to top


Webform used once to find the oclc duplicates.

  • Go to webform https://codeprod.lib.msu.edu/scripts/wf1.php
  • Go to MarcEdit - Tools > Export >
    • Place the mrc file in the first file box, copy the file name and change the end from mrc to txt.
    • Save on Desktop - add merging to the end of the file name.
    • Next
    • Do not go in this way. Click “Browse” button then find the corrected TXT file from the previous step.
  • Find  the file on your Desktop > Click “Upload file”
  • Select the option that reads "Instances with Single Holdings" in the drop down.
  • Click “Submit”
  • Wait for the query process to finish (It may take a while depending on how many OCLC numbers are in the file)
  • When the process is done, a list of Instance UUIDs will be listed > click “Download.”
  • The file name starts with "out_ ..."  and is saved as a csv file.

Web Form run through

Back to top


Go to FOLIO Data Export app.


  • In Data export > Upload the CSV file from the last step by clicking the “or choose file” button or dragging the CSV file into the “Drag and drop” box.
  • The file will label records that have duplicate OCLC records if there are duplicate OCLC records in the file.
  • If there are dups in the file, save a copy of this Webform file that has "(Dup?)" at the end of the UUID numbers.
  • Name the file by adding "Dups" to the end of the name so that you know not to use this file. This file will be used later to clean up the duplicate records. Name ex.: LIMIMIOC2104.OCLCDups.csv. 
  • Next, find the original file that still has (Dup?) at the end of the UUID numbers if there are duplicates. The original file will be run against CATMAN10 > Remove (Dup?) from the end of the UUID numbers.

Back to top


Run the Webform file in Data Export

  • In Data Export find the saved file (without (dups)) to run against the (find the data export JP name, it is not the CATMAN10 profile].
  • Drag or drop into the Data Export box to run the file.
  • Select “Default Instances Export Job Profile.”
  • Choose “Instances” in the popup.
  • Click “Run.”
  • Output MARC file report will appear on the top of the Data Export log.

Back to top


In MarcEdit Prepare Records to run against the second Job Profile (CATMAN10)

This is where the 948 \\$a7fdel is removed and then add a 948 \\$awbgov.

  • Find the mrk file to view records in MarcEdit.
  • Click on Tools > Add/Delete Field.
  • Look for and delete any 948 fields with \\$a7fdel.
  • In Add/Delete Fields add another 948 > Field Data type \\$awbgov) > click Add > Save file > close out of MarcEdit.
  • Find the Single record mrk file.
  • Look for updates, discarded, or errors.
  • Compile the csv file to a mrc file.
  • The csv excel file will show which records have duplicate records.
  • Save the csv file that list records with duplicate records.
  • In FOLIO select Data Import.
  • Drag or drop the mrc file to start data import job.
    • Select Job Profile “CATMAN10 – Load new Marcive monthly online records – create holdings and item records for both MSU and LM.”
    • Actions > RUN.
    • Wait for the report and then check that records have the wbgov holdings and item records with the designated electronic links and call numbers.
    • Look for updates, discarded, or error records.


Back to top



Back to top




a

Policies

ContactLisa English
TeamCatMan
UpdatedJuly 2023
CreatedMay 2023