Ask the Scholar

Page 3 of 4
I can add historical knowledge about this page.

Page image

Page 3

OCR

NATIONAL ARCHIVES SUPPLEMENTAL USER NOTE 3: Diacritics and character encodings issues Ship Passenger Records, 1820-1912 Castle Garden Immigration Center Collection NN3-CGIC-22-001 Staff found that some records in the German (PAS_GS), Irish and United Kingdom (PAS_IRUK), and Italian (PAS_IT) passenger records files can contain some diacritic characters or other special characters that may not display correctly depending on the character encoding setting in use. For example, in the record appearing on line 4649398 in the German passenger file, the last name appears as "GZRTNER" when viewed in US-ASCII. However, the name appears as "GÄRTNER" when viewed in an ANSI display mode. Alternatively, some diacritic characters appear to display correctly in an US-ASCII display mode. For example, on line 4441927, the first name appears as "THÖN" in ASCII. This name displays as "THIN" when viewed in ANSI mode. It is not clear to staff which representation of this name may be correct. Additional examples: File Line# ASCII mode ANSI mode PAS IT 154469 BERNIéRE BERNIURE 171285 BILà BILO PAS GS 4449699 ÜOLME .OLME 4649416 SCHTMNAU SCHÖNAU Unfortunately, due to these discrepancies, staff could not determine the appropriate character encoding that should be used for the German and Italian passenger record files. Researchers may want to replace any diacritic character known to be used in a name with a wildcard character when searching for specific persons or places in the records. The diacritic characters staff identified in the Irish/UK passenger record file appear to display correctly in ASCII. However, it is possible staff did not identify all diacritic characters present in the file and so some text fields may have similar issues as found in the German and Italian files. The Russian passenger file (PAS_RS) does not appear to contain diacritic characters. However, it is again possible staff simply did not identify any such characters in our searches. Electronic Records Division, Reference Branch (RRER) September 30, 2022 NATIONAL ARCHIVES and RECORDS ADMINISTRATION 8601 ADELPHI ROAD COLLEGE PARK, MD 20740-6001 www.archives.gov NARA Reference Copy NATIONAL ARCHIVES SUPPLEMENTAL USER NOTE 2 Ship Passenger Records, 1820-1912 Castle Garden Immigration Center Collection NN3-CGIC-22-001 VILLAGE codes The donor-provided Readme (readme.doc) references a VILLAGE table that contains town codes for the field TCODE. During initial processing, staff noted the donor did not transfer the VILLAGE code table. Upon later review of the code tables, staff identified a VILLAGE field name in the LAST_RES code table. The donor layout does not associate any coded fields with a code table named "LAST_RES." However, when staff linked the key field in this code table to the TCODE field in the passenger files (PAS_XX), the returned VILLAGE values appeared to be accurate for the records when comparing against other information in the record, specifically the value in the TOWN field, though there may be minor spelling differences. For this reason, staff believe the LAST_RES table can be used to return appropriate values for the TCODE field. First names in Irish and United Kingdom Passenger Data File The data file PAS_IRUK_NSTR.txt (PAS_IRUK) includes updated versions of passenger records first transferred to NARA in the file FIPAS (RG200.FAMIR.Y4651; XMIS 003584). FIPAS is described in the series, "Records for Passengers who Arrived at the Port of New York during the Irish Famine, 1977 - 1989" (National Archives Identifier 569666). In FIPAS, the passenger records include the field FAMILY RELATION CODE. The agency- prepared layout (IRISH.README) indicates this field should appear at file position 41. However, staff found that in the data these values appear in file position 21, which is identified as a FILLER field in the agency layout. In the data file, file position 41 is blank in all the records. File position 21 (Filler/Family Relation Code) is populated in 27,101 of the records. When comparing records found in FIPAS to the records for the same individual¹ in PAS_IRUK, staff found that the first names in 10,622 records are preceded with what appears to be a Family Relation Code. For example, in FIPAS, there is a record for a Margaret McCabe, age 8, with ship manifest 711 (see data record on line 44). In this record, file position 21 (Filler/Family Relation 1 There are no unique identifiers shared between the passenger data files. Staff compared the full records from both data files for a given name to determine if the records are for the same individual. NATIONAL ARCHIVES and RECORDS ADMINISTRATION 8601 ADELPHI ROAD COLLEGE PARK, MD 20740-6001 www.archives.gov NARA Reference Copy Code) contains the value "D". In PAS_IRUK, there is no record for a Margaret McCabe with this information. There is, however, a record for a Dmargaret McCabe, age 8, ship manifest 771 (see data record on line 17,605). Upon further investigation, staff identified 10,622 records in PAS_IRUK in which a family relation code appears as the first character in the First Name field based on similarly matching records in the FIPAS file. See the NARA-prepared documentation file PAS_IRUK_NARAIdentifiedRecords.txt for an extract of the set of 10,622 records identified by staff. Staff added the field "file_line" as the first (left-most) column, which indicates the line number on which the record appears in the original data file. The extract file is in ASCII, with pipe-delimited (|) fields enclosed with quotations ("), with record-delimited records (CR/LF). For researchers interested in creating a corrected version of the PAS_IRUK file, keep in mind the original PAS_IRUK records do not include fields containing line numbers or unique identifiers for the individual records. The line numbers provided for the records in the NARA-prepared extract refer to the original ordering of the records in the PAS_IRUK data file. Below is the Family Relation code list the donor provided for the FIPAS records. It is possible these code meanings may be applicable to the codes in the PAS_IRUK records. Code Meaning L Any In-Law A Aunt B Brother C Cousin D Daughter P Father Z Grandchild Y Grandparent H Husband M Mother N Niece or Nephew T Sister S Son F Stepdaughter G Stepson U Uncle W Wife NARA Reference Copy Italian Passenger Records Data File: embedded line feeds Staff found two records in the PAS_IT data file include embedded line feed characters (LF) in the TOWN field. The records appear on lines 855328 and 1152684 in the data file. These characters may cause an unexpected break in these records and so may need to be removed to avoid this issue. Italian Passenger Records Data File: some text fields populated with #NAME? Staff found 151 instances of the value #NAME? populating some fields in the PAS_IT file. There are 150 unique records affected. The value can appear in the following fields: LNAME, FNAME, TOWN, DEST_CITY, US_WHERE, REL2_NAME, REL2_ADDR, REL2_CITY. It is possible this may be the result of an error code generated by the software programs the donor used to create and maintain these records. It is not clear to staff why these values appear in these fields. Electronic Records Division, Reference Branch (RRER) Updated November 29, 2023 NARA Reference Copy NATIONAL ARCHIVES LIST OF DOCUMENTATION Ship Passenger Records, 1820-1912 Castle Garden Immigration Center Collection NN3-CGIC-22-001 I. NARA Documentation 1. List of Documentation 1 pg. 2. File List 1 pg. 3. User Note 2 pgs. 4. Supplemental User Note 1 pg. II. Donor-Created Documentation 1. Readme.doc 7 pgs. Total Pages 12 pgs. III. NARA Processing Materials 1. Automatic Verification of Electronic Records 2. AERIC Reports Prepared By: Sara Hawran, Archivist NATIONAL ARCHIVES and Date: December 7, 2021 RECORDS ADMINISTRATION Page 1 of 1 700 PENNSYLVANIA AVENUE. NW WASHINGTON, DC 20408-0001 www.archives.gov NARA Reference Copy NATIONAL A ARCHIVES AND RECORDS National Archives and Records Administration 8601 Adelphi Road 1985 College Park, Maryland 20740-6001 Theodore J. Hull NN3-CGIC-22-001 May 17, 2010 Ship Passenger Records, 1820-1912 Castle Garden Immigration Center Collection Initial Processing and Documentation: The four Ship Passenger Records data files (PAS_GS, IRUK, PAS_IT, and PAS_RS) were transferred to the National Archives and Records Administration as one table within MS Access databases. The remaining tables in each database were the Ship Manifest File (ALLHDRS) and 13 associated code tables. The files were saved from MSAccess as variable length ASCII text files, with pipe (|) field delimiters, and double quotation marks (") surrounding text fields. Note that the date field included in the Ship Manifest File was saved in Date/Time format (MM/DD/YYYY H.MM.SS). The donor supplied the documentation as an MSWord document. During archival processing, the donor supplied documentation was annotated to correct the record count for the PROVINCE code table, add a record count for the REGIONS table (N=20), and to indicate where three fields (RACE, TCODET, and TCDEST) appear in the record layout for three of the PAS_XX data files. The RACE, TCODET, and TCDEST fields are not included in the PAS_RS file. No code tables were provided by the donor for these three fields. The RACE field contains no values (NULL) in all four data files. NARA also did not receive the VILLAGE code table referenced in the donor supplied record layout. This code table is for the TCODE field. From manual review of the first 1,048,575 records in the PAS_GS data file, the TCODE field and TCODET field are both unique identifiers for the city / town / village identified in the TOWN field. However, whereas the TCODE field is populated in all records, the TCODET field may be NULL. TCODE can be used to identify variant spellings of the city / town / village identified in the TOWN field. Note that where TCODE is coded 24736 and TCODET is coded 3ZZZZ that the city / town / village identified in the TOWN field is Unknown. For the CDEST and TCDEST fields, they relate to the DEST_CITY field. CDEST can be used to identify variant spellings of the city / town in US identified in the DEST_CITY field. The CDEST in turn is translated in the DESTINATION code table. NARA prepared printouts of the codes tables ARR_PORTS, COLOR, COMPLEXION, COUNTRY, OCCUPATION, PORTS, PROVINCE, REGIONS, RELATION, TRANS_CODE, and TRAVEL_CODE. Because of the size of the DESTINATION and LAST_RES code tables, they were not printed. They were examined using the Automated Electronic Records Inspection and Control (AERIC) utility to verify that each code had a value associated with it. NARA's web site is http://www.archives.gov NARA Reference Copy Verification: The four Ship Passenger Records data files and Ship Manifest File were verified using the Automated Electronic Records Inspection and Control (AERIC) utility. AERIC rejected four records from loading on the PAS_IT file and the values appearing in some fields on the verification report indicate that a number of records did not load properly for verification. The AERIC reports retained among NARA Processing Materials can provide details on specific fields. The AERIC reports can provide details on specific fields. The following are some observations made about the various fields in the PAS_GS, PAS_IRUK, and PAS_RS data files based upon the detailed AERIC verifications. These comments generally apply to the PAS_IT file, but because of the load problems some additional erroneous results apply to that file as well: Age: a number of records contain negative numbers and values well over 100 Sex: valid codes are M, F, and U; the data also contains NULL, -, ?, G, H, f, and m. Marital: valid codes are M, S, W, and D; the data also contains NULL and U; note that this field contains only NULL in the PAS_IRUK and PAS_RS data files Literacy: valid codes are Y, N, and U; the data also contains NULL, -, ?, 0-9, A,C, D, E, F, G, H, I, J, K, L, M, O, P, R, S, T, W, [, ], n, and u. Relation_1: is coded 0 or NULL in all cases. Dest_State: is NULL in the PAS_IRUK data file Ticket: valid codes are Y and N; the data also contains NULL, -, 1, =, ?, ??, NY, U, and YN; note that this field contains only NULL in the PAS_IRUK data file and PAS_RS data files US Before: valid codes are Y and N; the data also contains NULL, -, ?, ??, ???, U, V, and YN; note that this field contains only NULL in the PAS_IRUK and PAS_RS data files To_Rel: valid codes are Y and N; the data also contains NULL and ?; note that this field contains only NULL in the PAS_IRUK and PAS_RS data files Complexion: the code for nine can be represented as 9 or 09; all other values are represented as two digit with a leading zero; note that this field contains only NULL in the PAS_IRUK and PAS_RS data files Hair_Color: the code table does not include values for LI, PA, or RE; note that this field contains only NULL in the PAS_IRUK and PAS_RS data files Eye_Color: the code table does not include values for BG, DRK, LGG, LIB, LIG, R, and Y-B; the data also contains NULL and ?; note that this field contains only NULL in the PAS_IRUK and PAS_RS data files Travel_Code: the code for nine can be represented as 9 or 09; the data also contains NULL and 1. Trans_Code: the data also contains NULL, #, L, U, c, and S. [12/10/2021 Note: Theodore Hull did preliminary processing on these records in 2010. At that time, these records were known under accession number 3-CIR-10-001 and the records were considered part of the Records of the Center for Immigration Research. When the deed of gift was signed in December 2021, the header of this User Note was updated to reflect its new accession number, NN3-CGIC-22-001, and the current collection title, the Castle Garden Immigration Center Collection. None of the content of the User Note was edited.] NARA's web site is http://www.archives.gov NARA Reference Copy NATIONAL ARCHIVES Supplemental User Note Ship Passenger Records, 1820-1912 Castle Garden Immigration Center Collection NN3-CGIC-22-001 The May 17, 2010 User Note indicates that the Microsoft Word documentation provided by the donor was printed out and annotated by Theodore Hull during initial processing. As of 2021 the annotated paper copy could not be located, although the original electronic file has been preserved in ERA 2.0 (readme.doc). Below I have attempted to recreate some of the annotations that may have existed on the paper copy, based on the information given in the original User Note: Corrected record count for the PROVINCE code table: 186 Record count for the REGIONS table: 20 Location of the three missing fields in the record layout (applies to all of the PAS_XX data files except PAS_RS): RACE: located right before PROVINCE TCODET: located right before TCODE TCDEST: located right before CDEST The 2010 User Note also references printouts of some of the code tables. These printouts were also not located in 2021. The code tables have been preserved electronically in ERA 2.0. Prepared By: Sara Hawran, Archivist NATIONAL ARCHIVES and Date: December 9, 2021 RECORDS ADMINISTRATION Page 1 of 1 8601 ADELPHI ROAD COLLEGE PARK. MD 20740-6001 www.archives.gov NARA Reference Copy

Document source description

This file unit contains records relating to passengers from the Russian Empire, Austria-Hungary, the Netherlands, Scandinavia, and the other countries of Europe.

Page data

Page
3
Source index
0
Type
document
Media ID
539e152bd3b3cef9
Size
unknown

Document data

ID
229630481
Core
doc
Type
document
DTO data
{
    "id": "229630481",
    "sourceUrl": "https://catalog.archives.gov/id/229630481",
    "contentType": "document",
    "title": "Records of Passengers from the Russian Empire, Austria-Hungary, the Netherlands, Scandinavia, and Other European Countries, ca. 1820 - ca. 1912",
    "description": "This file unit contains records relating to passengers from the Russian Empire, Austria-Hungary, the Netherlands, Scandinavia, and the other countries of Europe.",
    "citationUrl": "https://catalog.archives.gov/id/229630481",
    "collections": [
        "Castle Garden Immigration Center Collection",
        "Ship Passenger Records"
    ],
    "subjects": [
        "Austria-Hungary",
        "Netherlands",
        "Russia"
    ],
    "iiifBase": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/PAS_RS.txt",
    "thumbnailUrl": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/PAS_RS.txt",
    "largeImageUrl": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/PAS_RS.txt",
    "imageCount": 4,
    "hasImages": true,
    "source": "import",
    "hasTranscription": false
}

Context sent to Scholar

Document identity
{
    "localId": "229630481",
    "label": "Records of Passengers from the Russian Empire, Austria-Hungary, the Netherlands, Scandinavia, and Other European Countries, ca. 1820 - ca. 1912",
    "core": "doc",
    "dtoType": "document",
    "citationUrl": "https://catalog.archives.gov/id/229630481"
}
Document source metadata
{
    "id": "229630481",
    "sourceUrl": "https://catalog.archives.gov/id/229630481",
    "contentType": "document",
    "title": "Records of Passengers from the Russian Empire, Austria-Hungary, the Netherlands, Scandinavia, and Other European Countries, ca. 1820 - ca. 1912",
    "description": "This file unit contains records relating to passengers from the Russian Empire, Austria-Hungary, the Netherlands, Scandinavia, and the other countries of Europe.",
    "citationUrl": "https://catalog.archives.gov/id/229630481",
    "collections": [
        "Castle Garden Immigration Center Collection",
        "Ship Passenger Records"
    ],
    "subjects": [
        "Austria-Hungary",
        "Netherlands",
        "Russia"
    ],
    "iiifBase": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/PAS_RS.txt",
    "thumbnailUrl": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/PAS_RS.txt",
    "largeImageUrl": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/PAS_RS.txt",
    "imageCount": 4,
    "hasImages": true,
    "source": "import",
    "hasTranscription": false
}
Document source extras
{
    "url": "https://catalog.archives.gov/id/229630481",
    "naId": 229630481,
    "levelOfDescription": "fileUnit",
    "onlineResources": [
        {
            "description": "Access to Archival Databases (AAD) System",
            "note": "These electronic records can be searched online via the Access to Archival Databases (AAD) System.",
            "url": "https://aad.archives.gov/aad/series-description.jsp?s=5218&cat=GP44&bc=,sl&col=1288"
        }
    ],
    "recordType": "description",
    "ocrSource": "nara-archive"
}
Page context
{
    "seq": 3,
    "pageIndex": 0,
    "type": "document",
    "url": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/682_1-4ND.pdf",
    "mediaId": "539e152bd3b3cef9",
    "ocrText": "NATIONAL\nARCHIVES\nSUPPLEMENTAL USER NOTE 3:\nDiacritics and character encodings issues\nShip Passenger Records, 1820-1912\nCastle Garden Immigration Center Collection\nNN3-CGIC-22-001\nStaff found that some records in the German (PAS_GS), Irish and United Kingdom\n(PAS_IRUK), and Italian (PAS_IT) passenger records files can contain some diacritic characters\nor other special characters that may not display correctly depending on the character encoding\nsetting in use.\nFor example, in the record appearing on line 4649398 in the German passenger file, the last\nname appears as \"GZRTNER\" when viewed in US-ASCII. However, the name appears as\n\"GÄRTNER\" when viewed in an ANSI display mode. Alternatively, some diacritic characters\nappear to display correctly in an US-ASCII display mode. For example, on line 4441927, the\nfirst name appears as \"THÖN\" in ASCII. This name displays as \"THIN\" when viewed in ANSI\nmode. It is not clear to staff which representation of this name may be correct.\nAdditional examples:\nFile\nLine#\nASCII mode\nANSI mode\nPAS IT\n154469\nBERNIéRE\nBERNIURE\n171285\nBILà\nBILO\nPAS GS\n4449699\nÜOLME\n.OLME\n4649416\nSCHTMNAU\nSCHÖNAU\nUnfortunately, due to these discrepancies, staff could not determine the appropriate character\nencoding that should be used for the German and Italian passenger record files. Researchers may\nwant to replace any diacritic character known to be used in a name with a wildcard character\nwhen searching for specific persons or places in the records.\nThe diacritic characters staff identified in the Irish/UK passenger record file appear to display\ncorrectly in ASCII. However, it is possible staff did not identify all diacritic characters present in\nthe file and so some text fields may have similar issues as found in the German and Italian files.\nThe Russian passenger file (PAS_RS) does not appear to contain diacritic characters. However,\nit is again possible staff simply did not identify any such characters in our searches.\nElectronic Records Division, Reference Branch (RRER)\nSeptember 30, 2022\nNATIONAL ARCHIVES and\nRECORDS ADMINISTRATION\n8601 ADELPHI ROAD\nCOLLEGE PARK, MD 20740-6001\nwww.archives.gov\nNARA Reference Copy\nNATIONAL\nARCHIVES\nSUPPLEMENTAL USER NOTE 2\nShip Passenger Records, 1820-1912\nCastle Garden Immigration Center Collection\nNN3-CGIC-22-001\nVILLAGE codes\nThe donor-provided Readme (readme.doc) references a VILLAGE table that contains town\ncodes for the field TCODE. During initial processing, staff noted the donor did not transfer the\nVILLAGE code table. Upon later review of the code tables, staff identified a VILLAGE field\nname in the LAST_RES code table. The donor layout does not associate any coded fields with a\ncode table named \"LAST_RES.\" However, when staff linked the key field in this code table to\nthe TCODE field in the passenger files (PAS_XX), the returned VILLAGE values appeared to\nbe accurate for the records when comparing against other information in the record, specifically\nthe value in the TOWN field, though there may be minor spelling differences. For this reason,\nstaff believe the LAST_RES table can be used to return appropriate values for the TCODE field.\nFirst names in Irish and United Kingdom Passenger Data File\nThe data file PAS_IRUK_NSTR.txt (PAS_IRUK) includes updated versions of passenger\nrecords first transferred to NARA in the file FIPAS (RG200.FAMIR.Y4651; XMIS 003584).\nFIPAS is described in the series, \"Records for Passengers who Arrived at the Port of New York\nduring the Irish Famine, 1977 - 1989\" (National Archives Identifier 569666).\nIn FIPAS, the passenger records include the field FAMILY RELATION CODE. The agency-\nprepared layout (IRISH.README) indicates this field should appear at file position 41.\nHowever, staff found that in the data these values appear in file position 21, which is identified\nas a FILLER field in the agency layout. In the data file, file position 41 is blank in all the\nrecords. File position 21 (Filler/Family Relation Code) is populated in 27,101 of the records.\nWhen comparing records found in FIPAS to the records for the same individual¹ in PAS_IRUK,\nstaff found that the first names in 10,622 records are preceded with what appears to be a Family\nRelation Code. For example, in FIPAS, there is a record for a Margaret McCabe, age 8, with ship\nmanifest 711 (see data record on line 44). In this record, file position 21 (Filler/Family Relation\n1 There are no unique identifiers shared between the passenger data files. Staff compared the full records from both\ndata files for a given name to determine if the records are for the same individual.\nNATIONAL ARCHIVES and\nRECORDS ADMINISTRATION\n8601 ADELPHI ROAD\nCOLLEGE PARK, MD 20740-6001\nwww.archives.gov\nNARA Reference Copy\nCode) contains the value \"D\". In PAS_IRUK, there is no record for a Margaret McCabe with this\ninformation. There is, however, a record for a Dmargaret McCabe, age 8, ship manifest 771 (see\ndata record on line 17,605). Upon further investigation, staff identified 10,622 records in\nPAS_IRUK in which a family relation code appears as the first character in the First Name field\nbased on similarly matching records in the FIPAS file.\nSee the NARA-prepared documentation file PAS_IRUK_NARAIdentifiedRecords.txt for an\nextract of the set of 10,622 records identified by staff. Staff added the field \"file_line\" as the first\n(left-most) column, which indicates the line number on which the record appears in the original\ndata file. The extract file is in ASCII, with pipe-delimited (|) fields enclosed with quotations (\"),\nwith record-delimited records (CR/LF). For researchers interested in creating a corrected version\nof the PAS_IRUK file, keep in mind the original PAS_IRUK records do not include fields\ncontaining line numbers or unique identifiers for the individual records. The line numbers\nprovided for the records in the NARA-prepared extract refer to the original ordering of the\nrecords in the PAS_IRUK data file.\nBelow is the Family Relation code list the donor provided for the FIPAS records. It is possible\nthese code meanings may be applicable to the codes in the PAS_IRUK records.\nCode\nMeaning\nL\nAny In-Law\nA\nAunt\nB\nBrother\nC\nCousin\nD\nDaughter\nP\nFather\nZ\nGrandchild\nY\nGrandparent\nH\nHusband\nM\nMother\nN\nNiece or Nephew\nT\nSister\nS\nSon\nF\nStepdaughter\nG\nStepson\nU\nUncle\nW\nWife\nNARA Reference Copy\nItalian Passenger Records Data File: embedded line feeds\nStaff found two records in the PAS_IT data file include embedded line feed characters (LF) in\nthe TOWN field. The records appear on lines 855328 and 1152684 in the data file. These\ncharacters may cause an unexpected break in these records and so may need to be removed to\navoid this issue.\nItalian Passenger Records Data File: some text fields populated with #NAME?\nStaff found 151 instances of the value #NAME? populating some fields in the PAS_IT file.\nThere are 150 unique records affected. The value can appear in the following fields: LNAME,\nFNAME, TOWN, DEST_CITY, US_WHERE, REL2_NAME, REL2_ADDR, REL2_CITY. It is\npossible this may be the result of an error code generated by the software programs the donor\nused to create and maintain these records. It is not clear to staff why these values appear in these\nfields.\nElectronic Records Division, Reference Branch (RRER)\nUpdated November 29, 2023\nNARA Reference Copy\nNATIONAL\nARCHIVES\nLIST OF DOCUMENTATION\nShip Passenger Records, 1820-1912\nCastle Garden Immigration Center Collection\nNN3-CGIC-22-001\nI.\nNARA Documentation\n1. List of Documentation\n1 pg.\n2. File List\n1 pg.\n3. User Note\n2 pgs.\n4. Supplemental User Note\n1 pg.\nII.\nDonor-Created Documentation\n1. Readme.doc\n7 pgs.\nTotal Pages\n12 pgs.\nIII.\nNARA Processing Materials\n1. Automatic Verification of Electronic Records\n2. AERIC Reports\nPrepared By: Sara Hawran, Archivist\nNATIONAL ARCHIVES and\nDate: December 7, 2021\nRECORDS ADMINISTRATION\nPage 1 of 1\n700 PENNSYLVANIA AVENUE. NW\nWASHINGTON, DC 20408-0001\nwww.archives.gov\nNARA Reference Copy\nNATIONAL A ARCHIVES AND RECORDS\nNational Archives and Records Administration\n8601 Adelphi Road\n1985\nCollege Park, Maryland 20740-6001\nTheodore J. Hull\nNN3-CGIC-22-001\nMay 17, 2010\nShip Passenger Records, 1820-1912\nCastle Garden Immigration Center Collection\nInitial Processing and Documentation: The four Ship Passenger Records data files (PAS_GS,\nIRUK, PAS_IT, and PAS_RS) were transferred to the National Archives and Records\nAdministration as one table within MS Access databases. The remaining tables in each database were\nthe Ship Manifest File (ALLHDRS) and 13 associated code tables. The files were saved from MSAccess\nas variable length ASCII text files, with pipe (|) field delimiters, and double quotation marks (\")\nsurrounding text fields. Note that the date field included in the Ship Manifest File was saved in\nDate/Time format (MM/DD/YYYY H.MM.SS).\nThe donor supplied the documentation as an MSWord document. During archival processing, the donor\nsupplied documentation was annotated to correct the record count for the PROVINCE code table, add a\nrecord count for the REGIONS table (N=20), and to indicate where three fields (RACE, TCODET, and\nTCDEST) appear in the record layout for three of the PAS_XX data files. The RACE, TCODET, and\nTCDEST fields are not included in the PAS_RS file. No code tables were provided by the donor for\nthese three fields. The RACE field contains no values (NULL) in all four data files.\nNARA also did not receive the VILLAGE code table referenced in the donor supplied record layout.\nThis code table is for the TCODE field. From manual review of the first 1,048,575 records in the\nPAS_GS data file, the TCODE field and TCODET field are both unique identifiers for the city / town /\nvillage identified in the TOWN field. However, whereas the TCODE field is populated in all records,\nthe TCODET field may be NULL. TCODE can be used to identify variant spellings of the city / town /\nvillage identified in the TOWN field. Note that where TCODE is coded 24736 and TCODET is coded\n3ZZZZ that the city / town / village identified in the TOWN field is Unknown.\nFor the CDEST and TCDEST fields, they relate to the DEST_CITY field. CDEST can be used to\nidentify variant spellings of the city / town in US identified in the DEST_CITY field. The CDEST in\nturn is translated in the DESTINATION code table.\nNARA prepared printouts of the codes tables ARR_PORTS, COLOR, COMPLEXION, COUNTRY,\nOCCUPATION, PORTS, PROVINCE, REGIONS, RELATION, TRANS_CODE, and TRAVEL_CODE.\nBecause of the size of the DESTINATION and LAST_RES code tables, they were not printed. They\nwere examined using the Automated Electronic Records Inspection and Control (AERIC) utility to\nverify that each code had a value associated with it.\nNARA's web site is http://www.archives.gov\nNARA Reference Copy\nVerification: The four Ship Passenger Records data files and Ship Manifest File were verified using the\nAutomated Electronic Records Inspection and Control (AERIC) utility. AERIC rejected four records\nfrom loading on the PAS_IT file and the values appearing in some fields on the verification report\nindicate that a number of records did not load properly for verification. The AERIC reports retained\namong NARA Processing Materials can provide details on specific fields. The AERIC reports can\nprovide details on specific fields. The following are some observations made about the various fields in\nthe PAS_GS, PAS_IRUK, and PAS_RS data files based upon the detailed AERIC verifications. These\ncomments generally apply to the PAS_IT file, but because of the load problems some additional\nerroneous results apply to that file as well:\nAge: a number of records contain negative numbers and values well over 100\nSex: valid codes are M, F, and U; the data also contains NULL, -, ?, G, H, f, and m.\nMarital: valid codes are M, S, W, and D; the data also contains NULL and U; note that this field\ncontains only NULL in the PAS_IRUK and PAS_RS data files\nLiteracy: valid codes are Y, N, and U; the data also contains NULL, -, ?, 0-9, A,C, D, E, F, G, H,\nI, J, K, L, M, O, P, R, S, T, W, [, ], n, and u.\nRelation_1: is coded 0 or NULL in all cases.\nDest_State: is NULL in the PAS_IRUK data file\nTicket: valid codes are Y and N; the data also contains NULL, -, 1, =, ?, ??, NY, U, and YN; note\nthat this field contains only NULL in the PAS_IRUK data file and PAS_RS data files\nUS Before: valid codes are Y and N; the data also contains NULL, -, ?, ??, ???, U, V, and YN;\nnote that this field contains only NULL in the PAS_IRUK and PAS_RS data files\nTo_Rel: valid codes are Y and N; the data also contains NULL and ?; note that this field\ncontains only NULL in the PAS_IRUK and PAS_RS data files\nComplexion: the code for nine can be represented as 9 or 09; all other values are represented as\ntwo digit with a leading zero; note that this field contains only NULL in the PAS_IRUK and\nPAS_RS data files\nHair_Color: the code table does not include values for LI, PA, or RE; note that this field contains\nonly NULL in the PAS_IRUK and PAS_RS data files\nEye_Color: the code table does not include values for BG, DRK, LGG, LIB, LIG, R, and Y-B;\nthe data also contains NULL and ?; note that this field contains only NULL in the PAS_IRUK\nand PAS_RS data files\nTravel_Code: the code for nine can be represented as 9 or 09; the data also contains NULL and\n1.\nTrans_Code: the data also contains NULL, #, L, U, c, and S.\n[12/10/2021 Note: Theodore Hull did preliminary processing on these records in 2010. At that time,\nthese records were known under accession number 3-CIR-10-001 and the records were considered part\nof the Records of the Center for Immigration Research. When the deed of gift was signed in December\n2021, the header of this User Note was updated to reflect its new accession number, NN3-CGIC-22-001,\nand the current collection title, the Castle Garden Immigration Center Collection. None of the content of\nthe User Note was edited.]\nNARA's web site is http://www.archives.gov\nNARA Reference Copy\nNATIONAL\nARCHIVES\nSupplemental User Note\nShip Passenger Records, 1820-1912\nCastle Garden Immigration Center Collection\nNN3-CGIC-22-001\nThe May 17, 2010 User Note indicates that the Microsoft Word documentation provided by the\ndonor was printed out and annotated by Theodore Hull during initial processing. As of 2021 the\nannotated paper copy could not be located, although the original electronic file has been\npreserved in ERA 2.0 (readme.doc). Below I have attempted to recreate some of the annotations\nthat may have existed on the paper copy, based on the information given in the original User\nNote:\nCorrected record count for the PROVINCE code table: 186\nRecord count for the REGIONS table: 20\nLocation of the three missing fields in the record layout (applies to all of the PAS_XX\ndata files except PAS_RS):\nRACE: located right before PROVINCE\nTCODET: located right before TCODE\nTCDEST: located right before CDEST\nThe 2010 User Note also references printouts of some of the code tables. These printouts were\nalso not located in 2021. The code tables have been preserved electronically in ERA 2.0.\nPrepared By: Sara Hawran, Archivist\nNATIONAL ARCHIVES and\nDate: December 9, 2021\nRECORDS ADMINISTRATION\nPage 1 of 1\n8601 ADELPHI ROAD\nCOLLEGE PARK. MD 20740-6001\nwww.archives.gov\nNARA Reference Copy"
}