Ask the Scholar
Page 3 of 4
I can add historical knowledge about this page.
Page image
OCR
NATIONAL
ARCHIVES
SUPPLEMENTAL USER NOTE 3:
Diacritics and character encodings issues
Ship Passenger Records, 1820-1912
Castle Garden Immigration Center Collection
NN3-CGIC-22-001
Staff found that some records in the German (PAS_GS), Irish and United Kingdom
(PAS_IRUK), and Italian (PAS_IT) passenger records files can contain some diacritic characters
or other special characters that may not display correctly depending on the character encoding
setting in use.
For example, in the record appearing on line 4649398 in the German passenger file, the last
name appears as "GZRTNER" when viewed in US-ASCII. However, the name appears as
"GÄRTNER" when viewed in an ANSI display mode. Alternatively, some diacritic characters
appear to display correctly in an US-ASCII display mode. For example, on line 4441927, the
first name appears as "THÖN" in ASCII. This name displays as "THIN" when viewed in ANSI
mode. It is not clear to staff which representation of this name may be correct.
Additional examples:
File
Line#
ASCII mode
ANSI mode
PAS IT
154469
BERNIéRE
BERNIURE
171285
BILà
BILO
PAS GS
4449699
ÜOLME
.OLME
4649416
SCHTMNAU
SCHÖNAU
Unfortunately, due to these discrepancies, staff could not determine the appropriate character
encoding that should be used for the German and Italian passenger record files. Researchers may
want to replace any diacritic character known to be used in a name with a wildcard character
when searching for specific persons or places in the records.
The diacritic characters staff identified in the Irish/UK passenger record file appear to display
correctly in ASCII. However, it is possible staff did not identify all diacritic characters present in
the file and so some text fields may have similar issues as found in the German and Italian files.
The Russian passenger file (PAS_RS) does not appear to contain diacritic characters. However,
it is again possible staff simply did not identify any such characters in our searches.
Electronic Records Division, Reference Branch (RRER)
September 30, 2022
NATIONAL ARCHIVES and
RECORDS ADMINISTRATION
8601 ADELPHI ROAD
COLLEGE PARK, MD 20740-6001
www.archives.gov
NARA Reference Copy
NATIONAL
ARCHIVES
SUPPLEMENTAL USER NOTE 2
Ship Passenger Records, 1820-1912
Castle Garden Immigration Center Collection
NN3-CGIC-22-001
VILLAGE codes
The donor-provided Readme (readme.doc) references a VILLAGE table that contains town
codes for the field TCODE. During initial processing, staff noted the donor did not transfer the
VILLAGE code table. Upon later review of the code tables, staff identified a VILLAGE field
name in the LAST_RES code table. The donor layout does not associate any coded fields with a
code table named "LAST_RES." However, when staff linked the key field in this code table to
the TCODE field in the passenger files (PAS_XX), the returned VILLAGE values appeared to
be accurate for the records when comparing against other information in the record, specifically
the value in the TOWN field, though there may be minor spelling differences. For this reason,
staff believe the LAST_RES table can be used to return appropriate values for the TCODE field.
First names in Irish and United Kingdom Passenger Data File
The data file PAS_IRUK_NSTR.txt (PAS_IRUK) includes updated versions of passenger
records first transferred to NARA in the file FIPAS (RG200.FAMIR.Y4651; XMIS 003584).
FIPAS is described in the series, "Records for Passengers who Arrived at the Port of New York
during the Irish Famine, 1977 - 1989" (National Archives Identifier 569666).
In FIPAS, the passenger records include the field FAMILY RELATION CODE. The agency-
prepared layout (IRISH.README) indicates this field should appear at file position 41.
However, staff found that in the data these values appear in file position 21, which is identified
as a FILLER field in the agency layout. In the data file, file position 41 is blank in all the
records. File position 21 (Filler/Family Relation Code) is populated in 27,101 of the records.
When comparing records found in FIPAS to the records for the same individual¹ in PAS_IRUK,
staff found that the first names in 10,622 records are preceded with what appears to be a Family
Relation Code. For example, in FIPAS, there is a record for a Margaret McCabe, age 8, with ship
manifest 711 (see data record on line 44). In this record, file position 21 (Filler/Family Relation
1 There are no unique identifiers shared between the passenger data files. Staff compared the full records from both
data files for a given name to determine if the records are for the same individual.
NATIONAL ARCHIVES and
RECORDS ADMINISTRATION
8601 ADELPHI ROAD
COLLEGE PARK, MD 20740-6001
www.archives.gov
NARA Reference Copy
Code) contains the value "D". In PAS_IRUK, there is no record for a Margaret McCabe with this
information. There is, however, a record for a Dmargaret McCabe, age 8, ship manifest 771 (see
data record on line 17,605). Upon further investigation, staff identified 10,622 records in
PAS_IRUK in which a family relation code appears as the first character in the First Name field
based on similarly matching records in the FIPAS file.
See the NARA-prepared documentation file PAS_IRUK_NARAIdentifiedRecords.txt for an
extract of the set of 10,622 records identified by staff. Staff added the field "file_line" as the first
(left-most) column, which indicates the line number on which the record appears in the original
data file. The extract file is in ASCII, with pipe-delimited (|) fields enclosed with quotations ("),
with record-delimited records (CR/LF). For researchers interested in creating a corrected version
of the PAS_IRUK file, keep in mind the original PAS_IRUK records do not include fields
containing line numbers or unique identifiers for the individual records. The line numbers
provided for the records in the NARA-prepared extract refer to the original ordering of the
records in the PAS_IRUK data file.
Below is the Family Relation code list the donor provided for the FIPAS records. It is possible
these code meanings may be applicable to the codes in the PAS_IRUK records.
Code
Meaning
L
Any In-Law
A
Aunt
B
Brother
C
Cousin
D
Daughter
P
Father
Z
Grandchild
Y
Grandparent
H
Husband
M
Mother
N
Niece or Nephew
T
Sister
S
Son
F
Stepdaughter
G
Stepson
U
Uncle
W
Wife
NARA Reference Copy
Italian Passenger Records Data File: embedded line feeds
Staff found two records in the PAS_IT data file include embedded line feed characters (LF) in
the TOWN field. The records appear on lines 855328 and 1152684 in the data file. These
characters may cause an unexpected break in these records and so may need to be removed to
avoid this issue.
Italian Passenger Records Data File: some text fields populated with #NAME?
Staff found 151 instances of the value #NAME? populating some fields in the PAS_IT file.
There are 150 unique records affected. The value can appear in the following fields: LNAME,
FNAME, TOWN, DEST_CITY, US_WHERE, REL2_NAME, REL2_ADDR, REL2_CITY. It is
possible this may be the result of an error code generated by the software programs the donor
used to create and maintain these records. It is not clear to staff why these values appear in these
fields.
Electronic Records Division, Reference Branch (RRER)
Updated November 29, 2023
NARA Reference Copy
NATIONAL
ARCHIVES
LIST OF DOCUMENTATION
Ship Passenger Records, 1820-1912
Castle Garden Immigration Center Collection
NN3-CGIC-22-001
I.
NARA Documentation
1. List of Documentation
1 pg.
2. File List
1 pg.
3. User Note
2 pgs.
4. Supplemental User Note
1 pg.
II.
Donor-Created Documentation
1. Readme.doc
7 pgs.
Total Pages
12 pgs.
III.
NARA Processing Materials
1. Automatic Verification of Electronic Records
2. AERIC Reports
Prepared By: Sara Hawran, Archivist
NATIONAL ARCHIVES and
Date: December 7, 2021
RECORDS ADMINISTRATION
Page 1 of 1
700 PENNSYLVANIA AVENUE. NW
WASHINGTON, DC 20408-0001
www.archives.gov
NARA Reference Copy
NATIONAL A ARCHIVES AND RECORDS
National Archives and Records Administration
8601 Adelphi Road
1985
College Park, Maryland 20740-6001
Theodore J. Hull
NN3-CGIC-22-001
May 17, 2010
Ship Passenger Records, 1820-1912
Castle Garden Immigration Center Collection
Initial Processing and Documentation: The four Ship Passenger Records data files (PAS_GS,
IRUK, PAS_IT, and PAS_RS) were transferred to the National Archives and Records
Administration as one table within MS Access databases. The remaining tables in each database were
the Ship Manifest File (ALLHDRS) and 13 associated code tables. The files were saved from MSAccess
as variable length ASCII text files, with pipe (|) field delimiters, and double quotation marks (")
surrounding text fields. Note that the date field included in the Ship Manifest File was saved in
Date/Time format (MM/DD/YYYY H.MM.SS).
The donor supplied the documentation as an MSWord document. During archival processing, the donor
supplied documentation was annotated to correct the record count for the PROVINCE code table, add a
record count for the REGIONS table (N=20), and to indicate where three fields (RACE, TCODET, and
TCDEST) appear in the record layout for three of the PAS_XX data files. The RACE, TCODET, and
TCDEST fields are not included in the PAS_RS file. No code tables were provided by the donor for
these three fields. The RACE field contains no values (NULL) in all four data files.
NARA also did not receive the VILLAGE code table referenced in the donor supplied record layout.
This code table is for the TCODE field. From manual review of the first 1,048,575 records in the
PAS_GS data file, the TCODE field and TCODET field are both unique identifiers for the city / town /
village identified in the TOWN field. However, whereas the TCODE field is populated in all records,
the TCODET field may be NULL. TCODE can be used to identify variant spellings of the city / town /
village identified in the TOWN field. Note that where TCODE is coded 24736 and TCODET is coded
3ZZZZ that the city / town / village identified in the TOWN field is Unknown.
For the CDEST and TCDEST fields, they relate to the DEST_CITY field. CDEST can be used to
identify variant spellings of the city / town in US identified in the DEST_CITY field. The CDEST in
turn is translated in the DESTINATION code table.
NARA prepared printouts of the codes tables ARR_PORTS, COLOR, COMPLEXION, COUNTRY,
OCCUPATION, PORTS, PROVINCE, REGIONS, RELATION, TRANS_CODE, and TRAVEL_CODE.
Because of the size of the DESTINATION and LAST_RES code tables, they were not printed. They
were examined using the Automated Electronic Records Inspection and Control (AERIC) utility to
verify that each code had a value associated with it.
NARA's web site is http://www.archives.gov
NARA Reference Copy
Verification: The four Ship Passenger Records data files and Ship Manifest File were verified using the
Automated Electronic Records Inspection and Control (AERIC) utility. AERIC rejected four records
from loading on the PAS_IT file and the values appearing in some fields on the verification report
indicate that a number of records did not load properly for verification. The AERIC reports retained
among NARA Processing Materials can provide details on specific fields. The AERIC reports can
provide details on specific fields. The following are some observations made about the various fields in
the PAS_GS, PAS_IRUK, and PAS_RS data files based upon the detailed AERIC verifications. These
comments generally apply to the PAS_IT file, but because of the load problems some additional
erroneous results apply to that file as well:
Age: a number of records contain negative numbers and values well over 100
Sex: valid codes are M, F, and U; the data also contains NULL, -, ?, G, H, f, and m.
Marital: valid codes are M, S, W, and D; the data also contains NULL and U; note that this field
contains only NULL in the PAS_IRUK and PAS_RS data files
Literacy: valid codes are Y, N, and U; the data also contains NULL, -, ?, 0-9, A,C, D, E, F, G, H,
I, J, K, L, M, O, P, R, S, T, W, [, ], n, and u.
Relation_1: is coded 0 or NULL in all cases.
Dest_State: is NULL in the PAS_IRUK data file
Ticket: valid codes are Y and N; the data also contains NULL, -, 1, =, ?, ??, NY, U, and YN; note
that this field contains only NULL in the PAS_IRUK data file and PAS_RS data files
US Before: valid codes are Y and N; the data also contains NULL, -, ?, ??, ???, U, V, and YN;
note that this field contains only NULL in the PAS_IRUK and PAS_RS data files
To_Rel: valid codes are Y and N; the data also contains NULL and ?; note that this field
contains only NULL in the PAS_IRUK and PAS_RS data files
Complexion: the code for nine can be represented as 9 or 09; all other values are represented as
two digit with a leading zero; note that this field contains only NULL in the PAS_IRUK and
PAS_RS data files
Hair_Color: the code table does not include values for LI, PA, or RE; note that this field contains
only NULL in the PAS_IRUK and PAS_RS data files
Eye_Color: the code table does not include values for BG, DRK, LGG, LIB, LIG, R, and Y-B;
the data also contains NULL and ?; note that this field contains only NULL in the PAS_IRUK
and PAS_RS data files
Travel_Code: the code for nine can be represented as 9 or 09; the data also contains NULL and
1.
Trans_Code: the data also contains NULL, #, L, U, c, and S.
[12/10/2021 Note: Theodore Hull did preliminary processing on these records in 2010. At that time,
these records were known under accession number 3-CIR-10-001 and the records were considered part
of the Records of the Center for Immigration Research. When the deed of gift was signed in December
2021, the header of this User Note was updated to reflect its new accession number, NN3-CGIC-22-001,
and the current collection title, the Castle Garden Immigration Center Collection. None of the content of
the User Note was edited.]
NARA's web site is http://www.archives.gov
NARA Reference Copy
NATIONAL
ARCHIVES
Supplemental User Note
Ship Passenger Records, 1820-1912
Castle Garden Immigration Center Collection
NN3-CGIC-22-001
The May 17, 2010 User Note indicates that the Microsoft Word documentation provided by the
donor was printed out and annotated by Theodore Hull during initial processing. As of 2021 the
annotated paper copy could not be located, although the original electronic file has been
preserved in ERA 2.0 (readme.doc). Below I have attempted to recreate some of the annotations
that may have existed on the paper copy, based on the information given in the original User
Note:
Corrected record count for the PROVINCE code table: 186
Record count for the REGIONS table: 20
Location of the three missing fields in the record layout (applies to all of the PAS_XX
data files except PAS_RS):
RACE: located right before PROVINCE
TCODET: located right before TCODE
TCDEST: located right before CDEST
The 2010 User Note also references printouts of some of the code tables. These printouts were
also not located in 2021. The code tables have been preserved electronically in ERA 2.0.
Prepared By: Sara Hawran, Archivist
NATIONAL ARCHIVES and
Date: December 9, 2021
RECORDS ADMINISTRATION
Page 1 of 1
8601 ADELPHI ROAD
COLLEGE PARK. MD 20740-6001
www.archives.gov
NARA Reference Copy
Document source description
This file unit contains records relating to passengers from the Russian Empire, Austria-Hungary, the Netherlands, Scandinavia, and the other countries of Europe.
Page data
- Page
- 3
- Source index
- 0
- Type
- document
- Media ID
- 539e152bd3b3cef9
- Size
- unknown
Document data
- ID
- 229630481
- Core
- doc
- Type
- document
DTO data
{
"id": "229630481",
"sourceUrl": "https://catalog.archives.gov/id/229630481",
"contentType": "document",
"title": "Records of Passengers from the Russian Empire, Austria-Hungary, the Netherlands, Scandinavia, and Other European Countries, ca. 1820 - ca. 1912",
"description": "This file unit contains records relating to passengers from the Russian Empire, Austria-Hungary, the Netherlands, Scandinavia, and the other countries of Europe.",
"citationUrl": "https://catalog.archives.gov/id/229630481",
"collections": [
"Castle Garden Immigration Center Collection",
"Ship Passenger Records"
],
"subjects": [
"Austria-Hungary",
"Netherlands",
"Russia"
],
"iiifBase": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/PAS_RS.txt",
"thumbnailUrl": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/PAS_RS.txt",
"largeImageUrl": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/PAS_RS.txt",
"imageCount": 4,
"hasImages": true,
"source": "import",
"hasTranscription": false
}
Context sent to Scholar
Document identity
{
"localId": "229630481",
"label": "Records of Passengers from the Russian Empire, Austria-Hungary, the Netherlands, Scandinavia, and Other European Countries, ca. 1820 - ca. 1912",
"core": "doc",
"dtoType": "document",
"citationUrl": "https://catalog.archives.gov/id/229630481"
}
Document source metadata
{
"id": "229630481",
"sourceUrl": "https://catalog.archives.gov/id/229630481",
"contentType": "document",
"title": "Records of Passengers from the Russian Empire, Austria-Hungary, the Netherlands, Scandinavia, and Other European Countries, ca. 1820 - ca. 1912",
"description": "This file unit contains records relating to passengers from the Russian Empire, Austria-Hungary, the Netherlands, Scandinavia, and the other countries of Europe.",
"citationUrl": "https://catalog.archives.gov/id/229630481",
"collections": [
"Castle Garden Immigration Center Collection",
"Ship Passenger Records"
],
"subjects": [
"Austria-Hungary",
"Netherlands",
"Russia"
],
"iiifBase": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/PAS_RS.txt",
"thumbnailUrl": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/PAS_RS.txt",
"largeImageUrl": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/PAS_RS.txt",
"imageCount": 4,
"hasImages": true,
"source": "import",
"hasTranscription": false
}
Document source extras
{
"url": "https://catalog.archives.gov/id/229630481",
"naId": 229630481,
"levelOfDescription": "fileUnit",
"onlineResources": [
{
"description": "Access to Archival Databases (AAD) System",
"note": "These electronic records can be searched online via the Access to Archival Databases (AAD) System.",
"url": "https://aad.archives.gov/aad/series-description.jsp?s=5218&cat=GP44&bc=,sl&col=1288"
}
],
"recordType": "description",
"ocrSource": "nara-archive"
}
Page context
{
"seq": 3,
"pageIndex": 0,
"type": "document",
"url": "https://s3.amazonaws.com/NARAprodstorage/lz/electronic-records/CGIC/PAS/682_1-4ND.pdf",
"mediaId": "539e152bd3b3cef9",
"ocrText": "NATIONAL\nARCHIVES\nSUPPLEMENTAL USER NOTE 3:\nDiacritics and character encodings issues\nShip Passenger Records, 1820-1912\nCastle Garden Immigration Center Collection\nNN3-CGIC-22-001\nStaff found that some records in the German (PAS_GS), Irish and United Kingdom\n(PAS_IRUK), and Italian (PAS_IT) passenger records files can contain some diacritic characters\nor other special characters that may not display correctly depending on the character encoding\nsetting in use.\nFor example, in the record appearing on line 4649398 in the German passenger file, the last\nname appears as \"GZRTNER\" when viewed in US-ASCII. However, the name appears as\n\"GÄRTNER\" when viewed in an ANSI display mode. Alternatively, some diacritic characters\nappear to display correctly in an US-ASCII display mode. For example, on line 4441927, the\nfirst name appears as \"THÖN\" in ASCII. This name displays as \"THIN\" when viewed in ANSI\nmode. It is not clear to staff which representation of this name may be correct.\nAdditional examples:\nFile\nLine#\nASCII mode\nANSI mode\nPAS IT\n154469\nBERNIéRE\nBERNIURE\n171285\nBILà\nBILO\nPAS GS\n4449699\nÜOLME\n.OLME\n4649416\nSCHTMNAU\nSCHÖNAU\nUnfortunately, due to these discrepancies, staff could not determine the appropriate character\nencoding that should be used for the German and Italian passenger record files. Researchers may\nwant to replace any diacritic character known to be used in a name with a wildcard character\nwhen searching for specific persons or places in the records.\nThe diacritic characters staff identified in the Irish/UK passenger record file appear to display\ncorrectly in ASCII. However, it is possible staff did not identify all diacritic characters present in\nthe file and so some text fields may have similar issues as found in the German and Italian files.\nThe Russian passenger file (PAS_RS) does not appear to contain diacritic characters. However,\nit is again possible staff simply did not identify any such characters in our searches.\nElectronic Records Division, Reference Branch (RRER)\nSeptember 30, 2022\nNATIONAL ARCHIVES and\nRECORDS ADMINISTRATION\n8601 ADELPHI ROAD\nCOLLEGE PARK, MD 20740-6001\nwww.archives.gov\nNARA Reference Copy\nNATIONAL\nARCHIVES\nSUPPLEMENTAL USER NOTE 2\nShip Passenger Records, 1820-1912\nCastle Garden Immigration Center Collection\nNN3-CGIC-22-001\nVILLAGE codes\nThe donor-provided Readme (readme.doc) references a VILLAGE table that contains town\ncodes for the field TCODE. During initial processing, staff noted the donor did not transfer the\nVILLAGE code table. Upon later review of the code tables, staff identified a VILLAGE field\nname in the LAST_RES code table. The donor layout does not associate any coded fields with a\ncode table named \"LAST_RES.\" However, when staff linked the key field in this code table to\nthe TCODE field in the passenger files (PAS_XX), the returned VILLAGE values appeared to\nbe accurate for the records when comparing against other information in the record, specifically\nthe value in the TOWN field, though there may be minor spelling differences. For this reason,\nstaff believe the LAST_RES table can be used to return appropriate values for the TCODE field.\nFirst names in Irish and United Kingdom Passenger Data File\nThe data file PAS_IRUK_NSTR.txt (PAS_IRUK) includes updated versions of passenger\nrecords first transferred to NARA in the file FIPAS (RG200.FAMIR.Y4651; XMIS 003584).\nFIPAS is described in the series, \"Records for Passengers who Arrived at the Port of New York\nduring the Irish Famine, 1977 - 1989\" (National Archives Identifier 569666).\nIn FIPAS, the passenger records include the field FAMILY RELATION CODE. The agency-\nprepared layout (IRISH.README) indicates this field should appear at file position 41.\nHowever, staff found that in the data these values appear in file position 21, which is identified\nas a FILLER field in the agency layout. In the data file, file position 41 is blank in all the\nrecords. File position 21 (Filler/Family Relation Code) is populated in 27,101 of the records.\nWhen comparing records found in FIPAS to the records for the same individual¹ in PAS_IRUK,\nstaff found that the first names in 10,622 records are preceded with what appears to be a Family\nRelation Code. For example, in FIPAS, there is a record for a Margaret McCabe, age 8, with ship\nmanifest 711 (see data record on line 44). In this record, file position 21 (Filler/Family Relation\n1 There are no unique identifiers shared between the passenger data files. Staff compared the full records from both\ndata files for a given name to determine if the records are for the same individual.\nNATIONAL ARCHIVES and\nRECORDS ADMINISTRATION\n8601 ADELPHI ROAD\nCOLLEGE PARK, MD 20740-6001\nwww.archives.gov\nNARA Reference Copy\nCode) contains the value \"D\". In PAS_IRUK, there is no record for a Margaret McCabe with this\ninformation. There is, however, a record for a Dmargaret McCabe, age 8, ship manifest 771 (see\ndata record on line 17,605). Upon further investigation, staff identified 10,622 records in\nPAS_IRUK in which a family relation code appears as the first character in the First Name field\nbased on similarly matching records in the FIPAS file.\nSee the NARA-prepared documentation file PAS_IRUK_NARAIdentifiedRecords.txt for an\nextract of the set of 10,622 records identified by staff. Staff added the field \"file_line\" as the first\n(left-most) column, which indicates the line number on which the record appears in the original\ndata file. The extract file is in ASCII, with pipe-delimited (|) fields enclosed with quotations (\"),\nwith record-delimited records (CR/LF). For researchers interested in creating a corrected version\nof the PAS_IRUK file, keep in mind the original PAS_IRUK records do not include fields\ncontaining line numbers or unique identifiers for the individual records. The line numbers\nprovided for the records in the NARA-prepared extract refer to the original ordering of the\nrecords in the PAS_IRUK data file.\nBelow is the Family Relation code list the donor provided for the FIPAS records. It is possible\nthese code meanings may be applicable to the codes in the PAS_IRUK records.\nCode\nMeaning\nL\nAny In-Law\nA\nAunt\nB\nBrother\nC\nCousin\nD\nDaughter\nP\nFather\nZ\nGrandchild\nY\nGrandparent\nH\nHusband\nM\nMother\nN\nNiece or Nephew\nT\nSister\nS\nSon\nF\nStepdaughter\nG\nStepson\nU\nUncle\nW\nWife\nNARA Reference Copy\nItalian Passenger Records Data File: embedded line feeds\nStaff found two records in the PAS_IT data file include embedded line feed characters (LF) in\nthe TOWN field. The records appear on lines 855328 and 1152684 in the data file. These\ncharacters may cause an unexpected break in these records and so may need to be removed to\navoid this issue.\nItalian Passenger Records Data File: some text fields populated with #NAME?\nStaff found 151 instances of the value #NAME? populating some fields in the PAS_IT file.\nThere are 150 unique records affected. The value can appear in the following fields: LNAME,\nFNAME, TOWN, DEST_CITY, US_WHERE, REL2_NAME, REL2_ADDR, REL2_CITY. It is\npossible this may be the result of an error code generated by the software programs the donor\nused to create and maintain these records. It is not clear to staff why these values appear in these\nfields.\nElectronic Records Division, Reference Branch (RRER)\nUpdated November 29, 2023\nNARA Reference Copy\nNATIONAL\nARCHIVES\nLIST OF DOCUMENTATION\nShip Passenger Records, 1820-1912\nCastle Garden Immigration Center Collection\nNN3-CGIC-22-001\nI.\nNARA Documentation\n1. List of Documentation\n1 pg.\n2. File List\n1 pg.\n3. User Note\n2 pgs.\n4. Supplemental User Note\n1 pg.\nII.\nDonor-Created Documentation\n1. Readme.doc\n7 pgs.\nTotal Pages\n12 pgs.\nIII.\nNARA Processing Materials\n1. Automatic Verification of Electronic Records\n2. AERIC Reports\nPrepared By: Sara Hawran, Archivist\nNATIONAL ARCHIVES and\nDate: December 7, 2021\nRECORDS ADMINISTRATION\nPage 1 of 1\n700 PENNSYLVANIA AVENUE. NW\nWASHINGTON, DC 20408-0001\nwww.archives.gov\nNARA Reference Copy\nNATIONAL A ARCHIVES AND RECORDS\nNational Archives and Records Administration\n8601 Adelphi Road\n1985\nCollege Park, Maryland 20740-6001\nTheodore J. Hull\nNN3-CGIC-22-001\nMay 17, 2010\nShip Passenger Records, 1820-1912\nCastle Garden Immigration Center Collection\nInitial Processing and Documentation: The four Ship Passenger Records data files (PAS_GS,\nIRUK, PAS_IT, and PAS_RS) were transferred to the National Archives and Records\nAdministration as one table within MS Access databases. The remaining tables in each database were\nthe Ship Manifest File (ALLHDRS) and 13 associated code tables. The files were saved from MSAccess\nas variable length ASCII text files, with pipe (|) field delimiters, and double quotation marks (\")\nsurrounding text fields. Note that the date field included in the Ship Manifest File was saved in\nDate/Time format (MM/DD/YYYY H.MM.SS).\nThe donor supplied the documentation as an MSWord document. During archival processing, the donor\nsupplied documentation was annotated to correct the record count for the PROVINCE code table, add a\nrecord count for the REGIONS table (N=20), and to indicate where three fields (RACE, TCODET, and\nTCDEST) appear in the record layout for three of the PAS_XX data files. The RACE, TCODET, and\nTCDEST fields are not included in the PAS_RS file. No code tables were provided by the donor for\nthese three fields. The RACE field contains no values (NULL) in all four data files.\nNARA also did not receive the VILLAGE code table referenced in the donor supplied record layout.\nThis code table is for the TCODE field. From manual review of the first 1,048,575 records in the\nPAS_GS data file, the TCODE field and TCODET field are both unique identifiers for the city / town /\nvillage identified in the TOWN field. However, whereas the TCODE field is populated in all records,\nthe TCODET field may be NULL. TCODE can be used to identify variant spellings of the city / town /\nvillage identified in the TOWN field. Note that where TCODE is coded 24736 and TCODET is coded\n3ZZZZ that the city / town / village identified in the TOWN field is Unknown.\nFor the CDEST and TCDEST fields, they relate to the DEST_CITY field. CDEST can be used to\nidentify variant spellings of the city / town in US identified in the DEST_CITY field. The CDEST in\nturn is translated in the DESTINATION code table.\nNARA prepared printouts of the codes tables ARR_PORTS, COLOR, COMPLEXION, COUNTRY,\nOCCUPATION, PORTS, PROVINCE, REGIONS, RELATION, TRANS_CODE, and TRAVEL_CODE.\nBecause of the size of the DESTINATION and LAST_RES code tables, they were not printed. They\nwere examined using the Automated Electronic Records Inspection and Control (AERIC) utility to\nverify that each code had a value associated with it.\nNARA's web site is http://www.archives.gov\nNARA Reference Copy\nVerification: The four Ship Passenger Records data files and Ship Manifest File were verified using the\nAutomated Electronic Records Inspection and Control (AERIC) utility. AERIC rejected four records\nfrom loading on the PAS_IT file and the values appearing in some fields on the verification report\nindicate that a number of records did not load properly for verification. The AERIC reports retained\namong NARA Processing Materials can provide details on specific fields. The AERIC reports can\nprovide details on specific fields. The following are some observations made about the various fields in\nthe PAS_GS, PAS_IRUK, and PAS_RS data files based upon the detailed AERIC verifications. These\ncomments generally apply to the PAS_IT file, but because of the load problems some additional\nerroneous results apply to that file as well:\nAge: a number of records contain negative numbers and values well over 100\nSex: valid codes are M, F, and U; the data also contains NULL, -, ?, G, H, f, and m.\nMarital: valid codes are M, S, W, and D; the data also contains NULL and U; note that this field\ncontains only NULL in the PAS_IRUK and PAS_RS data files\nLiteracy: valid codes are Y, N, and U; the data also contains NULL, -, ?, 0-9, A,C, D, E, F, G, H,\nI, J, K, L, M, O, P, R, S, T, W, [, ], n, and u.\nRelation_1: is coded 0 or NULL in all cases.\nDest_State: is NULL in the PAS_IRUK data file\nTicket: valid codes are Y and N; the data also contains NULL, -, 1, =, ?, ??, NY, U, and YN; note\nthat this field contains only NULL in the PAS_IRUK data file and PAS_RS data files\nUS Before: valid codes are Y and N; the data also contains NULL, -, ?, ??, ???, U, V, and YN;\nnote that this field contains only NULL in the PAS_IRUK and PAS_RS data files\nTo_Rel: valid codes are Y and N; the data also contains NULL and ?; note that this field\ncontains only NULL in the PAS_IRUK and PAS_RS data files\nComplexion: the code for nine can be represented as 9 or 09; all other values are represented as\ntwo digit with a leading zero; note that this field contains only NULL in the PAS_IRUK and\nPAS_RS data files\nHair_Color: the code table does not include values for LI, PA, or RE; note that this field contains\nonly NULL in the PAS_IRUK and PAS_RS data files\nEye_Color: the code table does not include values for BG, DRK, LGG, LIB, LIG, R, and Y-B;\nthe data also contains NULL and ?; note that this field contains only NULL in the PAS_IRUK\nand PAS_RS data files\nTravel_Code: the code for nine can be represented as 9 or 09; the data also contains NULL and\n1.\nTrans_Code: the data also contains NULL, #, L, U, c, and S.\n[12/10/2021 Note: Theodore Hull did preliminary processing on these records in 2010. At that time,\nthese records were known under accession number 3-CIR-10-001 and the records were considered part\nof the Records of the Center for Immigration Research. When the deed of gift was signed in December\n2021, the header of this User Note was updated to reflect its new accession number, NN3-CGIC-22-001,\nand the current collection title, the Castle Garden Immigration Center Collection. None of the content of\nthe User Note was edited.]\nNARA's web site is http://www.archives.gov\nNARA Reference Copy\nNATIONAL\nARCHIVES\nSupplemental User Note\nShip Passenger Records, 1820-1912\nCastle Garden Immigration Center Collection\nNN3-CGIC-22-001\nThe May 17, 2010 User Note indicates that the Microsoft Word documentation provided by the\ndonor was printed out and annotated by Theodore Hull during initial processing. As of 2021 the\nannotated paper copy could not be located, although the original electronic file has been\npreserved in ERA 2.0 (readme.doc). Below I have attempted to recreate some of the annotations\nthat may have existed on the paper copy, based on the information given in the original User\nNote:\nCorrected record count for the PROVINCE code table: 186\nRecord count for the REGIONS table: 20\nLocation of the three missing fields in the record layout (applies to all of the PAS_XX\ndata files except PAS_RS):\nRACE: located right before PROVINCE\nTCODET: located right before TCODE\nTCDEST: located right before CDEST\nThe 2010 User Note also references printouts of some of the code tables. These printouts were\nalso not located in 2021. The code tables have been preserved electronically in ERA 2.0.\nPrepared By: Sara Hawran, Archivist\nNATIONAL ARCHIVES and\nDate: December 9, 2021\nRECORDS ADMINISTRATION\nPage 1 of 1\n8601 ADELPHI ROAD\nCOLLEGE PARK. MD 20740-6001\nwww.archives.gov\nNARA Reference Copy"
}