NF18 and the 4/26 ARC releases

NF18 is a list of redacted documents in the John F. Kennedy Assassination Records Collection (the ARC) held at the National Archives and Records Administration (NARA). This is an important document for those who are interested in how much material in the Collection remains unreleased.1

This post looks at how NF18 fits into the latest ARC release on 26 April 2018. The results of this comparison show that NF18 was by no means a complete list of all redacted documents in the ARC.

The status of NF18

NARA released NF18 in excel format on 29 January 2018 to John Greenewald, owner of “The Black Vault” website, in response to his FOIA request. Apparently the spreadsheet was accompanied by a note or letter, which Greenewald quotes as saying: “We conducted a search and were able to locate an EXCEL spreadsheet that lists everything that has not been released since December 15th, 2017 (the last release date).”2

While not very elegantly stated, this simply means that the NF18 spreadsheet lists all redacted documents remaining in the ARC after the six 2017 releases, which began in July 2017 and ended in December 2017.

This is confirmed (indirectly) in the March 2018 report from the office of NARA’s Inspector-General, James Springs (recently discussed here). That report states: “Currently, 21,890 documents [in the ARC] have not been fully released which represents about 7 percent of the collection.” The 21,890 record figure is consistent with NF18, which lists 21,890 unique document numbers.3

In other words, NF18 was NARA’s best effort at a comprehensive list of redacted documents in the ARC as of January 2018. As of March 29th, this was still the IG’s understanding.

NF18 in the 26 April 2018 releases

Following a six month review requested by President Trump, on 26 April 2018 more records were released and a new, cumulative spreadsheet was published for all of the now seven releases of ARC records. NARA’s press release on this set of records stated that 19,045 documents were in the 26 April release.4

If NF18 is indeed a complete list of all the ARC records with redactions, all of the new releases should be from records listed on NF18. 5

This turns out, however, not to be the case. To see that this is so requires two steps. First, one must determine how many records are unique to the April release: i.e., were not released in any of the 2017 sets. There are 1078 such records. Second, one must compare THESE files to NF18. Any records not in NF18 are then records that had redactions, but were not listed in NF18. Somewhat to my surprise, there are 320 such documents. A spreadsheet of these files is posted here.

In terms of the size of the ARC, this is not a large number: it is only one one thousandth of the 319,000 plus ARC documents. It also indicates that after coming up with its January 2018 total of redacted documents, NARA continued looking for more redactions all the way up to deadline. In addition, most of these newly discovered redactions were released in full and all of them were posted online at NARA.

In terms of finding out how many redacted ARC documents remain at NARA, however, it must remind us that tracking down every last one of these has been a difficult task, and we should not be surprised if more turn up in the months and years ahead.

Do discoveries of more redacted documents have any significance for those interested in researching the JFK assassination? This is a subject I’m slowly working on. Given the extremely broad scope of the material in the ARC, more documents released in full doesn’t automatically mean more information on the JFK assassination is available. Nor need it automatically diminish our confidence in previous studies, done when this material was unavailable.

  1. I have done a number of posts on NF18. See here for more details.
  2. See http://www.theblackvault.com/documentarchive/j-f-k-assassination-records/
  3. For reasons I do not know, NF18 contains a substantial number of duplicate record numbers; the 21,980 unique figure is after subtracting these duplicates.
  4. The press release is here. Note that there is a minor problem with this figure. I will write a short post on this problem in the near future.
  5. I assume for the purposes of this post that NARA did not post records that have already been released in full. It posts only unredacted, or less redacted, records. NARA’s JFK Project page (here) partly supports this assumption: “We only posted documents in April of 2018 if the agency informed us that the document had more information released as a result of the re-review ordered by the President.” This claim will get a closer look in a future post.
Posted in History, JFK ARC | Comments Off on NF18 and the 4/26 ARC releases

The state of the JFK ARC: The Bradford critique

This post will discuss the second of two recent reports on the status of the JFK Assassination Records Collection (ARC). My post on the first of the two is here. For those new to this subject, see here for an introduction to the ARC.

The report covered in this post, dated June 18, 2018, is by Rex Bradford, president of the Mary Ferrell Foundation. It can be found here.

The Mary Ferrell Foundation provides on-line access to a large percentage of the ARC records, as well as other important historical government records from the 1960s and 1970s. In terms of ARC documents, and the access it provides to them, it is of very high quality indeed.

Bradford is of course strongly conspiracy oriented, as are all of the MFF directors, but he is also well-qualified to provide an overview of the problems and work remaining for the ARC, so I had high expectations of his review of the current status of the ARC.

Unfortunately, his critique was a disappointment overall. I agree with Bradford on a number of points, but this post will focus on what I feel is his most problematic claim: that the ARC still contains records “withheld in full.”

Summary of Bradford

Bradford first offers a brief overview of the 2017-2018 releases, then summarizes what he sees as problems in these releases under four headings:

1) excessive and undocumented redactions;
2) errors, anomalies, and mysteries in online data;
3) missing withheld in full files
4) lack of accountability for the releases and the full collection

He closes with several recommendations, which mostly echo an open letter that the MF Board of Directors sent to National Archivist David Ferrigno in March 2018.1

Bradford’s doubts on NARA’s accounting

A number of my posts on the ARC documents have been responses to various claims that there are still large numbers of records withheld in full at NARA. All such claims that I have checked have been based on misunderstandings or error.

Yet Bradford too believes there are still entire documents in the ARC which are eligible for release under the ARCA, but which NARA has not yet released. Bradford does not make the mistake of claiming “thousands” of ARC records still withheld in full; in the end he claims only 13. Even this claim, however, is in error.

The basis for Bradford’s claim

What is the basis for Bradford’s claim that there are still releasable records withheld in full at NARA? It comes from one FOIA document and Bradford’s reading of a NARA webpage. The FOIA document is a list of records that still had redactions as of January 2018. I now call this important document NF18 (see here for a description of where it came from and what is in it). The webpage Bradford cites is NARA’s JFK Assassination Records Processing Project. This is also an important source for the final ARC releases.

NF18 has been misunderstood by several writers. It is basically a list of ARC document numbers and their current status: redacted or withheld. The list is NARA’s accounting of all the ARC documents with redactions as of January 2018.2 Bradford has clearly understood this, and matches NF18 against the information on the Records Processing Project page to check whether everything on NF18 that should be released has been released.

This is an appropriate method, and I tried to do the same thing in a post on 2018 May 5 (here). My results, however, were different from Bradford’s results, so a closer look is in order.

At the time of NF18, there were 798 ARC records withheld in full. It is important to remember, however, that the law creating the ARC, the John F. Kennedy Assassination Records Collection Act (ARCA), did NOT mandate that all records in the Collection would be made public. Sections 10 and 11 of the Act specifically exempted three types of records from public release: 1) sealed court documents and federal grand jury information; 2) deeded gifts to the federal government, 3) “records held under section 6103 of the Internal Revenue Code.”3

According to NARA’s webpage on “The JFK assassination records processing project,” there are 520 records which are withheld in full are withheld under Sections 10 and 11, and will therefore not be released.

But how do these 520 files fit into the 798 records withheld files listed in NF18? This is where some of Bradford’s doubts arise.

There are two other issues that come up as well. In addition to the section 10 and 11 records, there were 10 audio tapes in the Gerald Ford Presidential Library that were “not recoverable.” There were also 79 Record Information Forms (RIFs) that could not be matched to records in the collection. All 89 of these records are therefore also unavailable online or in NARA’s archives, adding to Bradford’s doubts.

A final set of 180 documents is also listed in NF18. This document set is a microfilm copy of the CIA’s 201 file for Lee Harvey Oswald.4 The microfilm 201 file turned out to be a 100% duplicate of the original file, released all the way back in 1992. The “Project page” thus states that the microfiled files “were not processed for release or posted.”5

Bradford’s list

Based on all these items, Bradford begins by trying to specify which files are exempt from release under Sections 10 and 11 of the ARCA. This attempt is marred by what appear to be count errors and a math error.6 In addition, he has overlooked sealed court documents and federal grand jury information, of which NARA’s JFK Project page says there are 5.

He then lists 19 files which he says have not been released but which he suggests may actually be releasable. Six of these are FBI files which Bradford concedes “may be tax records,” so that in his list it is only 13 files which are “at issue.” Here are the files Bradford lists:

# RIF # Agency RIF data Restrictions
1 104-10291-10021 CIA [RESTRICTED], 63 pages, NBR 1B
2 104-10291-10022 CIA [RESTRICTED], 270 pages, NBR 1B
3 124-10286-10391 FBI [No Title], From DIRECTOR, FBI to SAC, SG (7/15/1953) SECTION 10(a)1
4 124-90026-10181 FBI [No Title], Subjects: HARRY HALL SECTION 10(a)1
5 124-90026-10182 FBI [No Title], Subjects: HARRY HALL SECTION 10(a)1
6 124-90091-10143 FBI [No Title], From: US COURTS (AFFIDAVIT) SECTION 10(a)1
7 124-90097-10251 FBI [No Title], 198 pages, Subjects: CHARLES TOURINE SECTION 10(a)1
8 124-10129-10309 FBI [No Title]. Subjects: DEMOH, INCOME TAX RETURNS SECTION 11(a)
9 124-10130-10083 FBI [No Title], From: PAINE, MICHAEL RALPH, SECTION 11(a)
10 124-10130-10136 FBI [No Title], From: PAINE, MICHAEL RALPH, SECTION 11(a)
11 124-10130-10137 FBI [No Title], From: PAINE, MICHAEL RALPH, SECTION 11(a)
12 124-10130-10138 FBI [No Title], From: PAINE, MICHAEL RALPH, SECTION 11(a)
13 124-10158-10060 FBI [No Title], From: IRS, Subjects: LHP, PRE-RP, REL, INCOME TAX SECTION 11(a)
14 124-10175-10480 FBI [No Title], From: FAIN, JOHN W., 379 pages, Subjects: MCO, LHO, FOIA REQUEST,
Classification: TOP SECRET
NOT ASSASSINATION RELATED
15 180-10116-10076 HSCA [No Title], 26 pages, Subjects: KING, MARTIN LUTHER, JR.
16 180-10120-10010 HSCA [No Title]. From: HSCA, To: BELL, GRIFFIN, Subjects: BELL, GRIFFIN, SUBPOENA REFERRED
17 180-10131-10326 HSCA [No Title], Record Series: SECURITY CLASSIFIED TESTIMONY,
From: PHILLIPS, DAVID ATLEE, Date: 5/11/1978
REFERRED
18 180-10142-10055 HSCA [No Title], Classified typewriter ribbon cartridge (presumably accompanies 180-10142-10194?) REFERRED
19 202-10002-10134 JCS [No Title]. Subjects: INFORMATION FURNISHED THROUGH DIPLOMATIC CHANNELS;
SITUATION IN CUBA; CHE GUEVERA’S ARTICLE ON GUERRILLA WARFARE
REFERRED

Problems with the list

The first problem with this list is that although Bradford claims none of these documents have been released, in fact five of the documents already have been, as the links I have added show. Note that 180-10131-10326, a document Bradford was particularly concerned about, is one of these.

The second problem with this list is that Bradford apparently worked directly from NF18, and did not go back and check the RIF sheets for these documents. NF18 only gives a few data fields from the RIF sheets for these documents. It omits, among other things, the restrictions field for these records. I have added this back in because it shows the basis for restricting access to these records.

Using this, we can see that there are five records on Bradford’s list withheld on Section 10 grounds. Section 10 refers to legal documents under seal of court [10(a)1], or grand jury information [10(a)2]. Another 6 records are withheld on Section 11 grounds. Section 11 refers to “records held under section 6103 of the Internal Revenue Code.” Two of the CIA records which were released in April 2018 have information withheld on 1B grounds. This is the ARCA exemption for “intelligence sources or methods.” Several records are also listed as “referred.” This means that agencies which provided information in the record have been asked to clear release of the record. Several of these have indeed been released.

The RIF “restrictions” field does not resolve all questions, but it certainly answers some of Bradford’s doubts: the six FBI documents that Bradford says “appear to be IRS documents” are withheld under section 11; there is no ambiguity here. Five of the documents he lists as questionable are withheld on Section 10 grounds. This is consistent with NARA’s Project webpage, which says five documents were withheld under Section 10.

It is a pity that Bradford did not check the full RIFs for these documents before compiling his list. It is strange that he lists documents as unreleased that are in fact released.

Conclusions

The 798 withheld records listed in NF18 and the 520 records withheld under Sections 10 and 11 are largely resolvable. Here are the numbers I have:

# Prefix Agency type count Restrictions
1 104 CIA dupl. Oswald 201 180
2 misc misc unresolved RIFs 79
3 178 GFL tapes 10
4 137 IRS Tax docs 178 Sec 11
5 179 WC Tax docs 314 REFERRED
6 124 FBI Tax docs 6 Sec 11
7 124 FBI Court docs 5 Sec 10
8 176 JFKL DOG docs 7 3
9 179 LBJL DOG docs 5 REFERRED
10 MISC MISC 11/17 docs 3 [open]
11 MISC MISC 4/26 docs 5 [open]
12 MISC MISC unreleased docs 4 [WITHHELD]
2 180 HSCA typewriter ribbon/cartridge 4 ?

This is all 798 withheld records on NF18. Of these records, I can only identify 515 as Section 10 or 11 documents. There are four documents remaining which have not been released, but I have no idea why. Even if the four unreleased documents are all Section 11 records (very unlikely), we are still one document short of 520. Perhaps one unreleased Section 10 or 11 record has indeed been omitted from NF18. (I will have more to say about this in the near future.) Or perhaps 520 is a miscount. Everyone makes this kind of mistake; a look at my past posts will show lots of places where I have had to go back and correct my numbers.

Following the trail down to the very end, I am also uncertain of the status of the typewriter ribbons. Bradford seems to think that these two records represent two pieces of one object, but I think they are separate: the cartridge is not just a box, it has more ribbon inside it that was used to type classified documents. I have no idea why these two ribbons were kept. It seems unlikely that two only ribbons were required to type all the classified documents that passed through the HSCA, but these are the only two listed in the ARC.

Overall, this is almost the same accounting I gave in my May 5th post, as the excel sheet posted there shows. I have changed my mind on one item: the document 124-10286-10391. I originally thought this was NOT a withheld document because Mary Ferrell has a document with this record number. That left me with only four Section 10 records.

In fact the 124-10286-10391 document on Mary Ferrell is an error; the RIF sheet for the withheld 124-10286-10391 document has been erroneously attached to another document on a similar subject.

How did this happen? Federal agencies were required to produce record information forms (RIFs) for all their assassination related records, and during this process, it happened more than once that the wrong RIF was attached to the wrong document. This happened to several of the FBI documents in the record group that 124-10286-10391 belongs to. This group is a set of FBI files relating to William Waldman, a vice president of Klein’s Sporting Goods. Klein’s was the company which sold Lee Harvey Oswald the rifle he used to shoot President Kennedy.

I am now sure that the Mary Ferrell 124-10286-10391 RIF sheet is mis-attached because the RIF sheet indicates the document date is 1953, while the Mary Ferrell document attached to this RIF sheet is from 1965.

Summing up, the document count NARA gives is off by only one file. Although the remaining four unreleased files may have other issues, I conclude that Bradford’s claim of over a dozen missing withheld in full files is simply wrong.

  1. https://www.maryferrell.org/pages/Featured_Letter_to_Archivist_March2018.html
  2. From what we know in December 2018, NF18 is not one hundred percent correct or complete, but it was NARA’s best effort in January 2018.
  3. This summary comes from the recent report on the ARC by NARA’s Inspector-General James Springs. There is a copy of the text of the ARCA on the NARA website here.
  4. See here for a post on this subject.
  5. In fact, a file numbered 104-10196-10018 from this set was posted at NARA, but the file consists only of 312 pages all saying “Image temporarily not available.”
  6. For instance, Bradford counts 182 IRS documents in NF18’s withheld files instead of 178, lumps the LBJ library letters to and from Jacqueline Kennedy (probably Deed of Gift material) together with withheld Warren Commission tax documents, and mis-adds file totals (182+321+7 = 510, not 465). For my own accounting of the withheld documents in NF18, see this spreadsheet.
Posted in History, JFK ARC | Comments Off on The state of the JFK ARC: The Bradford critique

The state of the JFK ARC: The IG report

For those not familiar with the subject of this post, I have a new page introducing the JFK Assassination Records Collection (a link is at the top of the blog page). This should help make the discussion a little more comprehensible.

I’ve now had a look at the two reports I mentioned in my last post. These reports cover the final releases of material from the JFK Assassination Records Collection (ARC), which is held at the National Archives and Record Administration (NARA). Neither report is as useful as I had hoped.

The first of the two reports is from the office of NARA Inspector-General James Springs (here). It was issued 29 March 2018, a little less than a month before NARA released what is supposed to be the final set of ARC documents. The IG report therefore only covers the 2017 ARC releases.

I should note that I am not certain whether the document I cite here is the report itself, or simply a summary of the report. 1

Much of the report is simply a recitation of the basic history of the JFK assassination; no need to go over that here.

The remaining part of the report recounts various aspects of the 1992 ARCA, the legislation which created the ARC. It notes that, in the IG’s view, the ARCA is still in effect and imposes a “continuing obligation” on federal agencies to release assassination records.

It also spells out the records which the ARCA exempted from public release, including sealed court documents, federal grand jury information, deeded gifts to the federal government, and “records held under section 6103 of the Internal Revenue Code.”

There is then a brief description of NARA work on the ARC releases, beginning in 2014 and ending with work current as of the report date (March 2018).

For those who have not followed this long story, in 2014 the JFK Assassination Record Collection still had numerous records that were not available to the public, or available only in part.

The ARCA set a 2017 deadline to release most of this information, so after lengthy preparation and consultation, described in the IG report, NARA released six sets of records from the ARC during July to December 2017. According to the IG report, during this period 34,873 documents were ‘released.’

A caveat is now in order here for readers who may be confused by the word released.

Many readers have taken the word “released” in this context to mean that a document was previously “withheld,” i.e. unavailable to the public. This is not how these terms are used in describing ARC releases.

There are three possible states in which an ARC record may appear: withheld in full, withheld in part, and released in full. Documents withheld in full are not available to the public at all. Documents released in full are publicly available, with no text removed at all. Documents withheld in part are publicly available, but have part of their text removed. These removals (usually called ‘redactions’) range from a single excision of as few as two letters (a digraph), to several pages of text.2

When a redaction is “removed” from a document, this means the blanked out or blacked out text is restored. For ARC documents, however, the restored text is said to be ‘released.’

Why is this confusing? Consider a hypothetical ten page document, published ten years ago with only one redaction, two letters from a CIA cryptonym. When the two letters are restored, NARA counts the entire document as a “release.” Moreover, if redaction x in a document is ‘released’, but redactions y and z are not, the same document may later be referred to as ‘released’ again and again, until it finally reaches the stage of ‘released in full.’

This counter-intuitive terminology led some writers last year to believe that ALL of the documents ‘released’ during 2017 were previously withheld in full! Since a total of 34,873 documents were ‘released’ in 2017, it is easy to get the mistaken impression that a vast amount of material was previously unavailable to the public, based on the false assumption that all of these 34,873 documents were withheld in full.

But this was far from the case. Pursuant to an FOIA request in 2016, NARA attempted to compile a list of all the withheld in full documents. This list, which I refer to as NF16, counted 3598 documents withheld in full.3

The vast majority of the 34,873 documents released in 2017 were thus NOT withheld in full. Many of them had only one or two redactions, and after the 2017 ‘release’ were actually ‘released in full.’

Ah, but which ones? Unfortunately, NARA did not provide a count of these. This lack is partially filled by the IG report. For instance, the report states that all the documents released in July and October 2017 were released in full.

In addition, the IG report also indicates a publicly available source for further checking.

This source is another list which NARA released in January 2018. The list, which I call NF18, included ALL documents still containing redactions after the 2017 releases. The list, which was also released pursuant to an FOIA request, consisted of an excel spreadsheet with 22,933 rows. For reasons that are unclear to me, many of these rows were duplicates. The total number of unique documents in NF18 was 21,890. 4

This list is the basis for the claim on pages 3 and 6 of the IG report that 21,890 ARC documents still contain one or more redactions after the 2017 releases.

NF18 can thus be a tool for testing the IG report statement that the documents released in July and October 2017 were all released in full. Do any of the July/October documents appear on NF18? The answer is no. But is NF18, and the IG, correct in asserting that there is nothing left redacted in these documents?

Well, the documents were posted on the internet. Just check if a July/October document still has redactions. Alas, this is a task that none of the internet commentators on the ARC have yet attempted.

Going further, one can also check the November/December 2017 releases using the same method. For the count of November/December releases not included in NF18, the results I got were as follows. Of a total of 24,626 unique records released in November 2017, 8856 of these do NOT appear in NF18. Of a total of 4217 unique records released in December 2017, 986 do NOT appear in NF18.

These documents are also available for checking to see if they are indeed released in full. No one has bothered checking these either.

This being the case, and now having some spare time, I have attempted this feat for all of the 2017 releases, and will report on the results in a future post.

Meanwhile, adding these figures all together, I get 16,536 documents “released” in 2017 that are not on NF18, meaning that they were released in full.5 Returning one more time to the IG report, this is consistent with the claim in the second paragraph of the report that “approximately 16,000” of the 2017 documents were released in full.

These figures are the main contribution of the IG report to our understanding of the current state of the ARC. Since the IG is using NF18 to track releases, we can also do so for the 16 April 2018 release. This will also be the subject of a future post.

  1. The document cited is in the form of a letter from Springs to the National Archivist David Ferriero. Page 6 refers to “the attached special report”, but there is no attachment in the text released. This made me wonder whether the letter might be just a summary, while the actual report remains unreleased.
  2. See my posts on the Assassination Record Review Board for a discussion of who did these redactions and and how.
  3. In fact, the total number of withheld documents was smaller than this. I discuss NF16 in a post here.
  4. I have discussions of NF18 here, here, and here
  5. Some of these are duplicates. For more precise figures, watch for future posts
Posted in History, JFK ARC | Comments Off on The state of the JFK ARC: The IG report

New reports on the ARC releases

I have recently come across two 2018 reports on the final (?) ARC releases from NARA. The first of the two is Special Report No. 18-SR-07 and was released on 29 March 2018. It was issued by NARA Inspector- General James Springs and evaluates NARA’s compliance with the 1992 JFK Assassination Records Collection Act.

The second report is 2017 & 2018 JFK Releases: Progress, Issues, Recommendations and is dated 18 June 2018. The author, Rex Bradford, is President of the Mary Ferrell Foundation. Oddly, the report doesn’t seem to be up at the Mary Ferrell website yet. I found it at the AARC website.

I’ll post on these after I’ve had a careful look. I’m especially interested in Bradford’s review; I’d like to see a more detailed explanation of some of the problems which the MF webpage on the releases criticizes.

Posted in JFK ARC | Comments Off on New reports on the ARC releases

A note on ACRS “audit history”

In my previous post I noted that a field in the metadata form (RIF) had been changed at some point in the early 2000s for a number of records in the JFK Assassination Records Collection (ARC). This change made it a very difficult task to identify a number of records in the Mary Ferrell collection of ARC records, a pity if you are trying to squeeze the maximum use out of the great MF collection.

Today, however, I stumbled on a somewhat roundabout way around this problem. It also illustrates an odd little corner of the Assassination Collection Reference System (ACRS), NARA’s online database of finding aids for the ARC, so it’s worth a short post.

The ACRS it turns out has an “audit history” link at the bottom of every record screen. Here is an example for one of the records I cited in my previous post, 104-100010-10015:

Click on the link at the bottom of the page and you will get the following view:

The audit history screen shows the comment field change discussed in my previous post, in which the original date-time string 1993-05-17-17.29.39.000065 was changed to 20031124-1016188.

The problem with using the audit history function is that it is not possible to search the ACRS for a specific date-time string in the comment field. You will have to identify the CIA records with revised date-time strings on your own, and click through the ACRS audit history of each of them in the until you find the one you are looking for.

I should note that this is not a totally ridiculous task; there are many clues you can use to narrow down the field of records to search. The point is that the audit history function means we need not depend on finding an old rif form in the MF collection to get a match between a new rif number and an old rif number. A diligent search should eventually turn up the correct match.

[Revised 6 July 2018 to improve screenshot]

Posted in JFK ARC | Comments Off on A note on ACRS “audit history”

More on the “old RIF numbers” at Mary Ferrell

This post is a continuation of my April 2018 post on the “old RIF numbers” formerly used in the JFK Assassination Record Collection (ARC) at the National Archives and Records Administration (NARA).

This ID system is no longer used at NARA, but there are still many documents using it in the important on-line version of the ARC at the Mary Ferrell website.

For those who want to get maximum use out of the MF collection, matching up the old IDs with the current IDs can therefore be very, very helpful, as this post explains.

For others, however, this post will probably have little of interest. Caveat lector.

RIFs old and new

The act which created the ARC, the 1992 JFK Assassination Records Act (ARCA), required NARA to “prepare and make available to all Government offices a standard form of identification or finding aid for use with each assassination record subject to review under this Act.”1 It further required the National Archivist to “ensure that the identification aid program is established in such a manner as to result in the creation of a uniform system of electronic records by Government offices that are compatible with each other.”2

In compliance with this requirement, NARA created the RIF, short for “Reader Information Form”. The RIF has 17 fields for metadata concerning the record it covers, and a unique 13 digit identifying number, the “RIF number”.3 It is usually attached on top of an ARC document as a cover sheet. As a convenient shorthand, I’ll call all these documents “RIF docs.”

The ARCA requirement to create finding aids was limited, however, to federal government records which were not in the possession of NARA when the ARCA went into effect, or which had text redacted and were therefore not open in full for public inspection. The most obvious example of records which do NOT meet these criteria is the documents from the Warren Commission’s investigation of the JFK assassination. These have been in NARA’s possesion since the 1960s, and most of them have been open to the public for over 50 years. This is why most most records from the Warren Commission do not have RIF finding aids, despite being an integral part of the ARC.4

Other examples of ARC records without RIFs include documents from Jim Garrison’s investigation of the assassination, which resulted in the trial of New Orleans businessman Clay Shaw for conspiracy to assassinate President Kennedy. None of these documents have RIF forms either. Overall, however, documents without finding aids make up only a small percentage of the total JFK collection; they are far exceeded by documents for which the ARCA required a finding aid.

The Mary Ferrell collection of ARC documents includes a huge number of both RIF docs, such as the CIA 201 file on Oswald, and non-RIF docs, such as records from the Warren Commission and Garrison investigations. The MF website states it has 101,113 documents from the ARC collection available on line.5 I originally took this to refer to the total number of documents on the site, but after taking a hard look at documents counts at MF, I believe that the figure of 101,113 documents refers specifically to RIF docs, and does not include any of the thousands of non-RIF docs in the MF collection.

In addition to both RIF and non-RIF docs, as my previous post explained, the MF collection also includes a huge number of documents which use a different form, labeled “NARA Identification Aid.” This form, by my count, has 32 fields, and uses a different form of identifying number: a 35 character string which consists of a date-time string followed by a 6 digit number. (See my previous post for several examples of these.) These forms are only used for CIA documents.

This is not a third set of distinct documents. Instead, it turns out that this form was produced by the CIA when it began processing its records for the ARC, all the way back in 1992. Based on the date-time strings, the forms in the MF collection were created between May 1993 and January 1995. This CIA form was later replaced by NARA’s RIF; the old forms were then removed from documents in the ARC, and the new RIF forms were added in their place.

Why do so many of these forms remain in the MF collection? I believe this is because they were still in use at the time these documents were acquired by groups such as the Assassination Archive Research Centter (AARC), who in turn provided them to MF.

In my previous post I called these older forms “old RIFs” and the id numbers on them “old RIF numbers”. Since the function of the form was the same as the RIF, I will continue to use the name “old RIF” to refer to this earlier type of finding aid.

Old RIF doc count

Getting a count of old RIF docs in the MF collection is challenging; my current count is about 23,300. This is a much larger number than I estimated in my previous post; recall that the MF Foundation’s estimate of their RIF doc total was 101,113, so this potentially increases the size of the MF collection by 20 percent.

These documents are distributed in the MF collection as follows:
HSCA segregated collection: 18,819
Oswald 201: 3653
HSCA microfilm collection: 880

The 23,300 figure includes duplicate numbers; accounting for these, the total number of unique old RIF numbers in the MF collection is about 22,600. There were a fair number of typos in the old RIF numbers which I have corrected to the best of my ability.

Matching old RIFs to new RIFs

As the previous post noted, it is possible to match the old RIFs to the new RIFs. The 35 character old RIF number for these documents was not just dropped. Instead, it was moved to the Comment field of the RIF form, together with the “box number” and “vol/folder number” on the old RIF. I have now found some documentation for this move.

ARC record 104-10331-10342 (dated 27 June 1994) is a discussion of changes NARA requested to the “JFK Database Extract.” Item 6 on the list notes “NARA wants the date time user stamp removed from the ID aid. This will require a modification to the application.” Item 8 notes “NARA would like the box number and folder information prefixed to the comments field. This will require a modification to the application.”

ARC record 104-10331-10343 (dated 28 July 1994) notes that as a result of a 25 July meeting, it was decided to “Move date/time ID number to Comment Section along with box numbers and folder information (#8).”

Based on this, I thought it would be possible to match all of the old RIF docs to the new RIF docs. It turns out, however, that this is not possible. I was able to match only about 21,300 old RIF docs to their new RIF counterparts.

One reason for this is that some of the CIA documents in the ARC have redone the date-time string in the comment field. An example of this is MF docid 95842. This old RIF doc is titled “RPTS ON ACTIVITIES TRAVEL OF THE OSWALDS”, and its id number ‘1993.05.17.17:29:39:000065’ This can be identified as ARC record 104-10001-10015. The current version of this record was released on 26 April 2018, and the comment field is OSW7 : V32 : 20031124-1016188.

How do we know that the these two files represent the same record in the ARC? Merely eyeballing them is NOT adequate. There are far too many duplicates in the ARC to safely claim that two documents have the same RIF number simply because they are identical in appearance. The reason we can say these two documents ARE the same is that there is an earlier release of 104-10001-10015 in the MF collection (docid 49995). In this earlier release, the comment field is OSW7:V32 1993.05.17.17:29:39:000065, exactly matching the ID on the old RIF doc 95842.

Why did the date-time string change in the later release of this record? Apparently, this was one of a set of records that were reprocessed by the CIA in the period 2003-2005,6 and these new date-time strings reflect the date of this reprocessing.

Trying to match up old RIF and new RIF records where the date-time string has changed is a mind-boggling task. I have managed to match about 500 of them, and in theory it may be possible to do it for all of them, but at this point I don’t really believe it is worth further time and effort.

New totals for CIA records in the Mary Ferrell Collection

Even without the unmatched records, 21,500 is a lot of records. The MF website’s JFK Database Explorer, which is based on the NARA’s Assassination Collection Reference System (ACRS), gives a total of 85492 CIA records in the ARC. It gives the total number of CIA records in the MF collection as 52314.

The figure of 52314 does not include ANY of the old RIF docs, as far as I can tell. We cannot, of course, simply claim that all 21,500 of the old RIF docs that I was able to match up as new additions to the MF collection. The old RIF docs include a large number of documents that duplicate new RIF documents also on Mary Ferrell, as the examples in the this post and the previous post show.

But, as the excel file linked to in my last post also showed, there are a huge number of old RIF docs that are NOT available as new RIF docs on MF. Thus, the old RIF docs significantly expand the total number of CIA documents available from the MF collection.

At this point I can only provide very rough counts on exactly how many more CIA records the old RIF docs add to the collection. An estimate of 14,000 more records is probably close. This would represent an increase of about 20% from the 52,314 Mary Ferrell has already indexed, to around 66,000. I sent a note to MF on this a while ago, but haven’t heard back from them. Looks like another DIY project. Converting my current database tabulation to an excel sheet is not high among my priorities now, but if you are interested in such a list, leave a comment.

  1. ARRB Final Report, p. 186
  2. Ibid.
  3. I have seen NARA documents which refer to the RIF as having 23 fields rather than 18; I am not sure why their count differs.
  4. There were some records from the Warren Commission which were not open in full when the ARCA was passed. All of these previously redacted documents DO have RIF forms, and the redacted portions were processed for release according to the ARCA.
  5. https://www.maryferrell.org/php/jfkdb.php
  6. See the NARA press release from December 20, 2004
Posted in History, JFK ARC | Comments Off on More on the “old RIF numbers” at Mary Ferrell

ARRB postponements and the microfilm Oswald 201 file

Most of my recent spare time has gone into looking at the ARRB record notices published in the Federal Register (see here for an earlier post on this topic).

I am interested in these notices for several reasons. One important reason is that the record notices include many documents that were omitted from the Assassination Collection Reference System (ACRS), NARA’s database of ARC finding aids. Hopefully these records will be added to the database in the not too distant future, but in the meantime, the Federal Register notices remain the sole online reference for several thousand ARC records.

Another reason for my interest in the ARRB record notices is that they give us a detailed picture of which redactions the ARRB released and which redactions the ARRB sustained in the ARC. This was one of the main tasks of the ARRB set by the 1992 JFK Assassination Record Collection Act (ARCA): to examine the redactions requested by the main executive branch agencies in their classified records, accepting or rejecting these, based on the standards provided by Congress.

In the ARRB’s terminology, accepting a requested redaction was a “postponement,” while rejecting a requested redactions was a “release.” A document with no redactions was described as “open in full,” while a document in which text remained redacted was described as “postponed in part.” In a few cases, entire documents were withheld from public release. These were said to be “postponed in full.”

Every postponement of text in an ARC document was decided by a vote of the ARRB. Releases, on the other hand, sometimes occurred when an agency simply withdrew its request to redact a document and released it in full of its own accord. This of course was usually because the agencies concerned realized that the ARRB would probably vote against retaining their redactions, and rather than defend a losing case, simply dropped it. The ARRB called such releases “consent releases.” According to the ARRB’s Final Report, the majority of releases from the ARC were consent releases.

In order to ensure that the ARRB’s review process was subject to public scrutiny, the ARCA further required the ARRB to publish notices of all postponements of text in the Federal Register.

After going through the Federal Register notices, however, I have not been able to reconcile the postponements in these with the postponements listed in the ACRS. The current version of the ACRS lists over 9700 records as “postponed” either in part or in full. Only 2550 of these records were listed in the Federal Register notices. This seems to contradict my understanding of how the ARRB processed assassination records.

Explanations for some of this, however, can be found in other parts of the ARRB records. An interesting example of this is the microfilm Oswald 201 file. To understand this example, some background on 201 files is necessary. According to the ARRB’s Final Report,

the CIA opens a 201 file on an individual when it has an “operational interest” in that person. The CIA opened its 201 file on Lee Harvey Oswald in December 1960 when it received a request from the Department of State on defectors. After President Kennedy’s assassination, the Oswald 201 file served as a depository for records CIA gathered and created during CIA’s wide-ranging investigation of the assassination. Thus, the file provides the most complete record of the CIA’s inquiry in the months and years immediately following the assassination.1

As for how Oswald’s 201 file came to be microfilmed, when the House Sub-Committee on Assassinations concluded its investigation of the JFK assassination, it signed a memorandum of agreement with the CIA that

Upon termination of the Committee, all materials provided by CIA and examined by the Committee will be kept and preserved within a segregated and secure area within CIA for at least 30 years, unless the DCI and the House of Representatives agree to a shorter period of time….The decision to microfilm was apparently based on two major considerations, as far as we can determine from our records. First, the integrity of the sequestered records had to be maintained. Second, a number of the files that the Assassination Committee requested were active files, and had to be available to allow people to continue conducting their normal activities within the Agency.2

Following its final release of ARC documents on April 26 2018, NARA noted that

Documents included in the Oswald 201 microfilm were not processed for release or posted since it was determined that the microfilm documents are a duplicate of the original Oswald 201 file that is processed and released. The ARRB evaluated these records and determined that they were duplicate files. NARA conducted our own evaluation, which was completed on February 5, 2018. That independent evaluation agreed with the ARRB’s original assessment.3

The ARRB evaluation process is described in more detail in a memo I found in the electronic records of the ARRB, released last year. The memo is from Robert Skwirot, the ARRB’s chief analyst for CIA records, to Laura Denk, the Executive Director of the ARRB for the last few months of its existence. The full text is as follows:

September 25, 1998
TO: Laura Denk, Executive Director

FROM: Robert J. Skwirot

SUBJECT: Sequestered Collection Microfilm Copy of the Oswald 201 File: Review Board staff procedures to confirm that the microfilm copy matches the original Oswald 201.

When copying to microfilm all the records that had been made available to the HSCA, the CIA transferred the Lee Harvey Oswald 201 file to 13 reels of microfilm. The Review Board staff has made an effort to confirm that all of the records on the microfilm copy of the Oswald 201 file can be found in the original Oswald 201 which was reviewed by the Board in 1995 and 1996.

The Review Board staff chose random samples from a printed copy of the microfilm Oswald 201 and verified that they were in the original Oswald 201 file. This task proved difficult since the two copies of the file were not in the same sequence, possibly due to the mechanics of the microfilming or because the Oswald 201 has been disassembled, reviewed, and reassembled so many times.

Members of the Review Board staff spent approximately five days at different times over the past three years engaged in this meticulous work. The page by page comparison of the hard copies of these files was supplemented by CIA database searches to find a match for those records which proved elusive to the Review Board staff. Review Board staff members were able to physcially match each microflim record examined to the corresponding record in the original Oswald 201.

It is likely that the microfilm of the Oswald 201 is a duplicate of the original. Though the Review Board staff examined less than 10% of the microfilm copy of the Oswald 201, no record they viewed could not be matched to a copy in the original 201. The only way to speak with absolute authority on this subject would be to match each and every record. Our survey convinced the CIA team that viewing every record would not be the most productive use of limited staff resources.

The microfilm reels of the Lee Harvey Oswald 201, as well as the printouts from the microfilm, will be transferred to NARA after September 30, 1998. They will be released in full in 2017.

This memo clarifies Board’s policy on the microfilm 201: having already processed a hard copy of the Oswald 201, the Board decided not to waste time on the microfilm 201 which it had good reason to believe was a duplicate of the materials it had already processed. As a result, release of the microfilm 201 file was postponed until the final release date under the ARCA. This decision was not published in the Federal Register.

  1. ARRB Final Report, pg. 45
  2. ARRB 6 August 1996 Board meeting transcript, p. 23-26
  3. https://www.archives.gov/research/jfk/processing-project
Posted in History, JFK ARC | Comments Off on ARRB postponements and the microfilm Oswald 201 file

Review of Kill the Messenger

Schou, Nick. Kill the Messenger: How the CIA’s Crack-Cocaine Controversy Destroyed Journalist Gary Webb. Nation Books, 2006.

When Gary Webb’s series “Dark Alliance” was published in the San Jose Mercury News in 1996, it set off what was easily the biggest journalistic controversy of the 90s. Nick Schou’s book gives a highly sympathetic picture of Webb, but may not satisfy all interests.

I became interested in Webb and his “Dark Alliance” series (DA below) a few years ago, and spent much time fishing around the internet trying to piece the story together, before finally reading Schou’s book. Schou book puts a lot of the story together, and provides some important new contributions as well, but I cannot recommend it as a complete introduction. In the end, Schou tries to do too much in too little space. Kill the Messenger is a combination of biography, journalism critique, and re-examination of the DA story, and that’s just too much ground to cover for a book that’s only a little over 200 pages. Schou’s sympathies also get in the way of the story sometimes, substituting discreet understatements for a straightforward narrative.

For those who want to know more about Webb’s life and career, the first and last two chapters are interesting and useful biography, heavy on anecdotes, but solidly based on interviews with Webb’s family and friends. Schou’s description of Webb’s decline and suicide is plainly but movingly told. And for those who like gloves-off writing, his curb-stomping of the conspirati who claim that Webb was murdered is good clean fun.

For those interested in the journalism, the book gives a detailed and fascinating account of the complex relations between Webb and his editors. In most magazine and journal articles I read on DA, Webb’s editors refused all comment. Schou, however, managed to interview some central people, including executive editor Jerry Ceppos, Dawn Garcia, the editor who worked directly with Webb on DA, and reporter Pamela Kramer, who worked on many of the DA follow up stories with Webb. As a result, “Mea Culpa”, the chapter which deals with how Webb left the Mercury News after the story fell apart, is fascinating reading and adds important information to the story.

The chapter “Feeding Frenzy”, which deals with LA Times, Washington Post, and New York Times coverage of the story, is much weaker, partly because of Schou’s sympathy, which leads him to understate things in a way that can make it hard to understand what the coverage really said, and partly because Schou sometimes shows a hostility which seems almost personal. He is especially hard on LA Times reporter Jesse Katz, for instance, in a way the text doesn’t seem to explain or justify.

Despite this, Schou is not as partisan as some others, who lambast everyone at the big three papers who wrote about “Dark Alliance.” In an interview with NY Times reporter Tim Golden for example, although Schou is determined to extract some concession that Golden was too trusting of the CIA, he doesn’t try to hide Golden’s outstanding qualifications and accomplishments, or the absurdity of what Golden went through after he criticized Webb’s story.

Lack of detail for a complex story is also a problem. One chapter I had a really hard time figuring out was “Drug Stories” which deals with how Webb put together the series. This includes a long description of the travails of Martha Honey, Tony Avirgan, and Daniel Sheehan, but never explains how they fit into the story. I still don’t get this. I also found the chapter about Ron Lister very hard to understand. This chapter is where Schou tries to build his case that DA was basically right about some things, but there’s just not enough detail in the book to make it convincing or even easily comprehensible.

These defects take off a star. It loses another star for no index; it may be a short book, but there’s more than enough characters to merit an index. I must punish the cheapskate publisher.

[Postscript] I wrote this review over three years ago, and after reading more on the subject, I have a much harsher view of Schou’s attempts to find some substance to Webb’s claims. But that is a post for another day.

Posted in Book reviews | Comments Off on Review of Kill the Messenger

Bill Kelly on the ARCA

[Revised May 29]
The JFK Assassination Records Collection Act (ARCA) is the law that established the massive JFK Assassination Records Collection (ARC) at the National Archives and Records Administration (NARA). As federal law, the record of its enactment is about as public as you can get. Yet the passage of time, and ignorance of the basic law-making process, can confuse even something as transparent and public as this.

A recent post at JFKcountercoup, a blog owned by Bill Kelly, is an example of this (here). According to Kelly:

The law [the ARCA] prescribed that all of the government records on the assassination of President Kennedy be released in full to the public by October 26, 2017, twenty-five years to the day Bush signed it into law. When he signed it however, Bush added a rider to the law that provided the President – and only the President, with the authority to continue withholding certain records beyond the October 26, 2017 date on the grounds of national security, where their release would harm American interests.

It was of course impossible for President Bush to change a bill after it was passed by Congress. A federal law in the United States must first be passed by both Houses of Congress. It then comes to the President, and he can either sign it into law, or refuse to sign it, an act called vetoing. The President cannot rewrite a bill that Congress has passed and then sign it into law.

I learned this as a school child in the United States. I don’t understand how Kelly did not. Where Kelly got this idea is not important, but to actually publish this claim on his blog shows surprising ignorance of how laws are made in the United States Congress. Kelly frequently posts on the ARC and his posts are referenced at websites such as Mary Ferrell, so this error is worth a note.

The real legislative history of the ARCA is clearly described in the Final Report of the Assassination Records Review Board. 1 Summarizing, the ARCA was introduced in Congress as a joint resolution (H.J.Res 454/S.J.Res 282). After hearings and reports, the Senate passed a revised version of the bill on July 27, 1992. The House passed the Senate version on September 30, and it was signed into law by President Bush on October 26, 1992. The only thing that Bush added to the bill was his signature.

  1. Final Report, 6-7. Mary Ferrell has a copy of the final report here, NARA has a copy here.
Posted in History, JFK ARC | Comments Off on Bill Kelly on the ARCA

ARRB resource page added

I have finally put together a webpage to hold all of the lists and links I have been using in my posts on the Assassination Records Review Board (ARRB). In addition, I have also started to add material from other websites as well.

The new page includes a link to a list of articles originally posted as a site called ‘Fair Play’, run by John Kelin. Unfortunately, this site is now completely off-line, preserved only by the Wayback Machine at archive.org. The articles I list here were a series written by Joe Backes, who followed the ARRB’s activities very closely. Backes attempted for the first months of the ARRB’s existence to read, summarize, and critique all of the records released by the ARRB.

He was of course totally overwhelmed by the release of tens of thousands of records, but the series represents at least some of the early response to the ARRB’s work, and is worth a look. Beware, however, that there is much confusion on which records were released when. Backes tries to divide the releases into ‘Batches’, but these don’t match up with the Federal Register notices that the Board published, in part because there were often delays before the Board’s unredacted versions of the records reached NARA’s reading rooms.

The list of Backes’ articles is here.

Or go to the new link page here to see what else is up.

Posted in History | Comments Off on ARRB resource page added