Updating WordPress

I finally got around to updating this site’s wordpress installation. The reason for the long delay was that the online updating process from wordpress was broken.  I had originally thought this was because I had used non-standard permissions in the wordpress directory (using ‘hardened’ permissions), but it turns out that this was not the case.

Instead, for some reason, during my last update to wordpress almost a year and a half ago, the ownership of some of the files was not assigned to the Apache webserver. The permissions were okay, but the owner was wrong. This prevents the online update from working. These mis-owned files were actually shown during the latest version of the update process. Is this a new display for the update process, or have I been missing this for the last 18 months??

In any case, the explanation of the failed update was still not very clear in describing the problem, nor was this page.  It took a fair amount of head-scratching and experimenting to finally realize that the answer is simply to chown -R the wordpress directory using the web server name, and the update will work.  Note that if you have any symlinks in your directory, the source file also needs to be chowned, not just the symlink. (If I have misstated this, please let me know!)

Having been put on full maintenance alert, I also took a look at my log files, which showed that my xmlrpc file is being regularly hammered by ‘guests’ who claim to be from the Ukraine. Who knows where they’re really from. This is a well-known problem, so I’ve simply blocked that functionality for now.

In addition, some bot claiming to be from Majestic 12 has been ringing my bell non-stop, so I’ve put up a robots.txt file as well.  Of course that won’t do any good if it’s just some hacker with a Majestic 12 text label on his bot. We’ll see.

Posted in Software | Comments Off on Updating WordPress

Two sources for the Weisberg Collection

There are currently two places to get materials from the Weisberg collection. The main source is naturally the website that Hood College set up for the collection.  The second source is Archive.org. The Archive.org now has a “copy” of the Hood collection, and when searching for Weisberg materials on-line, both of these often turn up in search results.

Curious about this, I finally got around to downloading the Weisberg materials on Archive.org last week and have now had a chance to take a look at them.  They turn out to be significantly different from the materials on the Hood College website, so I’m posting a note on some of these differences.

Archive.org is a gigantic filing cabinet, and it can sometimes be quite difficult to track down the sources of the materials that are put up there.  In this case, it seems the Weisberg materials there were posted mostly by one Mike Best, archivist for the National Security Internet Archive. I haven’t quite figured out who or what NSIA is, except that it is not related to the National Security Archive at George Washington University.  The NSIA was registered at Archive.org in March 2015, and since then it has since posted a huge amount of materials.  NSIA began posting Weisberg Materials in August 2015, and apparently finished putting up what they had by the end of September.

The description of the Archive.org version is at “Complete Weisberg Archive on the JFK Assassination”, which says: “Harold Weisberg donated the world’s largest accessible private collection of government documents and public records relating to the assassination of President John F. Kennedy to Hood College and the Beneficial-Hodson Library at Hood College, which donated a copy to the National Security Internet Archive.”

So this is not just someone scraping the Hood collection, but a copy provided by Hood to NSIA. If you really want the whole thing, there it is: 29 compressed files, over 100 gigabytes even in the ultra-compressed 7z format.  It was quite a job getting all this stuff direct from archive.org. There is a torrent file that might be faster, but the word is that our school throttles torrents, so I did multi-day downloading through archive.org.

Having gotten the whole thing, I’ve had a chance to compare parts of it with the Hood College version, and they are indeed different.  The most important difference is that the Hood pdf files were run through OCR software (apparently mostly Omnipage 18) to convert them into searchable files.  There is a search interface for the OCR versions available at the Hood website, and this is by far the most convenient, effective way of accessing the Weisberg collection.  The Archive.org files have not been OCRed; they are simply images.

This is not the end of the story though.  After some rather hard poking through the NSIA materials, it seems that this is very likely a working copy of the Hood materials.  It’s most useful feature is that it includes excel files for the pdfs in each directory. These excel files have all kinds of important information, such as dates, to-from fields for letters etc, and comments and cross-references to related documents.  These excel files are mostly not available from the Hood website.

Unfortunately, the fact that these are “working” files also has another meaning.  The whole thing seems to have been simply yanked off a hard disk at some point. The most recent files in the NSIA materials are dated 2015-07-12, and there are a number of temporary excel files included in the archive which also have this date. So the backup was done without even closing the excel files that were being edited.  A number of these were clearly not yet done, with numerous inconsistencies in the files listed in the excel sheets and the files actually present in the directory. Some of the excel sheets are even in the wrong directories, with whole directories sometimes misplaced inside other directories as well.

This is not to dismiss the amazing amount of work done on the collection. The large majority of the files are listed, and the large majority of the information listed is accurate, but the Weisberg collection is so huge that “large majority” means there are still thousands of places where there are problems. It is not a trivial task to fix these problems.

It is also worth noting that there are tens of thousands of duplicate pdfs throughout the collection. These are not just duplicate files in the Weisberg collection; there are places where the exact same pdf file is present in multiple locations. Some of this is probably some sort of cross referencing system. An example is that in the giant C zip file, there are dozens of directories of the form CIA [someone’s name].  Most of these appear in other places, with the directory name in the form [someone’s name] CIA. In the second form, however, sometimes the pdf files in these directories are still named CIA [someone’s name]. In cases where they have been renamed, it is almost always the case that they are still the same pdfs, just with the names changed. Some of these duplicate directories also do not appear in the materials on the Hood website and it seems that NSIA copy may represent the Hood archivists’ current efforts in this area.

Despite these problems, the NSIA copy is a useful ancillary to anyone who wants to work with the collection as a whole As an example, the excel indices include a “date” field for much of the collection’s files. According to this, the earliest fully dated document in the collection is Weisberg’s birth certificate: April 8, 1913.  There are also a few documents from after Weisberg’s death in 2002, including the obituary of Weisberg’s wife Lillian, who died March 20, 2003.  The most recent document is a powerpoint file for a 2011 conference presentation by Clayton Ogilvie, the primary archivist for the Hood collection (Presentation-Canterbury 01.pptx, located in the P zip file, apparently not otherwise available either at Archive.org or Hood).  This gives a very useful overview of the collection and its history.  Everyone interested in Weisberg and his materials owes a huge thanks to Mr. Ogilvie and the others who have put so much time into this project.

Posted in History, Research methods | Comments Off on Two sources for the Weisberg Collection

The Weisberg Collection

While looking up some names from articles in Studies in Intelligence, I ran into another interesting on-line resource: the Harold Weisberg Archive, hosted at Hood College in Frederick, Maryland. When a number of CIA names kept turning up at the Archive, I decided to take a look at it.  It turns out to be a huge collection, with some very interesting material.

Harold Weisberg was one of the many people who quickly became convinced, following the assassination of President John Kennedy in 1963, that Lee Harvey Oswald might not have been the killer, and/or that the assassination might have involved more than one person.  Weisberg was apparently first off the mark in writing a book denouncing the Warren Commission’s report on the assassination.

His book, Whitewash, was published in March 1965, a remarkably fast 6 months after the Commission published the 26 volumes of evidence and testimony it collected.  At the same time, he began collecting a huge assortment of documents relating to the assassination, which now form the basis of the Archive site.

During the rest of the 1960s, Weisberg went on to write a whole “Whitewash” series, almost all self-published.  He was an enthusiastic participant in Jim Garrison’s investigation of the assassination, but later came to see Garrison as a fraud.  Moving on from Garrison, but not the assassination, Weisberg was an early advocate of using the Freedom of Information Act to get at restricted records, and the lawsuits he filed throughout the 70s and 80s make up a big part of the Archive.

Weisberg was considerably older than most (but not all) of the crowd looking into the assassination; he was 50 the year Kennedy was killed.  He thus came from a quite different background than the other writers on the assassination, such as Mark Lane and Edward Epstein, and it turns out that he had personal reasons to suspect government misconduct both in the assassination and in the investigation; he was fired from a State Department position in the late 1940s as a suspected Communist.

He also brought investigative skills and tactics to the JFK assassination which were honed in the 1930s, when he worked for the La Follette Committee investigating union busting activities, and in the 1940s, when he did free lance investigative writing for magazines such as Click and Picture.  Apparently he had a brief spell in the OSS as a Latin American analyst, which led to his State Department position, but I haven’t yet found the records for this part of the story.

In other ways, though, Weisberg seems to have been typical of the assassination buff. He was an inveterate newspaper clipper and letter writer, and these make up a huge part of the Archive. The newspaper clippings, in addition to assassination related material, focus on the CIA, Vietnam, and Watergate, which is why the Archive kept showing up in my searches.

The letters are often very cryptic to me, since my knowledge of the assassination is close to zero.  From what I do understand, Weisberg comes off as highly opinionated and irascible. His letters are full of blunt comments often aimed directly at his correspondents, who seem to have included most of the major assassination buffs.  His invective doesn’t have the cruel, multi-faceted edge of the “great masters of vituperation”, such as Baron Corvo, but if you’re looking for straight denunciation of hare-brained stupidity, he’s got it.  One thing you won’t find though; any admission of ever having been wrong himself.  Or maybe I just haven’t come to those letters yet.

Weisberg died in 2002. For several years before his death he had been negotiating with Hood College, located near his home in Frederick, Maryland, to donate his 60 (!) filing cabinets of assassination related material after his death.  The Archive website is proof that Hood did not just chuck everything in the library basement.

Posted in History, Research methods | Comments Off on The Weisberg Collection

Notes on Studies in Intelligence

I’ve read a bit more from and about Studies in Intelligence, the CIA’s in-house intelligence journal (not that much, put down that blindfold and cigarette).  A few random notes on this for today.

The most interesting discovery was the SI article ‘Fifty Years of Studies in Intelligence by Nicholas Dujmovic.  This article answered many of the questions I had after careful research in SI‘s back issues (e.g., “Rita Kronenbitter” was a man, not a woman), but it also beat me to the punch, publishing some of the discoveries I had made in my own in-depth research (e.g. the journal changed page format in 1972).  The list of chief editors, the overview of trends in article topics, and the description of the evolution of SI’s unclassified section, along with second thoughts about whether it’s a good idea for SI to develop a readership among the general public (my hand is up) are all well worth a read.

Another interesting article from a very different perspective is by Jeffrey Richelson at George Washington University’s National Security Archive, Studies in Intelligence: New Articles from The CIA’s In-House Journal.’ The Archive is an academic project by several researchers who have banded together to pry open as many government filing cabinets as the Freedom of Information Act allows. Richelson has been working on getting SI articles declassified for some time; this article presents some of his finds as well as some carefully documented complaints about CIA failures to comply with the spirit, and sometimes the letter, of the FOIA.  The article was originally posted June 4, 2013, with 19 newly declassified articles.  A revised version was posted November 20, 2014 with seven additional articles after the Jeffrey Scudder case concluded (see Washington Post, July 4, 2014, “CIA employee’s quest to release information ‘destroyed my entire career.'”)

If you are looking here for trivia on SI, an overview of its content, or a critique of its value, you are definitely looking in the wrong place; that is not the sort of thing the Archive usually does. Instead, the focus is on what articles SI has not been willing to release, and why their decisions are often arbitrary, inconsistent, and just plain wrong headed.  Fair enough, especially since Richelson, unlike Dujmovic, has only a carefully redacted copy of SI’s table of contents to date.  And as Richelson notes, the copy they gave him is about 130 titles shorter than the copy they gave another group, who used litigation to get it, rather than a polite FOIA request.

Certainly there is much confusion about what has been declassified and what has not. Tracing down when where and how articles were declassified and made publicly available might be interesting in this respect. Dujmovic has actually made a start on this, but for the fan of the truly trivial, no doubt there is a lot more to be done.

Posted in History, Intelligence | 1 Comment

Welcome to the 2016 spring semester

A new semester is starting, and I’ll be teaching some general education classes that I haven’t taught for a while.  Hope these are interesting for all of you who decided to enroll, I’m looking forward to meeting you!

Posted in School | Comments Off on Welcome to the 2016 spring semester

End of semester is here

The fall semester of 2015 ends with a shiver! Grades are done and should be mailed to you on time this year. If you want a rough preview, check your Moodle class page grade report.

Enjoy the snow up on the peaks around school, but be sure to bundle up and drive carefully if you take your motorcycle out. See everyone next semester!

Posted in School | Comments Off on End of semester is here

Idle reading

I confess to reading stuff on the internet when I should be working. Before you drag me off and shoot me, try this site. What is this? It is a sortable index to every article that has been declassified from the CIA’s in house journal, Studies in Intelligence, now published as a quarterly. The sortable index (a state of the art web-page, done by someone appropriately anonymous) is usually several months out of date; if you want the latest issue, try here the official website, here. Although there are always dense, chunky articles on policy, or new ways of thinking about intelligence, Studies in Intelligence is also full of great bits of forgotten or obscure history, such as “A Cable to Napoleon” by Edwin Fishel, who is identified elsewhere in Studies as a retired NSA analyst.

Another great feature are the book reviews; each issue has several lengthy reviews of books and/or movies, all intelligence related of course, and “The Intelligence Officer’s Bookshelf,” a collection of thumbnail reviews by Hayden Peake. Peake is an acknowledged expert in intelligence history, and an expert at condensing bulky stuff into a few pithy comments. Reading Peake coolly take apart yet another unreliable collection of spy anecdotes is a pleasure comparable to reading that other great debunker of historical anecdote, Ramon Adams (Burs under the Saddle; a Second Look at Books and Histories of the West. Norman, OK: University of Oklahoma Press, 1964).

All in all, I rate Studies as a great return on the taxpayer dollars. Okay, now give me my blindfold and cigarette.

Posted in History, Intelligence, Research methods | Comments Off on Idle reading

Original German text of Darkness at Noon found

Arthur Koestler’s novel Darkness at Noon, inspired by the Moscow show-trials of 1936-38, is one of the most important novels of the twentieth-century. Koestler originally wrote Darkness in German while he was living in Paris, supposedly between 1938 and 1939. It was translated into English by Daphne Hardy, an English sculptor Koestler was involved with at the time. Hardy’s translation was published in 1941, but Koestler’s German original was lost. When Darkness was later published in German, it was a back-translation from the English version.

Last month, however, the long-lost German original finally turned up in the Zurich Central Library. The text found was a typescript, with Koestler’s hand-written corrections on it, dated March 1940. The original German text is big news indeed. Darkness has been grossly under-estimated in German literature, partly because of the fact that the only edition available until now was a back-translation, partly because of its status as a central anti-Stalinist work. New and interesting work should come from this soon.

Posted in Literature | Comments Off on Original German text of Darkness at Noon found

A new semester’s greetings

A little late, but welcome to my students this semester! Looking forward to seeing you in class.

Posted in School | Comments Off on A new semester’s greetings

Fixing textwidth in vim

I have had several problems with my program editor Vim recently.  Here is how I fixed one of them.

There are two directories that I had to mess with:
c:\program files\vim [vim directory]
c:\users\rabbit [user directory]

the vim directory is the standard installation directory for vim in windows
the user directory is new with Windows 7, and is where you’re supposed to put config files for programs in the default installation location

When I first installed Vim 7.* on Windows XP, I put in some basic preferences in the vim directory, then promptly forgot what I had done. When I updated to new versions of Vim, these settings, such as textwidth, did not get wiped out, but instead kept on doing what I set them to do. Now that I’m on a new machine with windows 7, these modifications are gone.

Windows 7 now bans editing files in the c:\program files directory. This is supposed to improve security. This means I can’t just go into the vim directory and fix things. Instead I have to put all my config files in the user directory

This is not as simple as it sounds. One particular problem I have had is vim’s textwidth. Vim out of the box breaks lines at every 78 characters in text files. I tried just issuing the textwidth = command which should turn this off. It did not. I tried the windows way, using my old _vimrc config file from XP. This did not work. Why?

It turns out that I turned off line wrapping at the top of _vimrc file. But then I added something else, so that my _vimrc file looked like this:

set nowrap
source $VIMRUNTIME/vimrc_example.vim
source $VIMRUNTIME/mswin.vim
behave mswin

So why is it still wrapping? Why can’t I just turn it off by :set nowrap, or textwidth =
Because ….
The vimrc_example.vim file includes the following lines:

” For all text files set ‘textwidth’ to 78 characters.
autocmd FileType text setlocal textwidth=78

This turns wrapping back on for every new text buffer I open. I have found and forgotten this problem 3 times in the last year and a half, each time wasting as much as an hour! Definitely worth an entry here as a reminder.

To fix this, I copy only the stuff I want from vimrc_example straight into _vimrc, omit source $VIMRUNTIME/vimrc_example.vim, and voila, no more mysterious text wrapping.

Posted in Programming, Software | Comments Off on Fixing textwidth in vim