Quantcast
Channel: Christos military and intelligence corner
Viewing all 538 articles
Browse latest View live

Overview of 2017

$
0
0
2017 turned out to be a very productive year. During 2017 I copied material from government archives in Germany, US and UK, I received a lot of material from the NSA’s freedom of information act office and I also benefitted from the release of interesting files that were uploaded to the NSA and CIA FOIA websites.

Some of my friends also shared important reports with me and I did my best to repay them by giving them some of my material.


1). Regarding original essays, I wrote the following:














2). I also added new information and pics in various older essays:


The American M-209 cipher machine (I added notes and information from various sources)


Wartime exploitation of Turkish codes by Axis and Allied powers (I added decoded Turkish diplomatic messages)


Soviet partisan codes and KONA 6 (I added information from the TICOM report I-26)


The Japanese FUJI diplomatic cipher 1941-43 (I rewrote parts and added information from TICOM I-181)


Japanese codebreakers of WWII (I added new links and uploaded a PDF file with the decoded US diplomatic messages)


Svetova Revoluce and the codes of the Czechoslovak resistance (I added information from the report‘Dopady lúštenia šifrovacieho systému čs. londýnskeho MNO z rokov 1940-1945 na domáci odboj’ and the essay ‘STP cipher of the Czechoslovak in-exile Ministry of Defence in London during WWII’)


Decoding Prime Minister Chamberlain’s messages (I added information from TICOM DF-241 and from ‘British Intelligence in the Second World War- volume 2’)


Soviet cipher teleprinters of WWII (I added information from the TICOM reports DF-240 and DF-241)


Compromise of Soviet codes in WWII (I rewrote parts and added information from various sources)


The Slidex code (I added the British Air Support Signals Unit card No. 1)


3). I uploaded the following files and links:




American Cryptology During the Cold War 1945-1989, Book I (NSA website)























4). I posted the following book presentations:







Mission accomplished?

$
0
0
As I said in a previous essay I started this site because I wanted to move away from history forums and create my own space in the internet.

Since then I think that I have written many essays of real historical value, especially in the field of cryptology. I am satisfied that I’ve covered in detail all the cases that interested me, whether they dealt with general military history, performance of weapon systems, wartime economic history or spies and cryptology.


I did this on my own without support from a university, think tank or government organization.


The remaining cases that I am going to pursue in 2018 are the following:


1). Carlson-Goldsberry report: I am waiting for the NSA to declassify this document. Once they do I’ll add the information in my essays on State department codes and the Finnish codebreakers.


2). Remaining freedom of information act cases: I have to wait for the declassification of TICOM reports I-40 and DF-196. Once I received them I will upload them to my Google drive and Scribd accounts but I doubt they will have any new information not already mentioned in the other TICOM reports.


3). Files in the US National archives: During the year I will check again with NARA’s research department regarding the NSA files that I was unable to locate in 2017. Specifically the TICOM report ‘Interrogation of mr Hayashi’ and the two German reports E-Bericht der NAAst 5’ for second half 1944. Unfortunately there are no guarantees that these files will be located.


Apart from that I’ll also keep an eye out for anything interesting like academic articles, release of new material to the archives, new books etc. I am especially interested in the following topics:


1). Office of Strategic Services codes and ciphers, especially any postwar evaluation of their cipher security.


2). The wartime achievements of the Soviet codebreakers and the codes and ciphers of the Red Army.


3). The Soviet cryptosystems solved by the Anglo-Americans in the period 1945-48. Unfortunately the NSA history BOURBON to Black Friday: The Allied Collaborative COMINT Effort against the Soviet Union, 1945-1948 has many chapters deleted. 

Joint Chiefs of Staff evaluation of Office of Strategic Services ciphers

$
0
0
In 1943 and 1944 the US Joint Chiefs of Staff evaluated the cryptosystems used by the various US government agencies.

For example the report on State Department codes and ciphers for 1943 can be found in the NSA website and the report of 1944 is in the US national archives, in collection RG 457- Entry 9032- box 1384 - 'JCS Ad hoc committee report on cryptographic security of government communications'.


The ciphers of the Office of Strategic Services were also evaluated and there is some information on this topic in the US national archives, specifically Record Group 226 - Series: Correspondence Files, 1942 – 1946 - File Unit: 17) Cryptographic Security:











Unfortunately there are no detailed reports on the subject but from the information presented above it seems that even as late as 1944 OSS communications were sent on vulnerable cryptosystems (double transposition and M-138-A cipher).

Army Security Agency operations in Early Cold War Germany

$
0
0
The interesting article ‘The U.S. Army Security Agency in Early Cold War Germany’ is available in the latest issue of Army History Magazine.

Staff Study on OSS Cryptographic Plan - January 1945

$
0
0

Another document that has information on the OSS crypto systems is ‘Staff Study on OSS Cryptographic Plan’, available from the US National Archives - collection RG457- Entry 9032 - NR 3280 ‘Staff Study on OSS Cryptographic Plan’.


The report is also available from the journal ‘Cryptologia’, vol13, no.3:


 SECRET

HEADQUARTERS, ARMY SERVICE FORCES

OFFICE OF THE CHIEF SIGNAL OFFICER

WASHINGTON 25, D.C.


  SPSIC-6                                                                                            8 January 1945


MEMORANDUM for Assistant. Chief of Staff, G-2

Subject: Staff Study on OSS Cryptographic Plan

The enclosed staff study is forwarded for your consideration and comment,


For the Chief Signal Officer:  
                                                                                      W, Preston Corderman

                                                                                                                                                                                                                                          Colonel, Signal Corps

                                                                                                                                                                                                                                     Chiefs Signal Security Branch

1. Incl

Study on OSS Cryptographic Plan


STAFF STUDY ON OSS CRYPTOGRAPHIC PLAN 


PROBLEM PRESENTED


1. How may the need of OSS for a high grade, high speed cryptographic system be satisfied?


FACTS BEARING ON THE CASE


2. OSS has a requirement for a high grade, high speed cryptographic system for the encipherment and decipherment of secret traffic.


3. At the present time OSS is using the Converter M-134-A (short title SIGMYC) to satisfy this requirement.


4. Prior to 5 April 1944, eight (8) SIGMYC were issued to OSS.


5. The Assistant Chief of Staff, G-2, authorized the issue of twenty-six (26) SIGMYC to OSS by memorandum for Col. Corderman from Col. Clarke dated 5 April 1944, to meet the expanding needs of that organization.


6. Since 5 April 1944, twenty-one (21) SIGMYC have been delivered to OSS. That organization now holds twenty-nine (29) machines; five more are available for issue.


7. In the past OSS has used one universal set of rotors with SIGMYC. These rotors were replaced once.


8. In September 1944 OSS requested two new sets of rotors, one set to be used in Europe and the other set in the Far East. Thirty-eight (38) sets of rotors SIGRHAT (for use in the Far East) have been issued in compliance with that request.


9. Twenty-five (25) sets of rotors SIGSAAD (for use in Europe) have also been issued.


10. Instructional documents associated with SIGMYC are "Operating Instructions for Converter M-134 and M-134-A (Short title SIGKOC and ‘photographs and Drawings of Converter M-134-A (short title SIGVYJ). No copies of these publications are available for issue. This situation was caused by the destruction of the instructional documents when Converters M-134-A were turned in by Army holders.


11. Requests are received for spare parts with each request for the issue of a SIGMYC. The spare parts list always include rotor stepping solenoids. There are no rotor stepping solenoids on hand in this agency. Three requests for these items have not been fulfilled.


12. In accordance with authorization of the Assistant Chief of Staff, G-2, 27 July 1944, one SIGTOT room circuit was furnished OSS in Washington. Authorization did not extend to the issuance of tapes for use with this equipment. Additional SIGTOT circuits have been made available to OSS in Europe. That organization is procuring additional tape punching equipment to meet the increased demand for tape. OSS requested the loan of such equipment until they are prepared to fulfill their own needs for tape. This branch is supplying OSS with sufficient tape until that organization is self-supporting in this respect.


13. Four (4) SIGCUM have been issued to OSS with the approval of the Assistant Chief of Staff, G-2, 28 April 1944. These machines were sent to OSS in North Africa to replace four (4) SlGCUM which were loaned to OSS by NATO and subsequently recalled by the latter organization.


14. Within the past six (6) months the communications requirements of OSS have markedly increased. The cryptographic requirements have expanded proportionately. The rapid expansion is vividly illustrated by the strip cipher requirements of that organization. In June 1944 SSA requested OSS to furnish a monthly quota of desired material in order to adjust production schedules here. The monthly quota of strip cipher systems needed is now larger than the total number of strip systems issued to OSS over a period of twenty (20) months.


15. It is believed that the OSS will request the five (5) remaining SIGMYC of the authorized allotment of twenty-six (26) machines. Instructional documents are not available for issue with these converters. The reprinting of these documents presents a major reproduction job.


16. OSS encounters an ever present maintenance problem since the machines are constantly breaking down. It is believed that the time is not far distant when it will be impossible to maintain the machines adequately,


17. In order to provide new rotors in the future it will be necessary to have rotors returned from the field by OSS for rewiring. Thus, a rotation process will be established to meet new demands for rotors which will result in the wearing out of the rotors within a relatively short time. It is noted that it would take between one to two years to procure new rotors.


18. OSS is now trying out a modification of the standard --text deleted -- device, which utilizes -*- --text deleted--. That organization is contemplating an increase in the distribution of these --text deleted – to include the standard --text deleted – held by OSS, thus, permitting inter-communication between the two machines. The cryptographic principle involved his been approved by the Signal Security Agency. OSS plans to utilize the -*- --text deleted-- for secret radio transmissions.


19.  The question arises as to what other means are available. The following items of equipment are considered:


a. SIGTOT 


This system provides adequate security but the scarcity of equipment and the difficultly of providing sufficient quantities of one-time tape render its use impracticable. In addition SIGTOT is not at present adapted to multi-holders of a common system, which is an operational requirement


b. SIGABA


 Under present policy, it would be necessary to assign a crypt team with each machine in order to make them available to OSS. This presents a problem of securing sufficient personnel which appears insurmountable at the present time. Furthermore, the use of SIGABA as a solution to this problem is not generally regarded with favor.


c. SIGCUM


The communications and cryptographic problems of OSS are developing rapidly in the Far East where traffic is transmitted largely by radio. Since SIGCUM may not be employed for secret traffic transmitted by means of radio the use of this machine would not provide a solution to the problem, Although SIGCUM would be a satisfactory substitute for SIGMYC in Europe, a revision of the cryptographic facilities of OSS in that area is not considered feasible at this time.


d. SIGFOY


This converter provides adequate security to fulfill the need for a high grade cryptographic system and is well adapted to multiple holders of a common system. Since it is not a high speed system, it would not fulfill this requirement.


e. SIGLASE


This system would provide adequate security and speed to meet the outlined requirements. However, since SIGLASE is still in the development stage and the expected date of issue is unknown it is not the immediate answer to the OSS problem.


20. From the point of view of this branch the problem could be most acceptably solved by making Army facilities available to OSS. It is realized that the latter organization would probably not be favorably disposed toward such a solution,


CONCLUSIONS


21. The continued use of SIGMYC by OSS in the Far East will present maintenance and 
distribution problems which will be virtually impossible to solve.


22. A replacement for SIGMYC is needed.


23. SIGABA, SIGCUM and SIGTOT are not completely acceptable substitutes.


24. SIGFOY and SIGLASE would be a solution to the problem but since it will require from six to nine months to manufacture the SIGLASE, it cannot be considered an immediate solution.


25. It appears that the only immediate solution to the problem is for OSS traffic to be handled by Army cryptographic facilities.


RECOMMENDATIONS


26. That OSS be requested to utilize Army cryptographic communications facilities where such exist.


27. That OSS use its own cryptographic communications facilities where Army facilities do not exist.


28. That, at such time as the equipment referred to in paragraph 27 becomes unserviceable, service be maintained by those Army cryptographic facilities and/or equipments as may then be available.


A report dated 8 February 1946 (found in SRH-366 ‘The history of Army strip cipher devices’) has more information on the implementation of the aforementioned OSS cryptographic plan.

Update

Article on Germans signals intelligence operations in occupied Yugoslavia

$
0
0
The ‘Journal of Intelligence History’ article ‘The German ‘ultra’: signals intelligence in Yugoslavia 1943–1944’ by Gaj Trifković has interesting information on the dissemination and use of signals intelligence by the Germans in their war against the Chetnik and Partisan resistance movements in WWII.

ABSTRACT

This article deals with the extensive signals surveillance program operated by the Wehrmacht and directed at their most dangerous enemy in the Balkans, the Yugoslav Partisans. This subject has so far received surprisingly little attention in academic circles despite the fact that it was one of the crucial pillars of the entire Axis counter-insurgency effort in Yugoslavia and that it was one of the most successful actions of its kind conducted by the German intelligence. Based largely on previously unpublished primary sources, as well as post-war literature, this article will outline the workings of the program during its heyday in the years 1943–1944 and seek to establish its impact on the battlefield. As such, it will hopefully prove to be useful to both students of wartime events in the Western Balkans and to researchers of intelligence services during the Second World War in general.

Joint Chiefs of Staff evaluation of Office of War Information ciphers

$
0
0
During WWII the US Office of War Information engaged in intelligence gathering and propaganda activities against the Axis powers.

The representatives of the OWI used various cipher systems in order to protect their communications and these systems were examined by the Joint Chiefs of Staff.


A summary report was issued in July 1944 and it found problems with physical security, classification procedures, stereotyped messages and cipher reuse.


Regarding OWI ciphers it was noted that ‘Present double transposition keys have been in use since they were produced by the Signal Corps in late 1942 and early 1943’ and the recommendation was ‘That immediate supersession of these keys be accomplished and that provision be made for their more frequent supersession in the future’.













Source: US National Archives, collection RG 208, Office of Wartime Information: General Records of the Security Officer, Entry 9. Location:  350/71/17/6, Box 1. Folder Communications Survey OWI.


Acknowledgements: I have to thank Robert Hanyok for locating and copying the JCS evaluation.

To err is human vol 4

$
0
0
In my essay Rommel’s microwave link I had mentioned that a German speech cipher system was used on a microwave link connecting the German high command with Rommel’s HQ in North Africa.  

According to ‘Spread Spectrum Communications Handbook’ vol1:


'In 1935, Telefunken engineers Paul Kotowski and Kurt Dannehl applied for a German patent on a device for masking voice signals by combining them with an equally broad-band noise signal produced by a rotating generator. The receiver in their system had a duplicate rotating generator, properly synchronized so that its locally produced noise replica could be used to uncover the voice signal. The U.S. version of this patent was issued in 1940, and was considered prior art in a later patent on DSSS communication systems. Certainly, the Kotowski-Dannehl patent exemplifies the transition from the use of key-stream generators for discrete data encryption to pseudorandom signal storage for voice or continuous signal encryption. Several elements of the SS concept are present in this patent, the obvious missing notion being that of purposeful bandwidth expansion.


The Germans used Kotowski’s concept as the starting point for developing a more sophisticated capability that was urgently needed in the early years of World War II. Gottfried Vogt, a Telefunken engineer under Kotowski, remembers testing a system for analog speech encryption in 1939. This employed a pair of irregularly slotted or sawtoothed disks turning at different speeds, for generating a noise-like signal at the transmitter, to be modulated/multiplied by the voice signal. The receiver’s matching disks were synchronized by means of two transmitted tones, one above and one below the encrypted voice band. 

This system was used on a wire link from Germany, through Yugoslavia and Greece, to a very- and/or ultra-high frequency (VHF/UHF) link across the Mediterranean to General Erwin Rommel’s forces in Derna, Libya.'


After having a look at google patents I saw that Vogt was credited with a patent and I thought that this was the speech cipher system but I was corrected by klausis krypto kolumne commenter ‘Thomas’, who linked the Kotowski-Dannehl patent.


Thus in Rommel’s microwave link I’ve added a link and pics to patent US2211132A.

Candle in the Dark: COMINT and Soviet Industrial Secrets, 1946-1956

Radio War Nerd interview of Yasha Levine

Coldspur’s website

Bye bye mr Hayashi

$
0
0
In 2017 I tried to locate a file in the US national archives called ‘Interrogation of mr Hayashi’. 

According to the NSA FOIA office it had been recently transferred to NARA as part of transfer group TR-457-2016-0009. The reference I was given by NARA pointed to 36 boxes that have not been indexed, so the file could not be located by my researcher. 

I tried to find the Hayashi file again this year by asking NARA’s research department if they could locate it but I was told that ‘We have carefully searched our holdings with a particular focus on Record Group 457 - Entry P4…….however, we were not able to locate the file’.


Thus it seems that this is the end of my quest for the Hayashi file.

The Carlson-Goldsberry report - Compromise of State Department communications by the Finnish codebreakers in WWII

$
0
0
During WWII the US State Department used several cryptosystems in order to protect its radio communications from the Axis powers. For low level messages the unenciphered Gray and Brown codebooks were used.  For important messages four different codebooks (A1, B1, C1, D1) enciphered with substitution tables were available.

Their most modern and (in theory) secure system was the M-138-A strip cipher. Unfortunately for the Americans this system was compromised and diplomatic messages were read by the Germans, Finns, Japanese, Italians and Hungarians. The strip cipher carried the most important diplomatic traffic of the United States (at least until mid/late 1944) and by reading these messages the Axis powers gained insights into global US policy.


Germans, Finns and Japanese cooperated on the solution of the strip cipher. In 1941 the Japanese gave to the Germans alphabet strips and numerical keys that they had copied from a US consulate in 1939 and these were passed on by the Germans to their Finnish allies in 1942. Then in 1943 the Finns started sharing their results with Japan. 


Finnish solution of State Department cryptosystems


During WWII the Finnish signal intelligence service worked mostly on Soviet military and NKVD cryptosystems however they did have a small diplomatic section located in Mikkeli. This department had about 38 analysts, with the majority working on US codes.

Head of the department was Mary Grashorn. Other important people were Pentti Aalto (effective head of the US section) and the experts on the M-138 strip cipher Karl Erik Henriksson and Kalevi Loimaranta.


Their main wartime success was the solution of the State Department’s M-138-A cipher. The solution of this high level system gave them access to important diplomatic messages from US embassies in Europe and around the world. 


Operation Stella Polaris


In September 1944 Finland signed an armistice with the Soviet Union. The people in charge of the Finnish signal intelligence service anticipated this move and fearing a Soviet takeover of the country had taken measures to relocate the radio service to Sweden. This operation was called Stella Polaris (Polar Star).


In late September roughly 700 people, comprising members of the intelligence services and their families were transported by ship to Sweden. The Finns had come to an agreement with the Swedish intelligence service that their people would be allowed to stay and in return the Swedes would get the Finnish crypto archives and their radio equipment. At the same time colonel Hallamaa, head of the signals intelligence service, gathered funds for the Stella Polaris group by selling the solved codes in the Finnish archives to the Americans, British and Japanese. 

The Stella Polaris operation was dependent on secrecy. However the open market for Soviet codes made the Swedish government uneasy. In the end most of the Finnish personnel chose to return to Finland, since the feared Soviet takeover did not materialize. 


The American reaction and the Carlson-Goldsberry report


According to the NSA study History of Venona (Ft. George G. Meade: Center for Cryptologic History, 1995), it was at that time that the Finns revealed to the US authorities that they had solved their diplomatic codes. On 29 September 1944 colonel Hallamaa met with L. Randolph Higgs of the US embassy in Stockholm and told him about their success.



In response two cryptanalysts were sent from the US to evaluate the compromise of US codes in more detail. They were Paavo Carlson of the Army’s Signal Security Agency and Paul E. Goldsberry of the State Department’s cipher unit. Their report dated 23 November 1944 had details on the solution of US systems.



The Carlson-Goldsberry report


Unfortunately locating this report proved to be quite a problem. Initially I searched for it in the US National Archives (both in the NSA and OSS collections) but without success.


Thankfully the NSA FOIA/MDR office has managed to locate this file and they have finally declassified it.







The 4-page report summarizes the information gathered by US officials from their interviews of Finnish codebreakers in 16, 18 and 21 November 1944.


From the Finnish side Erkki Pale (head of the department working on Soviet ciphers) and Kalevi Loimaranta (member of the department dealing with foreign diplomatic codes) gave a summary of their work on various cryptosystems.


The Finns admitted to solving US diplomatic systems, both codebooks and the strip cipher M-138-A. According to them an unenciphered codebook could be reconstructed in 6 months but an enciphered one was harder to solve.


Regarding the M-138-A cipher it was solved because the alphabet strips were used for long periods of time, the same strips were used by several users and the numerical keys were the same for all users. Stereotypical beginnings and endings were also exploited in assumed plaintext cryptanalytic attacks.


There was cooperation with the German codebreakers on US systems and the Finns received a lot of intercepts from them.


The Finnish codebreakers also used a number of IBM machines for statistical work.


Although the Finns stated that after the introduction of channel elimination in January 1944 they could no longer solve strip cipher traffic a memo included in the report says that their detailed knowledge of channel elimination procedures may indicate continued success with the M-138-A system.



Acknowledgments: I have to thank my friends in the US for requesting this file from the NSA FOIA/MDR office and getting it declassified.

Essay by Frode Weierud on Inspectorate 7/VI cryptanalyst


The IBM Codatype cipher machine

$
0
0
In the files of the NSA’s Friedman collection there is a report by William F. Friedman, dated September 1937, which deals with a cipher machine called Codatype (1). 




Apparently David Salmon, the State Department’s chief of the Division of Communications and Records wanted Friedman’s opinion on the security afforded by the Codatype machine.

Although the device appeared to be ‘highly reliable, speedy and efficient’ Friedman’s conclusion was that ‘the degree of cryptographic security afforded by the machine is relatively low, and certainly not sufficient for governmental confidential or secret messages’ and ‘It is doubtful whether anything can be done to eliminate the more or less fatal cryptographic weakness of this model and still retain a machine and cryptographic system which will be practical for the purpose for which intended’.


Thus the Codatype remained a prototype and was not acquired by the State Department.


The device was designed by the IBM engineer Austin Robert Noll, US patent 2,116,732 (2):








Notes:



Another dead end?

$
0
0
Last month i posted the recently declassified Carlson-Goldsberry report. A memo included in the report had the following handwritten notes: RG 84 box 1 and an NND number that looks like 857570 or 857560.


This seems to lead to US National Archives collection RG 84 ‘Records of Foreign Service Posts of the Department of State’.


The NND number doesn’t seem to be 857570 because that code is associated with reports of the ‘Supreme Headquarters Allied Expeditionary Force. Office of the U.S. Political Officer. 2/13/1944-ca. 9/2/1944’.


Other combinations such as 851510, 857510, 851570 are not valid.


This leaves NND 857560. This code tracks to RG 84 ‘Sweden’ - Entry 3198 ‘Top Secret General Records, 1944 – 1952’.


This makes sense as that report was sent from the US embassy in Sweden.


One would expect to find the Carlson-Goldsberry report there.


So when I told my researcher to check this box I expected that I would be able to get the reports sent from Sweden in late 1944 summarizing the talks US officials had with the Finnish codebreakers.


Unfortunately both my researcher and the NARA FOIA office have confirmed that these reports are not there!


So why does the note say RG 84 box 1 NND 857560?


I’ve asked the NSA FOIA office if they can give me more information on where they got this document. If they respond maybe I will be able to track down similar reports in NARA.

Cipher systems of the German Foreign Ministry

Article on Chinese codes and ciphers

$
0
0
Interesting article from the journal Cryptologia: ‘Chinese cryptography: The Chinese Nationalist Party and intelligence management, 1927–1949’ by Ulug Kuzuoglu.

ABSTRACT


This paper is the first scholarly attempt to examine the history of Chinese cryptography and the role it played in building the intelligence network of the Chinese Nationalist Party (KMT) from 1927 to 1949. Rather than investigating the institutional structure of intelligence, I focus on Chinese characters, the primary medium that made cryptology and intelligence possible. Given that the Chinese writing system is by nature nonalphabetic and thus noncipherable, how did cryptography work in Chinese? How did the state and its scientists reengineer Chinese characters for the purposes of secret communication? This paper argues that due to the Chinese writing system itself, Chinese cryptography was bound to the use of codebooks rather than ciphers; thus, “codebook management” was central to building intelligence networks in China.

Analysis of the Czechoslovak STP cipher

Viewing all 538 articles
Browse latest View live


Latest Images