A. Harry Klopf, an American senior scientist for machine intelligence, since the early 70s affiliated with the Avionics Directorate, Wright Laboratory and Air Force Research Laboratory, Aeronautical Systems Center, Wright-Patterson Air Force Base, Ohio. His research focused on reinforcement learning, and adaptive behavior as approaches to the analysis of natural intelligence and the synthesis of machine intelligence [1]. Temporal difference learning has one root in Klopf's work on animal learning psychology [2] - beside Arthur Samuel's pioneering work on his self learning Checkers player in the late 50s [3] [4].
A. Harry Klopf [5]

Selected Publications

1970 ...

• A. Harry Klopf (1972). Brain Function and Adaptive Systems - A Heterostatic Theory. Air Force Cambridge Research Laboratories, Special Reports, No. 133, pdf ^[7]
• A. Harry Klopf (1975). A Comparison of Natural and Artificial Intelligence. ACM SIGART Bulletin, No. 52

1980 ...

• A. Harry Klopf (1982). The Hedonistic Neuron: A Theory of Memory, Learning, and Intelligence. Hemisphere Publishing Corporation, University of Michigan ^[8]
• A. Harry Klopf (1987). A Neuronal Model of Classical Conditioning. Technical Report, Air Force Wright Aeronautical Laboratories ^[9]
• A. Harry Klopf (1988). A Theoretical Neuronal Learning Mechanism That Predicts the Basic Categories of Classical Conditioning Phenomena. in Cellular Mechanisms of Conditioning and Behavioral Plasticity

1990 ...

• A. Harry Klopf, Scott E. Weaver, James S. Morgan (1993). A Hierarchical Network of Control Systems that Learn: Modeling Nervous System Function During Classical and Instrumental Conditioning. Adaptive Behavior, Vol. 1, No. 3
• Mance E. Harmon, Leemon C. Baird III, A. Harry Klopf (1995). Reinforcement Learning Applied to a Differential Game. Adaptive Behavior, Vol. 4, No. 1, pdf
• Leemon C. Baird III, Mance E. Harmon, A. Harry Klopf (1996). Reinforcement Learning: An Alternative Approach to Machine Intelligence. pdf

2000 ...

• Jeffrey D. Johnson, Wei Li, Jinghong Li, A. Harry Klopf (2001). A Computational Model of Learned Avoidance Behavior in a One-Way Avoidance Experiment. Adaptive Behavior, Vol. 9, No. 2

References

1. ^ "About the Authors" from Leemon C. Baird III, Mance E. Harmon, A. Harry Klopf (1996). Reinforcement Learning: An Alternative Approach to Machine Intelligence. pdf
2. ^ A. Harry Klopf (1972). Brain Function and Adaptive Systems - A Heterostatic Theory. Air Force Cambridge Research Laboratories, Special Reports, No. 133, pdf
3. ^ Arthur Samuel (1959). Some Studies in Machine Learning Using the Game of Checkers. IBM Journal July 1959
4. ^ Richard Sutton, Andrew Barto (1998). Reinforcement Learning: An Introduction. MIT Press, 6.10 Bibliographical and Historical Remarks
5. ^ Image from Leemon C. Baird III, Mance E. Harmon, A. Harry Klopf (1996). Reinforcement Learning: An Alternative Approach to Machine Intelligence. pdf
6. ^ dblp: A. Harry Klopf
7. ^ Heterostasis from Wikipedia
8. ^ Hedonism from Wikipedia
9. ^ Classical conditioning from Wikipedia

What links here?