Evo main page
GP main page
1987 GP paper
Jürgen Schmidhuber's page on
Evolution
TU Munich Cogbotlab


Meta-Genetic Programming etc

RNN-Evolution
Reinforcement Learning
In 1987 Schmidhuber published his first paper on "Genetic Programming". His diploma thesis came out in the same year and was more ambitious, describing first general purpose learning algorithms:

Evolutionary principles in self-referential learning. (On learning how to learn: The meta-meta-... hook.) Diploma thesis, Institut f. Informatik, Tech. Univ. Munich, 1987. (See jpeg scan below.) Pages 7-13 are devoted to the first self-improving, metalearning GP approach that recursively applies metalevel GP to the task of finding better program-modifying programs on lower levels. The goal was "learning to learn" by using GP for improving GP.

Pages 23-51 are devoted to an alternative metalearning approach called "prototypical self-referential learning mechanisms" (PSALM 1 - PSALM 3). PSALMs use competing metalearning agents with actions for generating and connecting agents and for assigning credit to agents, subject to the constraint that total credit is conserved (except for external reward and consumption). This was the first credit-conserving reinforcement learning economy.

My first Deep Learner of 1991 + Deep Learning timeline 1962-2013
Schmidhuber continued to work on general purpose learning algorithms & program search & metalearning. Compare the GP and program evolution page , the more recent and more principled Optimal Ordered Problem Solver (2002) and the universal Goedel Machine (2003), which is time-optimal in a certain sense.
Since the 1987 thesis is of historic interest, here is a jpeg scan:
Cover
Page 1
Page 2
Page 3
Page 4
Page 5
Page 6
Page 7 (Meta-Evolution, Meta-Genetic Programming)
Page 8
Page 9
Page 10
Page 11
Page 12
Page 13
Page 14
Page 15
Page 16
Page 17
Page 18
Page 19
Page 20
Page 21
Page 22
Page 23 (Self-referential Associating Learning Mechanisms)
Page 24
Page 25
Page 26
Page 27
Page 28
Page 29
Page 30
Page 31
Page 32
Page 33
Page 34
Page 35
Page 36
Page 37
Page 38
Page 39
Page 40
Page 41
Page 42
Page 43
Page 44
Page 45
Page 46
Page 47
Page 48
Page 49
Page 50
Page 51
Page 52 (The End)
Page 53
Page 54 (Bibliography)
Page 55
Page 56
Page 57
Page 58
Page 59
Page 60
Page 61 (Table of Contents)
Page 62 (cont'd)
Back cover
.