Jackey's 感悟

Do Research

Monthly Archives: 四月 2011

Report An Overview of Aritficial Immune Systems

From Evernote:

[Report] An Overview of Aritficial Immune Systems

Clipped from: http://www.artificial-immune-systems.org/Courses/York/lecture1.pdf

Short Lecture Course supplied by Jon Timmis of the University of York, UK (if you use any slides here, please provide a suitable acknowledgment). These lectures form part of a longer course on swarm intelligence, and also assume some knowledge of evolutionary computation. Immune networks are not covered in these slides, though they are on the course. The reason why there are no slides on immune networks is the topic is worked through with the students on a white board by adapting a clonal selection algorithm into an immune network algorithm. Negative selection is also covered on the white board, rather than through lecture slides.

  • Lecture 1: An Overview of Artifcial Immune Systems Lecture PDF
  • Lecture 2: An Introduction to Relevant Immunology Lecture PDF
  • Lecture 3: Immune Modelling : A simple case study Lecture PDF
  • Lecture 4: Engineering Artificial Immune Systems Lecture PDF
  • Lecture 5: Using Clonal Selection for Supervised Learning Lecture PDF
  • Lecture 6: On Artificial Immune Systems and Swarm Intelligence Lecture PDF

Collaborative Bio-Inspired Algorithms
Lecture 6: Artificial Immune Systems

Prof Jon Timmis
October 25, 2010

adj. 合作的, 协力完成的


  1. AIS Background
    1. History
    2. Of interest because?
  2. Thinking about AIS
  3. Basic Immunology
    1. The Immune what?
  4. Engineering Artificial Immune Systems
  5. Interdiscipinary?

What are AIS?
一种定义:AIS是一种受理论免疫学(theoretical immunology)及实验观察得到的免疫功能、原理、模型启发的适应性系统,被应用于多种复杂问题领域。(该定义来自于2002发表的书)
De Castro, L. & Timmis, J. Artificial immune systems: a new computational intelligence approach Springer Verlag, 2002


  • 开创性论文——1986年,Farmer等人(J. Doyne Farmer and Norman H. Packard and Alan S. Perelson)从理论免疫学中引出免疫网络的动态模型。
    • 文章中对比了免疫网络和神经网络的差异
    • 建议从计算的角度分析免疫系统IS
  • 1988年Varela(Varela, F. and Coutinho, A. and Dupire, B. and Nelson, N.)进一步对比了免疫、神经系统。
  • 1990年,日本人石田(Ishida, Y.)是第一个将免疫算法应用在解决实际问题。
  • 上世纪90年代中期,Forrest等人提出Self-nonself及反向选择算法,应用于计算机安全领域
  • 上世纪90年代中期,Hunt等人将免疫的思想用于机器学习领域
  • started quite immunological grounded(基础性的工作开始)
    • 1991年Bersini, H. & Varela, F.出版的著作《Hints for adaptive problem solving gleaned from immune networks》
    • 1994年Forrest, S.; Perelson, A.; Allen, L. & Cherukuri, R.提出的self-nonself,同前述
  • Kind of moved away from that, and abstracted more. (有点儿脱离原来的定义、轨迹,变得更加的抽象、隐喻?)
  • 当前,有种趋势是回归免疫学的根本以及更多的交叉(主要的表现是,2007年生物免疫学家在Nature Reviews Immunology上发表的)
    • 例如2007年Cohen的"The immune system computes"
    • “what might we gain by thinking about immune computation”, Cohen,2007(Mr. Timmis的slide中应该是笔误成了2008)

But how do we manage this intreaction to make it worth while for all concerned … ?


AIS的概念框架(Conceptual Frameworks)

该框架图出自Timmis Jonathan与De Castro合著的书《Artificial immune systems: a new computational intelligence approach》。将当前研究的交叉方法简单描述出来。

这时候枪头一转,问个问题:什么是免疫系统(Immune System, IS)?

  1. Classic View
    • a complex system of celluar and molecular components having the primary function of distinguishing self from not self and defense against foreign organisms or substances.
    • 上面的翻译:是一种复杂系统,由细胞、分子等组成,主要的功能是从“非我”中区分出“自我”(而不是去查找“非我”,记忆、查找的空间会更小),并对外来有机物或者物质起到防御作用
  2. Cognitive View(认知角度)
    • The immune system is a cognitive system whose primary role is to provide body maintenance.[2]
    • 免疫系统是一种认知系统,扮演着提供机体维护的角色[2]
  3. Danger View
    • The immune system recognises dangerous agents and not non-self [9]
    • 发现威胁性物体,而不是关注于“非我”的死死寻觅 [9]

Classic view 代表的是clonal slection 和negative selection等方法。



[1]Bersini, H. & Varela, F. Schwefel, H.-P. & Männer, R. (Eds.) Hints for adaptive problem solving gleaned from immune networks Parallel Problem Solving from Nature, Springer Berlin / Heidelberg, 1991, 496, 343-354
[2] Cohen, I. R. On Tending Adam’s Garden Tending Adam’s Garden, Academic Press, 2000, 243 – 255
[3] Cohen, I. R. Real and artificial immune systems: computing the state of the body Nature Reviews Immunology, 2007, 07, 569-574
[4] De Castro, L. & Timmis, J. Artificial immune systems: a new computational intelligence approach Springer Verlag, 2002
[5] Farmer, J. D.; Packard, N. H. & Perelson, A. S. The immune system, adaptation, and machine learning Physica D: Nonlinear Phenomena, 1986, 22, 187 – 204
Abstract: The immune system is capable of learning, memory, and pattern recognition. By employing genetic operators on a time scale fast enough to observe experimentally, the immune system is able to recognize novel shapes without preprogramming. Here we describe a dynamical model for the immune system that is based on the network hypothesis of Jerne, and is simple enough to simulate on a computer. This model has a strong similarity to an approach to learning and artificial intelligence introduced by Holland, called the classifier system. We demonstrate that simple versions of the classifier system can be cast as a nonlinear dynamical system, and explore the analogy between the immune and classifier systems in detail. Through this comparison we hope to gain insight into the way they perform specific tasks, and to suggest new approaches that might be of value in learning systems.
[6] Forrest, S.; Perelson, A.; Allen, L. & Cherukuri, R. Self-nonself discrimination in a computer Research in Security and Privacy, 1994. Proceedings., 1994 IEEE Computer Society Symposium on, 1994, 202 -212
Abstract: The problem of protecting computer systems can be viewed generally as the problem of learning to distinguish self from other. The authors describe a method for change detection which is based on the generation of T cells in the immune system. Mathematical analysis reveals computational costs of the system, and preliminary experiments illustrate how the method might be applied to the problem of computer viruses
[7] Hunt, J. E. & Cooke, D. E. Learning using an artificial immune system Journal of Network and Computer Applications, 1996, 19, 189 – 212
Abstract: In this paper we describe an artificial immune system (AIS) which is based upon models of the natural immune system. This natural system is an example of an evolutionary learning mechanism which possesses a content addressable memory and the ability to forget little-used information. It is also an example of an adaptive non-linear network in which control is decentralized and problem processing is efficient and effective. As such, the immune system has the potential to offer novel problem solving methods. The AIS is an example of a system developed around the current understanding of the immune system. It illustrates how an artificial immune system can capture the basic elements of the immune system and exhibit some of its chief characteristics. We illustrate the potential of the AIS on a simple pattern recognition problem. We then apply the AIS to a real-world problem: the recognition of promoters in DNA sequences. The results obtained are consistent with other appproaches, such as neural networks and Quinlan’s ID3 and are better than the nearest neighbour algorithm. The primary advantages of the AIS are that it only requires positive examples, and the patterns it has learnt can be explicitly examined. In addition, because it is self-organizing, it does not
require effort to optimize any system parameters.
[8] Ishida, Y. Fully distributed diagnosis by PDP learning algorithm: towards immune network PDP model Neural Networks, 1990., 1990 IJCNN International Joint Conference on, 1990, 777 -782 vol.1
Abstract: Based on the strong analogy between neural networks and distributed diagnosis models, diagnostic algorithms are presented which are similar to the learning algorithm used in neural networks. Diagnostic implications of convergence theorems proved by the Lyapunov function are also discussed. Regarding diagnosis process as a recalling process in the associative memory, a diagnostic method of associative diagnosis is also presented. A good guess of diagnosis is given as a key to recalling the correct diagnosis. The authors regard the distributed diagnosis as an immune network model, a novel PDP (parallel distributed processing) model. This models the recognition capability emergent from cooperative recognition of interconnected units.
[9] Matzinger, P. The Danger Model: A Renewed Sense of Self Science, 2002, 296, 301-305
[10] Neal, M.; Stepney, S.; Smith, R. & Timmis, J. Conceptual frameworks for artificial immune systems International Journal on Unconventional Computing, Old City Publishing, 2005, 1, 315-338
[11] Varela, F.; Coutinho, A.; Dupire, B. & Nelson, N. Cognitive networks: immune, neural and otherwise Addison Wesley Publishing Company, 1988