ACM Home Page
Please provide us with feedback. Feedback
Software maturity: design as dark art
Full text PdfPdf (893 KB)
Source
ACM SIGSOFT Software Engineering Notes archive
Volume 34 ,  Issue 1  (January 2009) table of contents
SECTION: Article abstracts with full text online table of contents
Pages 1-36  
Year of Publication: 2009
ISSN:0163-5948
Author
Robert Schaefer  Daniel Webster College
Publisher
ACM  New York, NY, USA
Bibliometrics
Downloads (6 Weeks): 45,   Downloads (12 Months): 456,   Citation Count: 0
Additional Information:

abstract   references   index terms   collaborative colleagues  

Tools and Actions: Review this Article  
DOI Bookmark: Use this link to bookmark this Article: http://doi.acm.org/10.1145/1457516.1457528
What is a DOI?

ABSTRACT

What does it mean for a profession to be considered mature? How valid is the claim that software faults may be excused due to the immaturity of the field? In giving that claim serious consideration, one might assume that there are stages to maturity, that maturity doesn't arrive in the world fully formed. If so, an understanding of maturity may be found from the viewing of the differences across various professions in terms of stages of maturity, perhaps signaled by how a profession detects and handles faults. The question thus becomes more refined, "Are software professionals more or less mature than their counterparts in respective fields in regards to the detection and handling of faults?" Which raises the previously begged but now follow-up question: "To whom should software professionals be compared?" The down-select for professions to choose for this comparison was straightforward. First, to disregard a comparison with the physical sciences as one could make a strong case that programming is nothing more than data and rules. Ones and zeros may represent any object, on, off, true, not true, apples, oranges, aelopiles and zeppelins, and that rules on objects are infinitely mutable, literally valid now and invalid one-half a tenth of a millisecond later. Software is distinctively arbitrary where the physical sciences are not (well, except perhaps for the quantum and the astro).

In joining software with the soft sciences, the likeliest candidates for comparison were identified as the fields of economics and law. Economics at first glance appears to be a combination of mathematics and logic applied to finance, and law appears to be a combination of philosophy and logic applied to rules of conduct. There also appears a commonality with these particular soft sciences and software in the attributes of design. Professionals in the field of economics design models of the world in terms of money. Professionals in the field of law design models of the world in terms of behavioral control, and software professionals design models for any purpose in any terms that one may choose to take. Software may be used to model both economics and law, so why not compare software professionals to their counterparts in economics and law.

On further investigation in development of this text, the rationale for this investigation hurt the premise, for if one considered that software is applied logic, then software has no reason to be considered an immature field. Logic and philosophy go back at least to the ancient Greeks, to Aristotle! If software is immature in the light of history, then what would that say about the maturity of logic and philosophy? (Hush, you cynics!) This author began to have severe doubts, that perhaps this whole line of investigation was naively misguided. Further investigation yielded additional insights, that although maturity may be an interesting topic in its own right, perhaps it wasn't key to understanding software faults, that perhaps instead, it was the art of design, design being a common feature across software, economics and law. With this new direction in mind, and then taking one step back for perspective, perhaps the common feature across the professions could be the design of design? And so this author meandered on, down paths less traveled and more shadowed (note the subtitle), observing and describing all of interest, and taking off yet again in directions oblique, the instinct of authorial self-restraint placed in competition with curiosity, all tugged and pulled and fretted at this author. The conflict of design choice reflected in an investigation of design choice! Oh, how self-similar! Deja vu all over again! The themes of this paper that continued beyond the initial investigation of maturity are as follows:

  1. A study of games versus competition in design.
  2. The limits of competition and the implications of these limits.
  3. A revisit of standing philosophical problems in computer science, in particular: Chess, Searle's Chinese Room and the Turing Test, studied as competitions.
  4. An exploration of the meta in design.
  5. Conclusions, which were in the first draft imagined to be most unlikely given the initial premise but in revision became necessary and unavoidable.
.


REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

 
1
Scott Adams, "Dilbert", August 5, 2005 http://www.dilbert.com/strips/comic/2005-08-05/ ("so fast it will make your head spin.").
 
2
Scott Adams, "Dilbert", March 30, 2008 www.dilbert.com/strips/comic/2008-03-30/ ("It is what it is." Also see {130}).
 
3
Scott Adams, "Dilbert", July 27, 2008 http://www.dilbert.com/strips/comic/2008-07-27/ ("My choices are failure or insubordination.").
 
4
Scott Adams, "Dilbert", Aug 23, 2008 http://www.dilbert.com/strips/comic/2008-08-23/ ("I believe you call it your 'business plan'.")
 
5
Scott Adams, "Dilbert", Oct. 25, 2008 http://www.dilbert.com/strips/comic/2008-10-25/ ("my business plan").
 
6
Sherry R. Arnstein, "A Ladder of Citizen Participation," JAIP, Vol. 35, No. 4, July 1969, pp. 216--224, http://lithgow-schmidt.dk/sherry-arnstein/ladder-of-citizen-participation.html
 
7
J. B. A. Bailey, "'Over by Christmas': Campaigning, Delusions and Force Requirements", The Institute of Land Warfare, No. 51W, Sept. 2005 http://www.ausa.org/pdfdocs/LWP_51WBailey.pdf
 
8
David Baltimore, "On Doing Science in the Modern World", The Tanner Lectures on Human Values, Delivered at Clare Hall, Cambridge University, March 9, 1992 http://www.tannerlectures.utah.edu/lectures/documents/Baltimore93.pdf (The bigger picture perspective from a Nobel Prize winner. "{S}cientists are often the worst judges of moral issues because they are too ready to believe in their own rationality and generally out of touch with the thinking of the community." {8}).
 
9
John D. Barrow, Pi in the Sky, Oxford, 1992.
 
10
Min Basadur, Conklin, Jeff, VanPatter, GK, "Rethinking Wicked Problems ("Part 2"), NextD Journal, Issue 10, Conversation 10.3, 2007 http://www.nextd.org/02/10/3/index.html (Not as good as part 1, B-school noise overwhelms the signal at about halfway in.).
 
11
Peter Bebergal, "Q&A: Robert Arp and Mark D. White: What Batman Teaches Us About Philosophy", Boston Sunday Globe, July 13, 2008 p C2. http://www.boston.com/bostonglobe/ideas/articles/2008/07/13/a_talk_with_robert_arp_and_mark_d_white/
 
12
Victor A. Beker, "Is Economics a Science?: A discussion of some methodological issues", July 2005 http://papers.ssrn.com/sol3/papers.cfm?abstract_id=839307
 
13
Drake Bennett, "The Culture of Corruption", The Boston Sunday Globe", July 27, 2008 p. K1 http://www.boston.com/bostonglobe/ideas/articles/2008/07/27/the_culture_of_corruption/
 
14
Blumenthal, David R., "The Banality of Good and Evil: Antisocial Behavior, Prosocial Behavior, and Jewish Religious Teaching," Good and Evil After Auschwitz: Ethical Implications for Today, ed. J. Bemporad., et al, 2000, pp. 285--299 http://www.js.emory.edu/BLUMENTHAL/Banality1.html
 
15
Peter J. Boyer, "Reporter at Large: The Bribe", The New Yorker, May 19, 2008 http://www.newyorker.com/reporting/2008/05/19/080519fa_fact_boyer/
 
16
T. Coraghessan Boyle, "Top of the Food Chain", Harper's Magazine, April 1993, pp 72--74 http://harpers.org/archive/1993/04/0001237 http://www.hwscience.com/APES/units/2006%20web%20stuff/Ecological%20Concepts/TOP%20OF%20THE%20FOOD%20CHAIN.pdf (See {54})
 
17
Robert Caro, The Power Broker: Robert Moses and the Fall of New York, Knopf, 1974.
 
18
Achin Chakraborty "The Irrelevance of methodology and the Art of the Possible: Reading Sen and Hirschman", Centre for Development Studies, Trivendrum, India, Centre for Development Studies, Trivendrum Working Papers. http://www.cds.edu/download_files/wp286.pdf
 
19
 
20
Robert N. Charette, "The Risks with Risk Identification", Undated http://www.itmpi.org/assets/base/images/itmpi/privaterooms/robertcharette/RISK_ID.pdf
21
 
22
I. Glenn Cohen, "Note: The Price of Everything, The Value of Nothing: Reframing the Commodification Debate", Harvard Law Review, Vol. 117, No. 689, 2003 http://papers.ssrn.com/sol3/papers.cfm?abstract_id=479321 (This paper is representative of the type.)
 
23
David Cole, "The Chinese Room Argument", in Zalta, Edward N., The Stanford Encyclopedia of Philosophy, Fall 2004 http://plato.stanford.edu/archives/fall2004/entries/chinese-room/ (See {121})
 
24
E. Jeffry Conklin, Weil, William, "Wicked Problems: Naming the Pain in Organization", 3M Meeting Network, October 14, 1998 http://www.leanconstruction.org/pdf/wicked.pdf
 
25
Jeff Conklin, Basadur, Min, VanPatter, GK, "Rethinking Wicked Problems", NextD Journal, Issue 10, Conversation 10.1, 2007, quoting from Klaus Krippendorf, The Semantic Turn, A New Foundation for Design, CRC Press, 2006 http://www.nextd.org/02/10/1/index.html
 
26
Michael Crichton, "This Essay Breaks the Law", New York Times, Mar. 19, 2006 http://www.nytimes.com/2006/03/19/opinion/19crichton.html
 
27
 
28
Robert Darnton, "The Library in the New Age", The New York Review of Books, Volume 55, Number 10 -- June 12, 2008 http://www.nybooks.com/articles/21514
29
30
 
31
Bradley Dowden, "Fallacies", The Internet Encyclopedia of Philosophy, 2008 http://www.iep.utm.edu/f/fallacy.htm
 
32
Nicholas Dujmovic, "Oral History: Reflections of DCIs Colby and Helms on the CIA's 'Time of Troubles'", Studies in Intelligence, Vol. 51, No. 3, 2007 http://www.foia.cia.gov/helms/pdf/reflections.pdf (The ultimate insiders view of security.)
 
33
Richard P. Feynman, "Cargo Cult Science: Some remarks on science, pseudoscience, and learning how not to fool yourself", The 1974 Caltech Commencement Address, Engineering and Science, Volume 37, Number 7, June 1974 http://calteches.library.caltech.edu/51/02/CargoCult.pdf
34
 
35
T.A. Frank, "Confessions of a Sweatshop Inspector", Washington Monthly, April 2008 http://www.washingtonmonthly.com/features/2008/0804.frank.html
 
36
Thomas Frank, "Fliers without ID placed on TSA list", USA Today, Aug. 12, 2008 http://www.usatoday.com/tech/news/surveillance/2008-08-12-tsa_N.htm
 
37
John Kenneth Galbraith, The Economics of Innocent Fraud, Houghton Mifflin, 2004.
 
38
Garet Garrett, Ouroboros or The Mechanical Extension of Mankind, E.F. Hutton, 1926 ("The machine does not abolish the curse of toil...it does create a preferred task.") http://mises.org/books/ouroboros.pdf
 
39
Jennifer L. Geddes, "An Interview with Margaret Jane Radin", The Hedgehog Review, Summer 2003 http://www.virginia.edu/iasc/HHR_Archives/Commodification/5.2IRadin.pdf
 
40
Edward Gibbon, Decline and Fall of the Roman Empire, Tess Press, 2005.
 
41
 
42
 
43
David Halberstam, The Best and the Brightest, Ballantine Books, 1993.
 
44
 
45
T.X. Hammes, "War Isn't a Rational Business", Proceedings of the US Naval Institute, Volume 124, No. 7, July 1998, pp 22--25 smallwarsjournal.com/documents/rationalwar.pdf
 
46
Blaine Harden, "S. Korean Tourist Is Shot Dead In North", Washington Post Foreign Service, July 12, 2008; Page A09 http://www.washingtonpost.com/wp-dyn/content/article/2008/07/11/AR2008071100314.html
 
47
Garrett Hardin, "The Tragedy of the Commons", Science, December 13, 1968 http://www.garretthardinsociety.org/articles/art_tragedy_of_the_commons.html
 
48
Garrett Hardin, "Rewards of Pejoristic Thinking", in Managing the Commons, by Garrett Hardin and John Baden (Editors), W. H. Freeman, 1977 http://www.garretthardinsociety.org/articles/art_rewards_perjoristic_thinking.html
 
49
Garrett Hardin, "The Cybernetics of Competition", Perspectives in Biology and Medicine, 7:58--84, 1963, Reprinted as Chapter 21. in Stalking the Wild Taboo, Kaufmann, 1978.
 
50
Friedrich August von Hayek, "The Pretence of Knowledge", Nobel Prize Lecture, December 11, 1974 http://nobelprize.org/nobel_prizes/economics/laureates/1974/hayek-lecture.html
 
51
Albert O. Hirschman, "Two Hundred Years of Reactionary Rhetoric", the Tanner Lectures on Human Values, University of Michigan, April 8, 1988 http://www.tannerlectures.utah.edu/lectures/documents/hirschman89.pdf
 
52
Albert O. Hirschman, "Against Parsimony: Three Easy Ways of Complicating Some Categories of Economic Discourse", Bulletin of the American Academy of Arts and Sciences, Vol. 37, No. 8, May, 1984, pp. 11--28 www.regulationbodyofknowledge.org/documents/027.pdf (Interesting website in a creepy sort of way.)
53
 
54
C.S. Holling, Goldbert, M. A., "Ecology and Planning", Journal of the American Institute of Planners, Volume XXXVII, Number 4, July 1971, pp 221--230 http://www.csun.edu/~vasishth/Holling+Ecology_and_Planning.pdf (See {15})
 
55
Keith N. Hylton, Khanna, Vikramaditya S., "Political Economy of Criminal Procedure", Boston University School of Law, Working Paper Series, Law and Economics Working Paper No. 08-06 http://ssrn.com/abstract ID=1121441 (This paper is representative of the type. Note the "existence theorem" issues.)
 
56
Michael C. Jackson, "The Youthful Immaturity of Software Engineering", Proceedings of Convencio Informatica Llatina, Boixareu Editores 1985, pp. 47--51; http://mcs.open.ac.uk/mj665/CIL1985.pdf
 
57
Tony Judt, Postwar: A History of Europe Since 1945, Penguin, 2005.
 
58
Paul Kennedy, "The Rise and Fall of the Great Powers", Vintage, 1989.
 
59
Daniel B. Klein, "A plea to economists who favor liberty: Assist the everyman", Eastern Economic Journal, Spring 2001 http://findarticles.com/p/articles/mi_qa3620/is_200104/ai_n8940844
 
60
Claudia Koonz, The Nazi Conscience, Belknap, 2003
 
61
 
62
Timothy B. Lee, "Circumventing Competition: The Perverse Consequences of the Digital Millennium Copyright Act", Cato Institute, Policy analysis No. 564, March 21, 2006 http://www.cato.org/pub_display.php?pub_id=6025
 
63
Michael Levenson, "T hacking exposes a deeper clash", Boston Globe, Aug. 18, 2008, p A1,A6 http://www.boston.com/news/local/massachusetts/articles/2008/08/18/t_hacking_exposes_a_deeper_clash/
64
 
65
J. R. Lucas, "Minds, Machines and Gödel", Philosophy, XXXVI, 1961, pp. 112--127; Reprinted in The Modeling of Mind, Kenneth M.Sayre and Frederick J.Crosson, eds., Notre Dame Press, 1963, pp.269--270 http://users.ox.ac.uk/~jrlucas/mmg.html
 
66
Deirdre N. McCloskey, "Cassandra's open letter to her economist colleagues", Eastern Economic Journal, Summer 1999 http://findarticles.com/p/articles/mi_qa3620/is_199907/ai_n8842882
 
67
Deirdre N. McCloskey, "Why Economics is on the Wrong Track", 2006/2007 http://deirdremccloskey.org/pubs/drafts/why.php
 
68
Erin McKean, "Chillax: If it works like a word, just use it.", The Boston Globe, Aug. 28, 2008 www.boston.com/bostonglobe/ideas/articles/2008/08/03/chillax/
 
69
Donella H. Meadows, "Places to Intervene in a System", Whole Earth Review, winter 1997 http://www.wholeearthmag.com/ArticleBin/109.html
 
70
John W. Meyer, Rowan, Brian, "Institutionalized Organizations: Formal Structure as Myth and Ceremony", The American Journal of Sociology, Vol. 83, No. 2, Sep. 1977, pp. 340--363 http://links.jstor.org/sici?sici=0002-9602 (197709)83%3A2%3C340%3AIOFSAM%3E2.0.CO%3B2-3
 
71
Mezmer, "Mezmer's Logical Defect Checklist, Undated http://flowstate.homestead.com/logical.html
 
72
Jeremy Miller, "Tyranny of the test", Harper's Magazine, Sept. 2008 harpers.org/archive/2008/09
73
 
74
Anna Mundow, "A warning about 'false science'", The Boston Sunday Globe, July 27, 2006 p. K12 http://www.boston.com/ae/books/articles/2008/07/27/a_warning_about_false_science/
 
75
C. Northcote Parkinson, Parkinson's Laws, Buccaneer Books, 1957.
76
77
 
78
Mark Peplow, "Science secret of grand masters revealed", Nature, online edition, Aug. 6, 2004 http://www.nature.com/news/2004/040802/full/040802-19.html http://www.freerepublic.com/focus/f-chat/1187541/posts
 
79
David Pescovitz, "Sons and Daughters of HAL Go on Line", New York Times, March 18, 1999 http://query.nytimes.com/gst/ fullpage.html?res=9B04E3DD1631F93BA25750C0A96F958260&sec=&spon=&pagewanted=3 http://loebner.net/Prizef/loebner-prize.html
 
80
Charles P. Pierce, "Rules What Rules?", The Boston Sunday Globe Magazine, December 30, 2007 pp. 31--32 http://www.boston.com/bostonglobe/magazine/articles/2007/12/30/rules_what_rules/
 
81
Bill Pollak, Ed., "Ultra-Large-Scale systems: The Software Challenge of the Future", Software Engineering Institute, Carnegie Mellon, June 2006 http://www.sei.cmu.edu/uls/report.html (Parnas may be referenced in {80}, but not the essay most relevant, for this see {75}. Also see {8} and {106}.)
 
82
Vassilis Prevekalis, "The Athens Affair", IEEE Spectrum, Vol. 44, No. 7, July 2007.
 
83
Munir Quddus, "The overuse of mathematics in economics: Nobel resistance", Eastern Economic Journal, Summer 1994 http://findarticles.com/p/articles/mi_qa3620/is_199407/ai_n8727805
84
 
85
Chanpory Rith, Dubberly, Hugh, "Why Horst W.J. Rittel Matters", Design Issues, Vol. 22, No. 4, Autumn 2006 http://www.dubberly.com/wp-content/uploads/2008/06/ddo_article_rittel.pdf
 
86
Horst Rittel, "Some Principles for the Design of an Educational System for Design", Journal of Archtectural Education (1947-1974), Vol. 25, No 1/2, Research as an Aspect of Architectural Education, (Winter- Spring, 1971) pp.16--27, Blackwell, Originally, Education for Architectural Technology. Ed. Passonneau, J. St. Louis: Washington University and the AIA Educational Research Projects, 1966. pp. 103--151 http://www.jstor.org/stable/1423929
 
87
Horst Rittel, "On the Planning Crisis: Systems Analysis of the 'First and Second Generations'." Bedrifts Økonomen. 8 (1972): 390--396. http://www.csun.edu/~vasishth/Rittel-Planning_Crisis.pdf (The second generation appears to have been strangled in its crib.)
 
88
Horst Rittel, and M. Webber, "Dilemmas in a General Theory of Planning", pp 155--169, Policy Sciences, Vol. 4. 1973, Elsevier http://www.uctc.net/mwebber/Rittel+Webber+Dilemmas+General_Theory_of_Planning.pdf (The source of wickedness).
 
89
Nancy Roberts, "Coping with Wicked Problems" Third Bi-Annual Research conference of the International Public Management Network, Sydney, Australia, March 4-6, 2000 http://www.inpuma.net/research/papers/sydney/nancyroberts.html
 
90
Dexter Roberts, Bernstein, Aaron, "Inside a Chinese Sweatshop: A Life of Fines and Beating", business week, Oct. 2, 2000 http://www.businessweek.com/2000/00_40/b3701119.htm (The U.S. isn't immune to its own Potemkin villages {92} {108}).
 
91
Fred Rodell, Woe Unto You Lawyers!, New York, Pageant Press, Inc, 2d ed. 1957 http://www.constitution.org/lrev/rodell/woe_unto_you_lawyers.htm
 
92
Jonathan Rowe, "Our Phony Economy", Harper's Magazine, June 2008, pp 17--18 http://harpers.org/archive/2008/06/0082042
 
93
Edward W. Said, "Intellectual Exile: Expatriates and Marginals", Grand Street, Issue 47, Fall 1993 http://www.grandstreet.com/gsissues/gs47/gs47a.html
94
 
95
Michael J. Sandel, "What Money Can't Buy: The Moral Limits of Markets", The Tanner Lectures on Human Values, Brasenose College, Oxford, May 11, 1998 http://www.tannerlectures.utah.edu/lectures/documents/sandel00.pdf
96
97
98
99
100
 
101
Bruce Schneier, "I've Seen the Future, and It Has a Kill Switch", Wired, June 26, 2006 http://www.wired.com/politics/security/commentary/securitymatters/2008/06/securitymatters_0626 (For a fatal kill switch, see {44}.)
 
102
Bruce Schneier, "Inside the Twisted Mind of the Security Professional", Wired, March 20, 08 http://www.wired.com/politics/security/commentary/securitymatters/2008/03/securitymatters_0320 (To teach security is to teach the dark arts. See {44}.)
 
103
Bruce Schneier, Ranum, Marcus, "Face-Off: Is vulnerability research ethical?", Information Security, May 2008 http://searchsecurity.techtarget.com/magazineFeature/0,296894,sid14_gci1313268,00.html# (Outsiders discuss security. For insiders, see {32}).
 
104
Bruce Schneier, "Opinion: The TSA's useless photo ID rules", Los Angeles Times, August 28, 2008 http://www.latimes.com/news/opinion/la-oe-schneier28-2008aug28,0,3099808.story
 
105
Tom Schorsch, "The Capability Im-Maturity Model (CIMM)", CrossTalk, The Journal of Defense Software Engineering, November 1996 www.stsc.hill.af.mil/crosstalk/1996/11/xt96d11h.asp
 
106
Scott, James C., Seeing Like a State: How Certain Schemes to Improve the Human Condition Have Failed, Yale University Press, 1999 (Systems delusions of megalomaniacs.)
 
107
Gene Sharp, "Disregarded History", Fellowship, March 1976 www.fragmentsweb.org/fourtx/dishist.pdf
 
108
Monique Doyle Spencer, "America's faux government", The Boston Globe, May 25, 2008, p D9 http://www.boston.com/bostonglobe/editorial_opinion/oped/articles/2008/05/25/americas_faux_government/
 
109
Staff, "From the Hartford Courant", The New York Times, November 11, 1909 http://query.nytimes.com/mem/archive-free/pdf?res=9D03E7D6123EE733A25752C1A9679D946897D6CF
 
110
Staff, "Charlemagne: Europe's Marxist dilemma", The Economist, Apr. 26, 2008 http://www.economist.com/world/europe/displaystory.cfm?story_id=11089474
 
111
Staff, "Olympic games: The ghosts of Mexico 1968", The Economist, April 26, 2008 http://www.economist.com/world/international/displaystory.cfm?story_id=11090825
 
112
David Stove, "What is Wrong with Our Thoughts?", The Plato Cult and Other Philosophical Follies, Chapt. 7, Blackwell, 1991 http://web.maths.unsw.edu.au/~jim/wrongthoughts.html (The irony is that if Stove, a philosopher, truly understood logic, he would have recognized the fallacy of the excluded middle and would have been able to answer his own question. Or perhaps, this was his joke on us?)
 
113
Christine Sypnowich, "Law and Ideology", Stanford Encyclopedia of Philosphy, (Winter 2001), edited by Edward N. Zalta., Oct. 22, 2001 http://plato.stanford.edu/entries/law-ideology/ (Representative of its type).
 
114
Barbara W. Tuchman, The March of Folly: From Troy to Vietnam, Ballantine Books, 1985.
 
115
Louis Uchitelle, "Robert Heilbroner: An Economic Pioneer Decries the Modern Field's Narrow Focus", New York Times, January 23, 1999.
 
116
Unknown, "25 Tactics for Truth Suppression", Alaska Free Press, Undated http://www.alaskafreepress.com/msgboard/disinfo/index.html
 
117
G. K. VanPatter, "Double Consciousness: Back to the Future with John Chris Jones", NextD Journal, Issue 9, Conversation 9.2, 2006 www.nextd.org/02/09/02/contents.htm
 
118
Bruce Weber, "It's Man Over Machine as Chess Champion Beats Computer He Calls Tough Opponent", The New York Times, Feb. 18, 1996 http://query.nytimes.com/gst/fullpage.html? res=9507E3DB1339F93BA25751C0A960958260&n=Top%2FReference%2FTimes%20Topics%2FPeople%2FK%2FKasparov%2C%20Garry
 
119
Wikipedia Contributors, "CAPTCHA", Wikipedia, The Free Encyclopedia, June 14, 2008 http://en.wikipedia.org/wiki/Captchas
 
120
Wikipedia Contributors, "Chatterbot", Wikipedia, The Free Encyclopedia, June 24, 2008 http://en.wikipedia.org/wiki/Chatterbot
 
121
Wikipedia Contributors, "Chinese room", Wikipedia, The Free Encyclopedia, June 18, 2008 http://en.wikipedia.org/wiki/Chinese_Room (Also see {23}).
 
122
Wikipedia Contributors, "Peter J. Denning", Wikipedia, The Free Encyclopedia, June 24, 2008 http://en.wikipedia.org/wiki/Peter_J_Denning
 
123
Wikipedia Contributors, "Design methods", Wikipedia, The Free Encyclopedia, June 9, 2008 http://en.wikipedia.org/wiki/Design_methods (See also - http://www.softopia.demon.co.uk)
 
124
Wikipedia Contributors, "ELIZA", Wikipedia, The Free Encyclopedia, June 24, 2008 http://en.wikipedia.org/wiki/ELIZA
 
125
Wikipedia Contributors, "Kobyayshi Maru", Wikipedia, The Free Encyclopedia, July 15, 2008 http://en.wikipedia.org/wiki/Kobyayshi_Maru
 
126
Wikipedia Contributors, "Deirdre McCloskey", Wikipedia, The Free Encyclopedia, May 11, 2008 http://en.wikipedia.org/wiki/Deirdre_McCloskey
 
127
Wikipedia Contributors, "Mechanism Design", Wikipedia, The Free Encyclopedia, July 14, 2008 http://en.wikipedia.org/wiki/Mechanism_design (Mechanism Design looks like social engineering from above by those who think they know best. Isn't this communism? Also see {106}).
 
128
Wikipedia Contributors, "Quasi-rent", Wikipedia, The Free Encyclopedia, Oct. 11, 2007 http://en.wikipedia.org/wiki/Quasi-rent
 
129
Wikipedia Contributors, "The Structure of Scientific Revolutions", Wikipedia, The Free Encyclopedia, July 1, 2008 http://en.wikipedia.org/wiki/The_Structure_of_Scientific_Revolutions
 
130
Wikipedia Contributors, "Turing Test", Wikipedia, The Free Encyclopedia, June 30, 2008 http://en.wikipedia.org/wiki/Turing_Test (Also see {2})
 
131
Edmund Wilson, To the Finland Station, NYRB Classics, 2003.