ACM Home Page
Please provide us with feedback. Feedback
Digital Library logoTake a look at the new version of this page: [ beta version ]. Tell us what you think.
Efficient reasoning
Full text PdfPdf (445 KB)
Source ACM Computing Surveys (CSUR) archive
Volume 33 ,  Issue 1  (March 2001) table of contents
Pages: 1 - 30  
Year of Publication: 2001
ISSN:0360-0300
Authors
Russell Greiner  Univ. of Alberta, Edmonton, Alta., Canada
Christian Darken  Siemens Corporate Research, Princeton, NJ
N. Iwan Santoso  Siemens Corporate Research, Princeton, NJ
Publisher
ACM  New York, NY, USA
Bibliometrics
Downloads (6 Weeks): 22,   Downloads (12 Months): 196,   Citation Count: 8
Additional Information:

abstract   references   cited by   index terms   review   collaborative colleagues  

Tools and Actions: Request Permissions Request Permissions    Review this Article  
DOI Bookmark: Use this link to bookmark this Article: http://doi.acm.org/10.1145/375360.375363
What is a DOI?

ABSTRACT

Many tasks require “reasoning”—i.e., deriving conclusions from a corpus of explicitly stored information—to solve their range of problems. An ideal reasoning system would produce all-and-only the correct answers to every possible query, produce answers that are as specific as possible, be expressive enough to permit any possible fact to be stored and any possible query to be asked, and be (time) efficient. Unfortunately, this is provably impossible: as correct and precise systems become more expressive, they can become increasingly inefficient, or even undecidable. This survey first formalizes these hardness results, in the context of both logic- and probability-based reasoning, then overviews the techniques now used to address, or at least side-step, this dilemma.


REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

 
1
AAAI. 1992. Workshop on Approximation and Abstraction of Computational Theories. Tech. Rep., AAAI.
 
2
 
3
ALCHOURR ON, C. E., G ARDENFORS,P.,AND MAKIN- SON, D. 1985. On the logic of theory change: partial meet contraction and revision functions. Journal of Symbolic Logic 50, 510- 30.
 
4
ANDERSEN, S. K., OLESEN,K.G.,JENSEN,F.V.,AND JENSEN, F. 1989. HUGIN-a shell for building Bayesian belief universes for expert systems. In Proceedings of the Eleventh International Joint Conference on Artificial Intelligence (IJCAI-89), Detroit, Michigan, Aug. 1989. Morgan Kaufmann, San Mateo, CA, vol. 2, 1080- 1085.
 
5
 
6
AZEVEDO, P. J. 1997. Magic sets with full sharing. Journal of Logic Programming 30, 3 (March), 223-237.
 
7
8
 
9
BEINLICH, I. A., SUERMONDT,H.J.,CHAVEZ,R.M.,AND COOPER, G. F. 1989. The ALARM monitoring system: a case study with two probabilistic inference techniques for belief networks. In Proceedings of the Second European Conference on Artificial Intelligence in Medicine, London, Aug. 1989. Springer, Berlin.
 
10
BOBROW. 1980. Artificial intelligence. Special Issue on Non-Monotonic Logic.
 
11
BOROS, E., CRAMA,Y.,AND HAMMER, P. 1990. Polynomial-time inference of all valid implications for horn and related formulae. Annals of Mathematics and Artificial Intelligence 1, 21- 32.
 
12
BRACEWELL, R. N. 1978. The Fourier Transform and Its Applications. McGraw-Hill, New York.
 
13
 
14
 
15
 
16
CHAUDHRI,V.AND GREINER, R. 1992. A formal analysis of solution caching. In Proceedings of the Ninth Canadian Conference on Artificial Intelligence, Vancouver, 1992.
 
17
CHOW,C.K.AND LUI, C. N. 1968. Aproximating discrete probability distributions with dependence trees. IEEE Transactions on Information Theory 14, 3, 462-467.
 
18
CLARK, K. 1978. Negation as failure. In Logic and Data Bases, H. Gallaire and J. Minker Eds. Plenum Press, New York, 293-322.
 
19
 
20
 
21
COUSINS, S., CHEN,W.,AND FRISSE, M. 1993. A tutorial introduction to stochastic simulation algorithms for belief networks. Artificial Intelligence in Medicine 5, 315-340.
 
22
 
23
 
24
DALAL,M.AND ETHERINGTON, D. W. 1992a. Tractable approximate deduction using limited vocabulary. In Proceedings of the Ninth Canadian Conference on Artificial Intelligence, Vancouver, May 1992.
 
25
 
26
DARWICHE,A.AND PROVAN, G. M. 1996. Query dags: a practical paradigm for implementing belief network inference. In Proc. Uncertainty in AI.
 
27
DARWICHE,A.AND PROVAN, G. M. 1997. A standard approach for optimizing belief network inference using query dags. In Proc. Uncertainty in AI.
 
28
DECHTER, R. 1996. Topological parameters for timespace tradeoff. In Proc. Uncertainty in AI, San Francisco, 1996, E. Horvitz and F. Jensen, Eds. Morgan Kaufmann, San Maeto, CA, 220- 227.
 
29
 
30
DECHTER,R.AND RISH, I. 1997. A scheme for approximating probabilistic inference. In Proc. Uncertainty in AI.
 
31
DELCHER, A. L., GROVE, A., KASIF,S.,AND PEARL, J. 1996. Logarithmic-time updates and queries in probabilistic networks. J. Artificial Intelligence Research 4, 37-59.
 
32
 
33
DOWLING,W.F.AND GALLIER, J. H. 1984. Linear time algorithms for testing the satisfiability of propositional horn formula. Journal of Logic Programming 3, 267-84.
 
34
 
35
DRAPER,D.L.AND HANKS, S. 1994. Localized partial evaluation of belief networks. In Proceedings of the 10th Conference on Uncertainty in Artificial Intelligence, San Francisco, CA, USA, July 1994, R. L. DE MANTARAS AND D. POOLE, Eds. Morgan Kaufmann, San Maeto, CA, 170- 177.
 
36
ELLMAN, T. 1993. Abstraction via approximate symmetry. In IJCAI-93.
 
37
ENDERTON, H. B. 1972. AMathematical Introduction to Logic. Academic Press, New York.
 
38
FELLER, W. 1966. An Introduction to Probability Theory and Its Applications II. John Wiley, New York.
 
39
 
40
 
41
 
42
 
43
 
44
GENESERETH,M.R.AND FIKES, R. E. 1992. Knowledge Interchange Format, Version 3.0 Reference Manual. Tech. Rep. Logic-92-1 (June), Computer Science Dept., Stanford Univ.
 
45
 
46
 
47
GINSBERG, M. L. 1991. Knowledge Interchange Format: The KIF of Death. Tech. Rep., Stanford Univ.
 
48
 
49
 
50
 
51
GREINER, R. 1999. Explanation-based learning. In The Encyclopedia of Cognitive Science,R.WILSON AND F. KEIL, Eds. MIT Press, Cambridge, MA, 301-303. A Bradford Book.
 
52
GREINER,R.AND ELKAN, C. 1991. Measuring and improving the efiectiveness of representations. In Proceedings of the Twelfth International Joint Conference on Artificial Intelligence, Sydney, Australia, Aug. 1991, 518-524.
 
53
GREINER,R.AND SCHUURMANS, D. 1992. Learning useful horn approximations. In Proceedings of KR-92, San Mateo, CA, Oct. 1992, B. NEBEL, C. RICH, AND W. SWARTOUT, Eds. Morgan Kaufmann, San Mateo, CA.
 
54
GREINER, R., GROVE, A., AND SCHUURMANS, D. 1997. Learning Bayesian nets that perform well. In Uncertainty in Artificial Intelligence.
 
55
 
56
 
57
HECKERMAN, D. E. 1995. A Tutorial on Learning with Bayesian Networks. Tech. Rep. MSR-TR- 95-06, Microsoft Research.
 
58
HERSKOVITS,E.H.AND COOPER, C. 1991. Algorithms for Bayesian Belief-network Precomputation. In Methods of Information in Medicine.
 
59
HOOS,H.H.AND STUTZLE, T. 1998. Evaluating las vegas algorithms-pitfalls and remedies. In Proc. Uncertainty in AI, San Francisco, 1998. Morgan Kaufmann, San Mateo, CA.
 
60
HORVITZ,E.J.,SUERMONDT,H.J.,AND COOPER,G.F. 1989. Bounded conditioning: flexible inference for decisions under scarce resources. In Proceedings of the Fifth Conference on Uncertainty in Artificial Intelligence (UAI-89), Windsor, Ontario, 1989. Morgan Kaufmann, San Mateo, CA, 182- 193.
 
61
JAAKKOLA,T.S.AND JORDAN, M. I. 1996a. Computing upper and lower bounds on likelihoods in intractable networks. In Proc. Uncertainty in AI.
 
62
JAAKKOLA,T.S.AND JORDAN, M. I. 1996b. Recursive algorithms for approximating probabilities in graphical models. Tech. Rep. 9604 (June), MIT Computational Cognitive Science.
 
63
JENSEN,F.V.,LAURITZEN,S.L.,AND OLESEN, K. G. 1990. Bayesian updating in causal probabilistic networks by local computations. SIAM Journal on Computing 4, 269-282.
 
64
KAUTZ,H.AND SELMAN, B. 1996. Pushing the envelope: planning, propositional logic and stochastic search. In Proceedings AAAI96, Menlo Park, Aug. 1996. AAAI Press/MIT Press, Cambridge, MA, 1194-1201.
 
65
KAUTZ, H., KEARNS, M., AND SELMAN, B. 1993. Reasoning with characteristic models. In AAAI-93, 34-39.
 
66
 
67
KJARULFF, U. 1994. Reduction of computational complexity in Bayesian networks through removal of weak dependences. In Uncertainty in Artificial Intelligence: Proceedings of the Tenth Conference, Seattle, WA, 1994, R. L. DE MANTARAS AND D. POOLE, Eds.
 
68
KOLLER,D.AND PFEFFER, A. 1997. Learning probabilities for noisy first-order rules. In Proceedings of the 15th International Joint Conference on Artificial Intelligence (IJCAI), Nagoya, Japan, Aug. 1997.
 
69
KOLLER, D., LEVY, A., AND PFEFFER, A. 1997. P- classic: a tractable probabilistic description logic. In Proceedings of the 14th National Conference on Artificial Intelligence (AAAI), Providence, Rhode Island, Aug. 1997.
 
70
 
71
LAURITZEN,S.AND SPIEGELHALTER, D. J. 1988. Local computations with probabilities on graphical structures and their application to expert systems (with discussion). Journal of the Royal Statistical Society series B 50, 157-224. Reprinted in (Shafer and Pearl 1990).
 
72
LEPAR,V.AND SHENOY, P. P. 1998. A comparison of lauritzen-spiegelhalter, hugin, and shenoy-shafer architectures for computing marginals of probability distributions. In Proc. Uncertainty in AI, San Francisco, 1998. Morgan Kaufmann, San Mateo, CA.
 
73
 
74
LEVESQUE,H.AND BRACHMAN, R. 1985. A fundamental tradeoff in knowledge representation and reasoning. In Readings in Knowledge Representation, Los Altos, CA, 1985, R. BRACHMAN AND H.
 
75
LEVESQUE, Eds. Morgan Kaufmann, San Mateo, CA. 41-70.
 
76
LI,Z.AND D'AMBROSIO, B. 1994. Efficient inference in bayes nets as a combinatorial optimization problem. International Journal of Approximate Reasoning 11, 1, 55-81.
77
 
78
 
79
 
80
MCCARTHY, J. 1977. Epistemological problems in artificial intelligence. In Proceedings of the Fifth International Joint Conference on Artificial Intelligence (IJCAI-77), Cambridge, MA, Aug. 1977. IJCAI.
 
81
MCCARTHY, J. 1980. Circumscription-a form of non-monotonic reasoning. Artificial Intelligence 13, 1-2 (April), 27-39.
 
82
 
83
MENGSHOEL,O.J.AND WILKINS, D. 1997. Abstraction and aggregation in belief networks. In AAAI97 Workshop on Abstractions, Decisions and Uncertainty.
 
84
 
85
 
86
MOORE, R. C. 1982. The role of logic in knowledge representation and commonsense reasoning. In Proceedings of the National Conference on Artificial Intelligence, Pittsburgh, PA, Aug. 1982, D. WALTZ, Ed. AAAI Press, Menlo Park, Calif., 428- 433.
 
87
NAGEL,E.AND NEWMAN, J. 1958. G odel's Proof. New York University Press, New York.
 
88
 
89
 
90
 
91
 
92
 
93
POOLE, D. 1993a. Average-case analysis of a search algorithm for estimating prior probabilities in Bayesian networks with extreme probabilities. In Proceedings IJCAI-93, Chamberery, France, Aug. 1993, 606-612.
 
94
 
95
POOLE, D., GOEBEL, R., AND ALELIUNAS, R. 1987. Theorist: a logical reasoning system for default and diagnosis. In The Knowledge Frontier: Essays in the Representation of Knowledge, New York, 1987, N. CERCONE AND G. MCCALLA, Eds. Springer, Berlin, 331-52.
 
96
 
97
PRADHAN,M.AND DAGUM, P. 1996. Optimal Monte Carlo estimation of belief network inference. In Proceedings of the 12th Conference on Uncertainty in Artificial Intelligence (UAI-96), San Francisco, Aug. 1996, E. HORVITZ AND F. J ENSEN, Eds. Morgan Kaufmann, San Mateo, CA. 446- 453.
 
98
PRADHAN, M., PROVAN, G., MIDDLETON,B.,AND HENRION, M. 1994. Knowledge engineering for large belief networks. In Proceedings of the 10th Conference on Uncertainty in Artificial Intelligence, San Francisco, CA, USA, July 1994, R. L. DE MAN- TARAS AND D. POOLE, Eds. Morgan Kaufmann, San Mateo, CA, 484-490.
 
99
RABINER,L.R.AND JUANG, B. H. 1986. An introduction to hidden Markov models. IEEE ASSP Magazine, 4ff.
 
100
REITER, R. 1978a. Deductive question-answering on relational data bases. In Logic and Data Bases, H. GALLAIRE AND J. MINKER, Eds. Plenum Press, New York, 149-177.
 
101
REITER, R. 1978b. On closed world data bases. In Logic and Data Bases,H.GALLAIRE AND J. MINKER Eds. Plenum Press, New York, 55-76.
102
 
103
REITER, R. 1987. Nonmonotonic reasoning. In Annual Review of Computing Sciences, vol. 2, Annual Reviews, Palo Alto, 147-187.
104
 
105
 
106
RUDNICKI, P. 1992. An overview of the Mizar project. In Notes to a Talk at the Workshop on Types for Proofs and Programs.
 
107
SACERDOTI, E. D. 1973. Planning in a hierarchy of abstraction spaces. In IJCAI-73.
 
108
 
109
110
 
111
SELMAN, B., LEVESQUE, H., AND MITCHELL, D. 1992. A new method for solving hard satisfiability problems. In Proceedings of the Twelfth National Conference on Artificial Intelligence, San Jose, July 1992, 440-446.
 
112
 
113
SINGH, M. 1998. Learning Belief Networks. Ph.D. thesis, Dept. of Computer Science, Univ. of Pennsylvania.
 
114
 
115
 
116
 
117
SRINIVAS, S. 1994. A probabilistic apprach to hierarchical model-based diagnosis. Tech. Rep. Research Rep. no. KSL-94-14 (Feb.), Knowledge Systems Laboratory, Stanford Univ.
 
118
119
 
120
 
121
 
122
TURING, A. M. 1936. On computable numbers, with an application to the Entscheidungs problem. Proc. London Math. Soc. 2, 42, 230-265. Corrections on vol. 2, 43, 544-546.
 
123
VALIANT, L. G. 1979. The complexity of enumeration and reliability problems. SIAM Journal on Computing 8, 3, 410-421.
 
124
 
125
 
126
 
127
WELLMAN, M. 1994. Abstraction in Probabilistic Reasoning. Tech. Rep., Univ. of Michigan. Tutorial prepared for the Summer Institute on Probability in AI, Corvallis, OR, July 1994. See http://ai.eecs.umich.edu/people/wellman/ tut/Abstraction.html.
 
128
 
129
 
130
ZHANG,N.L.AND POOLE, D. 1994. A simple approach to Bayesian network computations. In Proc. of the 10th Canadian Conference on Artificial Intelligence, Banff, Alberta, Canada, May 1994.
 
131
132

CITED BY  8


REVIEW

"John Abel Moyne : Reviewer"

The authors begin with the premise that many tasks require "reasoning"--i.e., deriving conclusions from a corpus of explicitly sotred information--to solve their range of problems. The paper is a useful survey and a formal mathematical descript  more...

Collaborative Colleagues:
Russell Greiner: colleagues
Christian Darken: colleagues
N. Iwan Santoso: colleagues