|
ABSTRACT
Many tasks require “reasoning”—i.e., deriving conclusions from a corpus of explicitly stored information—to solve their range of problems. An ideal reasoning system would produce all-and-only the correct answers to every possible query, produce answers that are as specific as possible, be expressive enough to permit any possible fact to be stored and any possible query to be asked, and be (time) efficient. Unfortunately, this is provably impossible: as correct and precise systems become more expressive, they can become increasingly inefficient, or even undecidable. This survey first formalizes these hardness results, in the context of both logic- and probability-based reasoning, then overviews the techniques now used to address, or at least side-step, this dilemma.
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
| |
1
|
AAAI. 1992. Workshop on Approximation and Abstraction of Computational Theories. Tech. Rep., AAAI.
|
| |
2
|
|
| |
3
|
ALCHOURR ON, C. E., G ARDENFORS,P.,AND MAKIN- SON, D. 1985. On the logic of theory change: partial meet contraction and revision functions. Journal of Symbolic Logic 50, 510- 30.
|
| |
4
|
ANDERSEN, S. K., OLESEN,K.G.,JENSEN,F.V.,AND JENSEN, F. 1989. HUGIN-a shell for building Bayesian belief universes for expert systems. In Proceedings of the Eleventh International Joint Conference on Artificial Intelligence (IJCAI-89), Detroit, Michigan, Aug. 1989. Morgan Kaufmann, San Mateo, CA, vol. 2, 1080- 1085.
|
| |
5
|
|
| |
6
|
AZEVEDO, P. J. 1997. Magic sets with full sharing. Journal of Logic Programming 30, 3 (March), 223-237.
|
| |
7
|
|
 |
8
|
|
| |
9
|
BEINLICH, I. A., SUERMONDT,H.J.,CHAVEZ,R.M.,AND COOPER, G. F. 1989. The ALARM monitoring system: a case study with two probabilistic inference techniques for belief networks. In Proceedings of the Second European Conference on Artificial Intelligence in Medicine, London, Aug. 1989. Springer, Berlin.
|
| |
10
|
BOBROW. 1980. Artificial intelligence. Special Issue on Non-Monotonic Logic.
|
| |
11
|
BOROS, E., CRAMA,Y.,AND HAMMER, P. 1990. Polynomial-time inference of all valid implications for horn and related formulae. Annals of Mathematics and Artificial Intelligence 1, 21- 32.
|
| |
12
|
BRACEWELL, R. N. 1978. The Fourier Transform and Its Applications. McGraw-Hill, New York.
|
| |
13
|
|
| |
14
|
|
| |
15
|
|
| |
16
|
CHAUDHRI,V.AND GREINER, R. 1992. A formal analysis of solution caching. In Proceedings of the Ninth Canadian Conference on Artificial Intelligence, Vancouver, 1992.
|
| |
17
|
CHOW,C.K.AND LUI, C. N. 1968. Aproximating discrete probability distributions with dependence trees. IEEE Transactions on Information Theory 14, 3, 462-467.
|
| |
18
|
CLARK, K. 1978. Negation as failure. In Logic and Data Bases, H. Gallaire and J. Minker Eds. Plenum Press, New York, 293-322.
|
| |
19
|
|
| |
20
|
|
| |
21
|
COUSINS, S., CHEN,W.,AND FRISSE, M. 1993. A tutorial introduction to stochastic simulation algorithms for belief networks. Artificial Intelligence in Medicine 5, 315-340.
|
| |
22
|
|
| |
23
|
|
| |
24
|
DALAL,M.AND ETHERINGTON, D. W. 1992a. Tractable approximate deduction using limited vocabulary. In Proceedings of the Ninth Canadian Conference on Artificial Intelligence, Vancouver, May 1992.
|
| |
25
|
|
| |
26
|
DARWICHE,A.AND PROVAN, G. M. 1996. Query dags: a practical paradigm for implementing belief network inference. In Proc. Uncertainty in AI.
|
| |
27
|
DARWICHE,A.AND PROVAN, G. M. 1997. A standard approach for optimizing belief network inference using query dags. In Proc. Uncertainty in AI.
|
| |
28
|
DECHTER, R. 1996. Topological parameters for timespace tradeoff. In Proc. Uncertainty in AI, San Francisco, 1996, E. Horvitz and F. Jensen, Eds. Morgan Kaufmann, San Maeto, CA, 220- 227.
|
| |
29
|
|
| |
30
|
DECHTER,R.AND RISH, I. 1997. A scheme for approximating probabilistic inference. In Proc. Uncertainty in AI.
|
| |
31
|
DELCHER, A. L., GROVE, A., KASIF,S.,AND PEARL, J. 1996. Logarithmic-time updates and queries in probabilistic networks. J. Artificial Intelligence Research 4, 37-59.
|
| |
32
|
|
| |
33
|
DOWLING,W.F.AND GALLIER, J. H. 1984. Linear time algorithms for testing the satisfiability of propositional horn formula. Journal of Logic Programming 3, 267-84.
|
| |
34
|
|
| |
35
|
DRAPER,D.L.AND HANKS, S. 1994. Localized partial evaluation of belief networks. In Proceedings of the 10th Conference on Uncertainty in Artificial Intelligence, San Francisco, CA, USA, July 1994, R. L. DE MANTARAS AND D. POOLE, Eds. Morgan Kaufmann, San Maeto, CA, 170- 177.
|
| |
36
|
ELLMAN, T. 1993. Abstraction via approximate symmetry. In IJCAI-93.
|
| |
37
|
ENDERTON, H. B. 1972. AMathematical Introduction to Logic. Academic Press, New York.
|
| |
38
|
FELLER, W. 1966. An Introduction to Probability Theory and Its Applications II. John Wiley, New York.
|
| |
39
|
|
| |
40
|
Eugene C. Freuder, Principles and Practice of Constraint Programming-CP '96: Second International Conference, CP 96, Cambridge, Ma, U. S. A., August 1996: Proceedings, Springer-Verlag New York, Inc., Secaucus, NJ, 1996
|
| |
41
|
|
| |
42
|
|
| |
43
|
|
| |
44
|
GENESERETH,M.R.AND FIKES, R. E. 1992. Knowledge Interchange Format, Version 3.0 Reference Manual. Tech. Rep. Logic-92-1 (June), Computer Science Dept., Stanford Univ.
|
| |
45
|
|
| |
46
|
|
| |
47
|
GINSBERG, M. L. 1991. Knowledge Interchange Format: The KIF of Death. Tech. Rep., Stanford Univ.
|
| |
48
|
|
| |
49
|
|
| |
50
|
|
| |
51
|
GREINER, R. 1999. Explanation-based learning. In The Encyclopedia of Cognitive Science,R.WILSON AND F. KEIL, Eds. MIT Press, Cambridge, MA, 301-303. A Bradford Book.
|
| |
52
|
GREINER,R.AND ELKAN, C. 1991. Measuring and improving the efiectiveness of representations. In Proceedings of the Twelfth International Joint Conference on Artificial Intelligence, Sydney, Australia, Aug. 1991, 518-524.
|
| |
53
|
GREINER,R.AND SCHUURMANS, D. 1992. Learning useful horn approximations. In Proceedings of KR-92, San Mateo, CA, Oct. 1992, B. NEBEL, C. RICH, AND W. SWARTOUT, Eds. Morgan Kaufmann, San Mateo, CA.
|
| |
54
|
GREINER, R., GROVE, A., AND SCHUURMANS, D. 1997. Learning Bayesian nets that perform well. In Uncertainty in Artificial Intelligence.
|
| |
55
|
|
| |
56
|
|
| |
57
|
HECKERMAN, D. E. 1995. A Tutorial on Learning with Bayesian Networks. Tech. Rep. MSR-TR- 95-06, Microsoft Research.
|
| |
58
|
HERSKOVITS,E.H.AND COOPER, C. 1991. Algorithms for Bayesian Belief-network Precomputation. In Methods of Information in Medicine.
|
| |
59
|
HOOS,H.H.AND STUTZLE, T. 1998. Evaluating las vegas algorithms-pitfalls and remedies. In Proc. Uncertainty in AI, San Francisco, 1998. Morgan Kaufmann, San Mateo, CA.
|
| |
60
|
HORVITZ,E.J.,SUERMONDT,H.J.,AND COOPER,G.F. 1989. Bounded conditioning: flexible inference for decisions under scarce resources. In Proceedings of the Fifth Conference on Uncertainty in Artificial Intelligence (UAI-89), Windsor, Ontario, 1989. Morgan Kaufmann, San Mateo, CA, 182- 193.
|
| |
61
|
JAAKKOLA,T.S.AND JORDAN, M. I. 1996a. Computing upper and lower bounds on likelihoods in intractable networks. In Proc. Uncertainty in AI.
|
| |
62
|
JAAKKOLA,T.S.AND JORDAN, M. I. 1996b. Recursive algorithms for approximating probabilities in graphical models. Tech. Rep. 9604 (June), MIT Computational Cognitive Science.
|
| |
63
|
JENSEN,F.V.,LAURITZEN,S.L.,AND OLESEN, K. G. 1990. Bayesian updating in causal probabilistic networks by local computations. SIAM Journal on Computing 4, 269-282.
|
| |
64
|
KAUTZ,H.AND SELMAN, B. 1996. Pushing the envelope: planning, propositional logic and stochastic search. In Proceedings AAAI96, Menlo Park, Aug. 1996. AAAI Press/MIT Press, Cambridge, MA, 1194-1201.
|
| |
65
|
KAUTZ, H., KEARNS, M., AND SELMAN, B. 1993. Reasoning with characteristic models. In AAAI-93, 34-39.
|
| |
66
|
|
| |
67
|
KJARULFF, U. 1994. Reduction of computational complexity in Bayesian networks through removal of weak dependences. In Uncertainty in Artificial Intelligence: Proceedings of the Tenth Conference, Seattle, WA, 1994, R. L. DE MANTARAS AND D. POOLE, Eds.
|
| |
68
|
KOLLER,D.AND PFEFFER, A. 1997. Learning probabilities for noisy first-order rules. In Proceedings of the 15th International Joint Conference on Artificial Intelligence (IJCAI), Nagoya, Japan, Aug. 1997.
|
| |
69
|
KOLLER, D., LEVY, A., AND PFEFFER, A. 1997. P- classic: a tractable probabilistic description logic. In Proceedings of the 14th National Conference on Artificial Intelligence (AAAI), Providence, Rhode Island, Aug. 1997.
|
| |
70
|
|
| |
71
|
LAURITZEN,S.AND SPIEGELHALTER, D. J. 1988. Local computations with probabilities on graphical structures and their application to expert systems (with discussion). Journal of the Royal Statistical Society series B 50, 157-224. Reprinted in (Shafer and Pearl 1990).
|
| |
72
|
LEPAR,V.AND SHENOY, P. P. 1998. A comparison of lauritzen-spiegelhalter, hugin, and shenoy-shafer architectures for computing marginals of probability distributions. In Proc. Uncertainty in AI, San Francisco, 1998. Morgan Kaufmann, San Mateo, CA.
|
| |
73
|
|
| |
74
|
LEVESQUE,H.AND BRACHMAN, R. 1985. A fundamental tradeoff in knowledge representation and reasoning. In Readings in Knowledge Representation, Los Altos, CA, 1985, R. BRACHMAN AND H.
|
| |
75
|
LEVESQUE, Eds. Morgan Kaufmann, San Mateo, CA. 41-70.
|
| |
76
|
LI,Z.AND D'AMBROSIO, B. 1994. Efficient inference in bayes nets as a combinatorial optimization problem. International Journal of Approximate Reasoning 11, 1, 55-81.
|
 |
77
|
|
| |
78
|
|
| |
79
|
|
| |
80
|
MCCARTHY, J. 1977. Epistemological problems in artificial intelligence. In Proceedings of the Fifth International Joint Conference on Artificial Intelligence (IJCAI-77), Cambridge, MA, Aug. 1977. IJCAI.
|
| |
81
|
MCCARTHY, J. 1980. Circumscription-a form of non-monotonic reasoning. Artificial Intelligence 13, 1-2 (April), 27-39.
|
| |
82
|
|
| |
83
|
MENGSHOEL,O.J.AND WILKINS, D. 1997. Abstraction and aggregation in belief networks. In AAAI97 Workshop on Abstractions, Decisions and Uncertainty.
|
| |
84
|
|
| |
85
|
|
| |
86
|
MOORE, R. C. 1982. The role of logic in knowledge representation and commonsense reasoning. In Proceedings of the National Conference on Artificial Intelligence, Pittsburgh, PA, Aug. 1982, D. WALTZ, Ed. AAAI Press, Menlo Park, Calif., 428- 433.
|
| |
87
|
NAGEL,E.AND NEWMAN, J. 1958. G odel's Proof. New York University Press, New York.
|
| |
88
|
Robert Neches , Richard Fikes , Tim Finin , Tom Gruber , Ramesh Patil , Ted Senator , William R. Swartout, Enabling technology for knowledge sharing, AI Magazine, v.12 n.3, p.36-56, Fall 1991
|
| |
89
|
|
| |
90
|
|
| |
91
|
|
| |
92
|
|
| |
93
|
POOLE, D. 1993a. Average-case analysis of a search algorithm for estimating prior probabilities in Bayesian networks with extreme probabilities. In Proceedings IJCAI-93, Chamberery, France, Aug. 1993, 606-612.
|
| |
94
|
|
| |
95
|
POOLE, D., GOEBEL, R., AND ALELIUNAS, R. 1987. Theorist: a logical reasoning system for default and diagnosis. In The Knowledge Frontier: Essays in the Representation of Knowledge, New York, 1987, N. CERCONE AND G. MCCALLA, Eds. Springer, Berlin, 331-52.
|
| |
96
|
|
| |
97
|
PRADHAN,M.AND DAGUM, P. 1996. Optimal Monte Carlo estimation of belief network inference. In Proceedings of the 12th Conference on Uncertainty in Artificial Intelligence (UAI-96), San Francisco, Aug. 1996, E. HORVITZ AND F. J ENSEN, Eds. Morgan Kaufmann, San Mateo, CA. 446- 453.
|
| |
98
|
PRADHAN, M., PROVAN, G., MIDDLETON,B.,AND HENRION, M. 1994. Knowledge engineering for large belief networks. In Proceedings of the 10th Conference on Uncertainty in Artificial Intelligence, San Francisco, CA, USA, July 1994, R. L. DE MAN- TARAS AND D. POOLE, Eds. Morgan Kaufmann, San Mateo, CA, 484-490.
|
| |
99
|
RABINER,L.R.AND JUANG, B. H. 1986. An introduction to hidden Markov models. IEEE ASSP Magazine, 4ff.
|
| |
100
|
REITER, R. 1978a. Deductive question-answering on relational data bases. In Logic and Data Bases, H. GALLAIRE AND J. MINKER, Eds. Plenum Press, New York, 149-177.
|
| |
101
|
REITER, R. 1978b. On closed world data bases. In Logic and Data Bases,H.GALLAIRE AND J. MINKER Eds. Plenum Press, New York, 55-76.
|
 |
102
|
|
| |
103
|
REITER, R. 1987. Nonmonotonic reasoning. In Annual Review of Computing Sciences, vol. 2, Annual Reviews, Palo Alto, 147-187.
|
 |
104
|
|
| |
105
|
|
| |
106
|
RUDNICKI, P. 1992. An overview of the Mizar project. In Notes to a Talk at the Workshop on Types for Proofs and Programs.
|
| |
107
|
SACERDOTI, E. D. 1973. Planning in a hierarchy of abstraction spaces. In IJCAI-73.
|
| |
108
|
|
| |
109
|
|
 |
110
|
|
| |
111
|
SELMAN, B., LEVESQUE, H., AND MITCHELL, D. 1992. A new method for solving hard satisfiability problems. In Proceedings of the Twelfth National Conference on Artificial Intelligence, San Jose, July 1992, 440-446.
|
| |
112
|
|
| |
113
|
SINGH, M. 1998. Learning Belief Networks. Ph.D. thesis, Dept. of Computer Science, Univ. of Pennsylvania.
|
| |
114
|
|
| |
115
|
|
| |
116
|
|
| |
117
|
SRINIVAS, S. 1994. A probabilistic apprach to hierarchical model-based diagnosis. Tech. Rep. Research Rep. no. KSL-94-14 (Feb.), Knowledge Systems Laboratory, Stanford Univ.
|
| |
118
|
|
 |
119
|
|
| |
120
|
|
| |
121
|
|
| |
122
|
TURING, A. M. 1936. On computable numbers, with an application to the Entscheidungs problem. Proc. London Math. Soc. 2, 42, 230-265. Corrections on vol. 2, 43, 544-546.
|
| |
123
|
VALIANT, L. G. 1979. The complexity of enumeration and reliability problems. SIAM Journal on Computing 8, 3, 410-421.
|
| |
124
|
|
| |
125
|
|
| |
126
|
|
| |
127
|
WELLMAN, M. 1994. Abstraction in Probabilistic Reasoning. Tech. Rep., Univ. of Michigan. Tutorial prepared for the Summer Institute on Probability in AI, Corvallis, OR, July 1994. See http://ai.eecs.umich.edu/people/wellman/ tut/Abstraction.html.
|
| |
128
|
|
| |
129
|
|
| |
130
|
ZHANG,N.L.AND POOLE, D. 1994. A simple approach to Bayesian network computations. In Proc. of the 10th Canadian Conference on Artificial Intelligence, Banff, Alberta, Canada, May 1994.
|
| |
131
|
|
 |
132
|
|
CITED BY 8
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Tharam Dillon , Elizabeth Chang , Maja Hadzic , Pornpit Wongthongtham, Differentiating conceptual modelling from data modelling, knowledge modelling and ontology modelling and a notation for ontology modelling, Proceedings of the fifth on Asia-Pacific conference on conceptual modelling, January 01-01, 2008, Wollongong, NSW, Australia
|
|
|
|
REVIEW
"John Abel Moyne : Reviewer"
The authors begin with the premise that many tasks require
"reasoning"--i.e., deriving conclusions from a corpus of
explicitly sotred information--to solve their range of problems.
The paper is a useful survey and a formal mathematical descript
more...
|