A Bayesian/information theoretic model of bias learning

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

A Bayesian/information theoretic model of bias learning

Full text

Pdf (1.20 MB)

Source

Annual Workshop on Computational Learning Theory archive
Proceedings of the ninth annual conference on Computational learning theory table of contents

Desenzano del Garda, Italy

Pages: 77 - 88

Year of Publication: 1996

ISBN:0-89791-811-8

Author

Jonathan Baxter

Department of Mathematics, London School of Economics and Department of Computer Science, Royal Holloway College, University of London

Sponsors

Univ degli Studi de Milano : Universite degli Studi de Milano
SIGACT: ACM Special Interest Group on Algorithms and Computation Theory
SIGART: ACM Special Interest Group on Artificial Intelligence

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 20, Downloads (12 Months): 37, Citation Count: 2

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/238061.238071 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	1	Francesca Albertini , Eduardo D. Sontag, For neural networks, function determines form, Neural Networks, v.6 n.7, p.975-990, 1993 [doi>10.1016/S0893-6080(09)80007-5]
	2	Peter L. Bartlett , Philip M. Long , Robert C. Williamson, Fat-shattering and the learnability of real-valued functions, Proceedings of the seventh annual conference on Computational learning theory, p.299-310, July 12-15, 1994, New Brunswick, New Jersey, United States [doi>10.1145/180139.181158]
	3	J. Baxter. A Model of Bias Learning. Technical Report LSE-MPS-97, London School of Economics, Centre for Discrete and Applicable Mathematics, November 1995. Submitted to Journal of the ACM.
	4	Jonathan Baxter, Learning internal representations, Proceedings of the eighth annual conference on Computational learning theory, p.311-320, July 05-08, 1995, Santa Cruz, California, United States [doi>10.1145/225298.225336]
	5	J. O. Berger. Statistical Deciswn Theory and Bayesian Analysis. Springer-Verlag, New York, 1985.
	6	J. O. Berger. Multivariate Estimation: Bayes, Empirical Bayes, and Stein Approaches. SIAM, 1986.
	7	J. S. Bridle. Probabilistic interpretation of feedforward classification network outputs, with relationships to statistical pattern recognition. In F. Fogelman-Soulie and J. Herault, editors, Neurocomputzng: Algorzthms, Architectures. Springer Verlag, New York, 1989.
	8	B. Clarke and A. Barron. Information-Theoretic Asymptotics of Bayes Methods. IEEE Transactions on Information Theory, 36:453-471, 1990.
	9	Thomas M. Cover , Joy A. Thomas, Elements of information theory, Wiley-Interscience, New York, NY, 1991
	10	I. J. Good. Some History of the Hierarchical Bayesian Methodology. In J. M. Bernado, M. H. D. Groot, D. V. Lindley, and A. F. M. Smith, editors, Bayesian Statistics II. University Press, Valencia, 1980.
	11	David Haussler , Manfred Opper, General bounds on the mutual information between a parameter and n conditionally independent observations, Proceedings of the eighth annual conference on Computational learning theory, p.402-411, July 05-08, 1995, Santa Cruz, California, United States [doi>10.1145/225298.225347]
	12	V. Kurkova and P. C. Kainen. Functionally equivalent feedforward neural networks. Neural Computation, 6:543-558, 1994.
	13	David J. C. MacKay, Bayesian interpolation, Neural Computation, v.4 n.3, p.415-447, May 1992 [doi>10.1162/neco.1992.4.3.415]
	14	D. Mackay. The Evidence Framework Applied to Classification Networks. Neural Computation, 4:698-714, 1991.
	15	Héctor J. Sussmann, Uniqueness of the weights for minimal feedforward nets with a given input-output map, Neural Networks, v.5 n.4, p.589-593, July-Aug. 1992 [doi>10.1016/S0893-6080(05)80037-1]
	16	L. G. Valiant, A theory of the learnable, Communications of the ACM, v.27 n.11, p.1134-1142, Nov. 1984 [doi>10.1145/1968.1972]
	17	Vladimir Vapnik, Estimation of Dependences Based on Empirical Data: Springer Series in Statistics (Springer Series in Statistics), Springer-Verlag New York, Inc., Secaucus, NJ, 1982
	18	V. N. Vapnik and A. Y. Chervonenkis. On the uniform convergence of relative frequencies of events to their probabilities. Theory Probab. Appl., 16:264- 280, 1971.

CITED BY 2

	Jonathan Baxter, A Bayesian/Information Theoretic Model of Learning to Learn viaMultiple Task Sampling, Machine Learning, v.28 n.1, p.7-39, July 1997
	Rich Caruana, Multitask Learning, Machine Learning, v.28 n.1, p.41-75, July 1997