Improving the performance of log-structured file systems with adaptive methods

Subscribe (Full Service)


	Search: The ACM Digital Library The Guide

	Feedback

Improving the performance of log-structured file systems with adaptive methods

Full text

Pdf (2.18 MB)

Source

ACM Symposium on Operating Systems Principles archive
Proceedings of the sixteenth ACM symposium on Operating systems principles table of contents

Saint Malo, France

Pages: 238 - 251

Year of Publication: 1997

ISBN:0-89791-916-5

Also published in ...

Authors

Jeanna Neefe Matthews	Computer Science Division, University of California, Berkeley
Drew Roselli	Computer Science Division, University of California, Berkeley
Adam M. Costello	Computer Science Division, University of California, Berkeley
Randolph Y. Wang	Computer Science Division, University of California, Berkeley
Thomas E. Anderson	Computer Science Division, University of California, Berkeley

Sponsors

INRIA : Institut Natl de Recherche en Info et en Automatique
SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

ACM New York, NY, USA

Bibliometrics

Downloads (6 Weeks): 12, Downloads (12 Months): 105, Citation Count: 34

Additional Information:

references cited by index terms collaborative colleagues

Tools and Actions:	Request Permissions Review this Article Save this Article to a Binder Display Formats: BibTeX EndNote ACM Ref

DOI Bookmark:	Use this link to bookmark this Article: http://doi.acm.org/10.1145/268998.266700 What is a DOI?

REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

	Akyü95	Sedat Akyürek , Kenneth Salem, Adaptive block rearrangement, ACM Transactions on Computer Systems (TOCS), v.13 n.2, p.89-121, May 1995 [doi>10.1145/201045.201046]
	Ande96	Thomas E. Anderson , Michael D. Dahlin , Jeanna M. Neefe , David A. Patterson , Drew S. Roselli , Randolph Y. Wang, Serverless network file systems, ACM Transactions on Computer Systems (TOCS), v.14 n.1, p.41-79, Feb. 1996 [doi>10.1145/225535.225537]
	Bake91	Mary G. Baker , John H. Hartman , Michael D. Kupfer , Ken W. Shirriff , John K. Ousterhout, Measurements of a distributed file system, Proceedings of the thirteenth ACM symposium on Operating systems principles, p.198-212, October 13-16, 1991, Pacific Grove, California, United States
	Barn93	S. Bamard and H. Simon. A Fast Multilevel Implementation of Recursive Spectral Bisection for Partitioning Unstructured Problems. Prec. Sixth SIAM Conference on Parallel Processing for Scientific Computing, pp. 711-718, 1993.
	Birr93	A. Birrell, A. Hisgen, C. Jedan, T. Mann, and G. Swart. The Echo Distributed File System. Technical Report 111, Digital Equipment Corp. Systems Research Center, Sep. 1993.
	Blac95	T. Blackwell,J. Harris, andM. Seltzer. Heuristic Cleaning Algorithms in Log-Structured File Sygtems. Prec. 1995. Winter USENIX Conference, pp. 277-288, Jan. 1995.
	Chen94	Peter M. Chen , Edward K. Lee , Garth A. Gibson , Randy H. Katz , David A. Patterson, RAID: high-performance, reliable secondary storage, ACM Computing Surveys (CSUR), v.26 n.2, p.145-185, June 1994 [doi>10.1145/176979.176981]
	Chut92	S. Chutani, O. Anderson, M. Kazar, B. Leverett, W. Mason, and R. Siedbotham. The Episode File System. Prec. 1992 Winter USENIX Conference, pp. 43--60, Jan. 1992.
	Cust94	Helen Custer, Inside the Windows NT File System, Microsoft Press, Redmond, WA, 1994
	Dahl94	Michael D. Dahlin , Clifford J. Mather , Randolph Y. Wang , Thomas E. Anderson , David A. Patterson, A quantitative analysis of cache policies for scalable network file systems, Proceedings of the 1994 ACM SIGMETRICS conference on Measurement and modeling of computer systems, p.150-160, May 16-20, 1994, Nashville, Tennessee, United States
	Dahl95	Michael Donald Dahlin , David A. Patterson, Serverless network file systems, 1995
	Gang94	G. Ganger and Y. Patt. Metadata Update Performance in File Systems. Prec. First Symposium on Operating Systems Design and Implementation, pp. 49-60, Nov. 1994.
	Gold95	R. Gelding, P. Bosch, C. Staelin, T. Sullivan, and J. Wilkes. Idleness is Not Sloth. Prec. 1995 Winter US- EN1X Conference, pp. 201-202, Jan. 1995.
	Grif94	J. Griffioen and R. Appleton. Reducing File SystemLatency Using A Predictive Approach. Prec. 1994 Summer US- ENiX Conference, pp. 197-207, Jun. 1994.
	Hagm87	R. Hagmann, Reimplementing the Cedar file system using logging and group commit, Proceedings of the eleventh ACM Symposium on Operating systems principles, p.155-162, November 08-11, 1987, Austin, Texas, United States
	Hart93	John H. Hartman , John K. Ousterhout, The Zebra striped network file system, ACM Transactions on Computer Systems (TOCS), v.13 n.3, p.274-310, Aug. 1995 [doi>10.1145/210126.210131]
	Hend93	B. Hendrickson and R. Leland. A Multilevel Algorithm for Partitioning Graphs. Technical Report SAND93-1301, Sandia National Laboratories, 1993.
	Hitz94	D. Hitz and .1. Lau and M. Malcolm. File System Design for an NFS Server Appliance. Prec. 1994 Winter USENIX Conference, pp. 235-246, 1994.
	Jaco88	V. Jacobson, Congestion avoidance and control, Symposium proceedings on Communications architectures and protocols, p.314-329, August 16-18, 1988, Stanford, California, United States
	Jaco91	D. Jacobsen and J. Wilkes. Disk Scheduling Algorithms Based on Rotational Position. Technical Report HPL-CSP- 91-Yrevl, Hewlett-Packard Laboratories, Pale Alto, CA, Mar. 1991.
	Kary95	G. Karypis and V. Kumar. A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs. Technical Report TR 95-035, University of Minnesota, 1995.
	Kotz94	David Kotz , Song B Toh , Sriram Radhakrishnan, A Detailed Simulation Model of the HP 97560 Disk Drive, Dartmouth College, Hanover, NH, 1994
	Kowa78	T. Kowalski. FSCK: The UNIX System Check Program, Technical report, Bell Laboratory, Murray Hill, NJ, Mat, 1978.
	Kroe96	T. Kroeger and D. Long. Predicting Future File. System Actions From Prior Events. Prec. 1996 LtSENIX Confer, ence, pp. 319-328, Jan. 1996.
	Lome95	D. Lomet. The Case for Log Structuring in Database Systems. lnt'l Workshop on High Performance Transaction Systems, Sep. 1995.
	McDo89	M. McDonald and R. Bunt. Improving File System Performance by Dynamically Restructuring Disk Space. Free, Phoenix Conference on Computers and Communication (Scottsdale, AZ), pp. 264-269, Mar. 1989.
	McNu94	B. McNutt, Background data movement in a log-structured disk subsystem, IBM Journal of Research and Development, v.38 n.1, p.47-58, Jan. 1994
	McKu84	Marshall K. McKusick , William N. Joy , Samuel J. Leffler , Robert S. Fabry, A fast file system for UNIX, ACM Transactions on Computer Systems (TOCS), v.2 n.3, p.181-197, Aug. 1984 [doi>10.1145/989.990]
	McVo91	L. McVoy and S. Kleiman. Extent-like Performance from a UNIX File System. Prec. 1991 Winter USEIVlX Conference, pp. 33-43, Jan. 1991.
	Math96	Matthew Mathis , Jamshid Mahdavi, Forward acknowledgement: refining TCP congestion control, Conference proceedings on Applications, technologies, architectures, and protocols for computer communications, p.281-291, August 28-30, 1996, Palo Alto, California, United States
	Oust95a	J. Ousterhout. A Critique of Seltzer's 1993 USENIX Paper. http://www.sunlabs.com/people/john.ousterhout/ seltzer93.html, 1995.
	Oust95b	J. Ousterhout. A Critique of Seltzer's LFS Measure, menu. http:llwww.sunlabs.comlpeopleljohn.ousterhoutl seltzer, html
	Oust95c	J. Ousterhout. A Response to Seltzer's Response. http:// www. sunlabs.com/people/john.ousterhout/seltzer2,html,
	Ritc74	Dennis M. Ritchie , Ken Thompson, The UNIX time-sharing system, Communications of the ACM, v.17 n.7, p.365-375, July 1974 [doi>10.1145/361011.361061]
	Rose92a	Mendel Rosenblum , John K. Ousterhout, The design and implementation of a log-structured file system, ACM Transactions on Computer Systems (TOCS), v.10 n.1, p.26-52, Feb. 1992 [doi>10.1145/146941.146943]
	Rose92b	Mendel Rosenblum, The design and implementation of a log-structured file system, University of California at Berkeley, Berkeley, CA, 1992
	Ruem91	C. Ruemmler and J. Wilkes. Disk Shuffling, Technical Report HPi~91-156. Hewlett-Packard Laboratories, Pale Alto, CA, Oct. 1991.
	Ruem93	C. Ruemmler and J. Wilkes. A Trace-driven Analysis of Disk Working Set Sizes. Technical Report HPL-OSR-93- 23. Hewlett-Packard Laboratories, Pale Alto, CA, Apr. 4, 1993.
	Sea97a	Seagate Technology, Inc. Hawk 2XL Family 3.5-inch Driives, http://www.seagate.com/disc/hawk/ hawk2xlscsi3.shtml, 1997.
	Sea97b	Seagate Technology, Inc. Cheetah Family 3.5--inch Form Factor. http:/lwww.seagate.com/disc/cheetah/cheetah.shtrot, 1997.
	Selt90	M. Seltzer, P. Chen, and J. Ousterhout. Disk Scheduling Revisted. Proc. 1990 Winter USENIX Conference, pp. 313-324, Jan. 1990.
	Selt92	Margo Ilene Seltzer, File system performance and transaction support, University of California at Berkeley, Berkeley, CA, 1992
	Selt93	Margo I. Seltzer, Transaction Support in a Log-Structured File System, Proceedings of the Ninth International Conference on Data Engineering, p.503-510, April 19-23, 1993
	Selt95a	M. Seltzer, K. Smith, H. Balakrishnan, J. Chang, S. McMains, and V. Padmanabhan. File System Logging Versus Clustering: A Performance Comparison. Proc. 1995 Winter USENIX Conference, pp. 249-264, Jan. 1995.
	Selt95b	M. Seltzer and K. Smith. A Response to Ousterhout's Critique of LFS Measurements. http://www.eecs.harvard.edu/ ~margo/usenix. 195/ouster. html.
	Smit96	K. Smith and M. Seltzer. A Comparison of FFS Disk A1- location Polices. Proc. 1996 USENIX Conference, pp. 15- 26, Jan. 1996.
	Smit97	Keith A. Smith , Margo I. Seltzer, File system aging—increasing the relevance of file system benchmarks, Proceedings of the 1997 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, p.203-213, June 15-18, 1997, Seattle, Washington, United States
	Stae91	C. Staelin and H. Garcia-Molina. Smart Filesystems. Proc. 1991 Winter USENiX Conference, pp. 45-51, Jan. 1991.
	Stae96	C. Staelin. Discussion at UC Berkeley. Personal Communication. Nov. 1996.
	Swee96	A. Sweeney, D. Doucette, W. Hu, C. Anderson, M. Nishimoto, and G. Peck. Scalability in the XF8 File System. Proc. 1996 USENIX Conference, pp. 1-14, Jan. 1996.
	Tran90a	Transaction Processing Performance Council. TPC Benchmark B Standard Specification. Waterside Associates, Fremont, CA, Aug. 1990.
	Tran90b	Transaction Processing Performance Council. TPC Benchmark C Standard Specification. Waterside Associates, Fremont, CA, Jul. 1990.
	Tran95	Transaction Processing Performance Council. TPC Benchmark D Standard Specification. Waterside Associates, Fremont, CA, Apr. 1995.
	Veri95	Veritas Software. The VERITAS File System (VxFS). http ://www. veritas.comlproducts.html, 1995.
	Vong90	S. D. Carson, A system for adaptive disk rearrangement, Software—Practice & Experience, v.20 n.3, p.225-242, March 1990 [doi>10.1002/spe.4380200302]
	Wilk96	John Wilkes , Richard Golding , Carl Staelin , Tim Sullivan, The HP AutoRAID hierarchical storage system, ACM Transactions on Computer Systems (TOCS), v.14 n.1, p.108-136, Feb. 1996 [doi>10.1145/225535.225539]
	Wong83	C. K. Wong, Algorithmic Studies in Mass Storage Systems, W. H. Freeman & Co., New York, NY, 1983
	Wort95	Bruce L. Worthington , Gregory R. Ganger , Yale N. Patt , John Wilkes, On-line extraction of SCSI disk drive parameters, Proceedings of the 1995 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems, p.146-156, May 15-19, 1995, Ottawa, Ontario, Canada

CITED BY 34

	Peter J. Nürnberg , John J. Leggett , Uffe K. Wiil, An agenda for open hypermedia research, Proceedings of the ninth ACM conference on Hypertext and hypermedia : links, objects, time and space---structure in hypermedia systems: links, objects, time and space---structure in hypermedia systems, p.198-206, June 20-24, 1998, Pittsburgh, Pennsylvania, United States
	Randolph Y. Wang , Thomas E. Anderson , David A. Patterson, Virtual log based file systems for a programmable disk, Proceedings of the third symposium on Operating systems design and implementation, p.29-43, February 1999, New Orleans, Louisiana, United States
	Remzi H. Arpaci-Dusseau , Eric Anderson , Noah Treuhaft , David E. Culler , Joseph M. Hellerstein , David Patterson , Kathy Yelick, Cluster I/O with River: making the fast case common, Proceedings of the sixth workshop on I/O in parallel and distributed systems, p.10-22, May 05-05, 1999, Atlanta, Georgia, United States
	John Kubiatowicz , David Bindel , Yan Chen , Steven Czerwinski , Patrick Eaton , Dennis Geels , Ramakrishna Gummadi , Sean Rhea , Hakim Weatherspoon , Chris Wells , Ben Zhao, OceanStore: an architecture for global-scale persistent storage, ACM SIGARCH Computer Architecture News, v.28 n.5, p.190-201, Dec. 2000
	Kjetil Nrvåg, The Vagabond Approach to Logging and Recovery in Transaction-Time Temporal Object Database Systems, IEEE Transactions on Knowledge and Data Engineering, v.16 n.4, p.504-518, April 2004
	Jun Wang , Yiming Hu, A Novel Reordering Write Buffer to Improve Write Performance of Log-Structured File Systems, IEEE Transactions on Computers, v.52 n.12, p.1559-1572, December 2003
	Arun Iyengar , Shudong Jin , Jim Challenger, Techniques for efficiently allocating persistent storage, Journal of Systems and Software, v.68 n.2, p.85-102, 15 November 2003
	Douglas S. Santry , Michael J. Feeley , Norman C. Hutchinson , Alistair C. Veitch , Ross W. Carton , Jacob Ofir, Deciding when to forget in the Elephant file system, ACM SIGOPS Operating Systems Review, v.33 n.5, p.110-123, Dec. 1999
	Jun Wang , Yiming Hu, WOLF--A Novel Reordering Write Buffer to Boost the Performance of Log-Structured File System, Proceedings of the 1st USENIX Conference on File and Storage Technologies, January 28-30, 2002, Monterey, CA
	Jiri Schindler , John Linwood Griffin , Christopher R. Lumb , Gregory R. Ganger, Awarded Best Student Paper! - Track-Aligned Extents: Matching Access Patterns to Disk Drive Characteristics, Proceedings of the 1st USENIX Conference on File and Storage Technologies, January 28-30, 2002, Monterey, CA
	Windsor W. Hsu , Alan Jay Smith , Honesty C. Young, The automatic improvement of locality in storage systems, ACM Transactions on Computer Systems (TOCS), v.23 n.4, p.424-473, November 2005
	Remzi H. Arpaci-Dusseau, Run-time adaptation in river, ACM Transactions on Computer Systems (TOCS), v.21 n.1, p.36-86, February 2003
	Wenguang Wang , Yanping Zhao , Rick Bunt, HyLog: A High Performance Approach to Managing Disk Layout, Proceedings of the 3rd USENIX Conference on File and Storage Technologies, March 31-31, 2004, San Francisco, CA
	Zhihui Zhang , Kanad Ghose, yFS: A Journaling File System Design for Handling Large Data Sets with Reduced Seeking, Proceedings of the 2nd USENIX Conference on File and Storage Technologies, March 31-31, 2003, San Francisco, CA
	Andrea C. Arpaci-Dusseau , Remzi H. Arpaci-Dusseau , Nathan C. Burnett , Timothy E. Denehy , Thomas J. Engle , Haryadi S. Gunawi , James A. Nugent , Florentina I. Popovici, Transforming policies into mechanisms with infokernel, Proceedings of the nineteenth ACM symposium on Operating systems principles, October 19-22, 2003, Bolton Landing, NY, USA
	Margo I. Seltzer , Gregory R. Ganger , M. Kirk McKusick , Keith A. Smith , Craig A. N. Soules , Christopher A. Stein, Journaling versus soft updates: asynchronous meta-data protection in file systems, Proceedings of the Annual Technical Conference on 2000 USENIX Annual Technical Conference, p.6-6, June 18-23, 2000, San Diego, California
	Lakshmi Ganesh , Hakim Weatherspoon , Mahesh Balakrishnan , Ken Birman, Optimizing power consumption in large scale storage systems, Proceedings of the 11th USENIX workshop on Hot topics in operating systems, p.1-6, May 07-09, 2007, San Diego, CA
	Christopher Jermaine , Edward Omiecinski , Wai Gen Yee, The partitioned exponential file for database storage management, The VLDB Journal — The International Journal on Very Large Data Bases, v.16 n.4, p.417-437, October 2007
	Martin Jambor , Tomas Hruby , Jan Taus , Kuba Krchak , Viliam Holub, Implementation of a Linux log-structured file system with a garbage collector, ACM SIGOPS Operating Systems Review, v.41 n.1, January 2007
	Christian Czezatke , M. Anton Ertl, LinLogFS: a log-structured filesystem for Linux, Proceedings of the Annual Technical Conference on 2000 USENIX Annual Technical Conference, p.35-35, June 18-23, 2000, San Diego, California
	Gaurav Mathur , Peter Desnoyers , Deepak Ganesan , Prashant Shenoy, Capsule: an energy-optimized object storage system for memory-constrained sensor devices, Proceedings of the 4th international conference on Embedded networked sensor systems, October 31-November 03, 2006, Boulder, Colorado, USA
	Tom M. Kroeger , Darrell D. E. Long, Design and Implementation of a Predictive File Prefetching Algorithm, Proceedings of the General Track: 2002 USENIX Annual Technical Conference, p.105-118, June 25-30, 2001
	Eran Gal , Sivan Toledo, A transactional flash file system for microcontrollers, Proceedings of the USENIX Annual Technical Conference 2005 on USENIX Annual Technical Conference, p.7-7, April 10-15, 2005, Anaheim, CA
	Zhihui Zhang , Kanad Ghose, hFS: a hybrid file system prototype for improving small file and metadata performance, ACM SIGOPS Operating Systems Review, v.41 n.3, June 2007
	Timothy E. Denehy , Andrea C. Arpaci-Dusseau , Remzi H. Arpaci-Dusseau, Bridging the Information Gap in Storage Protocol Stacks, Proceedings of the General Track: 2002 USENIX Annual Technical Conference, p.177-190, June 10-15, 2002
	Hakim Weatherspoon , Patrick Eaton , Byung-Gon Chun , John Kubiatowicz, Antiquity: exploiting a secure log for wide-area distributed storage, ACM SIGOPS Operating Systems Review, v.41 n.3, June 2007
	Mei-Ling Chiang , Jia-Shin Huang, Improving the performance of log-structured file systems with adaptive block rearrangement, Proceedings of the 2007 ACM symposium on Applied computing, March 11-15, 2007, Seoul, Korea
	Craig A. N. Soules , Garth R. Goodson , John D. Strunk , Gregory R. Ganger, Metadata Efficiency in Versioning File Systems, Proceedings of the 2nd USENIX Conference on File and Storage Technologies, March 31-31, 2003, San Francisco, CA
	Michail D. Flouris , Evangelos P. Markatos, The Network RamDisk: Using remote memory on heterogeneous NOWs, Cluster Computing, v.2 n.4, p.281-293, 1999
	Seungjae Baek , Seongjun Ahn , Jongmoo Choi , Donghee Lee , Sam H. Noh, Uniformity improving page allocation for flash memory file systems, Proceedings of the 7th ACM & IEEE international conference on Embedded software, September 30-October 03, 2007, Salzburg, Austria
	Chi-Hsun Li , Da-Wei Chang, Improving flash storage system performance by using an extra RAM buffer, Proceedings of the 6th WSEAS International Conference on Applied Informatics and Communications, p.175-180, August 18-20, 2006, Elounda, Greece
	Medha Bhadkamkar , Jorge Guerra , Luis Useche , Sam Burnett , Jason Liptak , Raju Rangaswami , Vagelis Hristidis, BORG: block-reORGanization for self-optimizing storage systems, Proccedings of the 7th conference on File and stroage technologies, p.183-196, February 24-27, 2009, San Francisco, California
	Hakim Weatherspoon , Lakshmi Ganesh , Tudor Marian , Mahesh Balakrishnan , Ken Birman, Smoke and mirrors: reflecting files at a geographically remote location without loss of performance, Proccedings of the 7th conference on File and stroage technologies, p.211-224, February 24-27, 2009, San Francisco, California
	Gary H. Sockut , Balakrishna R. Iyer, Online reorganization of databases, ACM Computing Surveys (CSUR), v.41 n.3, p.1-136, July 2009