research-article

Free access

The tail at scale

Authors:

Jeffrey Dean,

Luiz André BarrosoAuthors Info & Claims

Communications of the ACM, Volume 56, Issue 2

Pages 74 - 80

https://doi.org/10.1145/2408776.2408794

Published: 01 February 2013 Publication History

All formats PDF

Abstract

Software techniques that tolerate latency variability are vital to building responsive large-scale Web services.

References

[1]

Barroso, L.A. and Höelzle, U. The case for energy proportional computing. IEEE Computer 40, 12 (Dec. 2007), 33--37.

Digital Library

Google Scholar

[2]

Barroso, L.A. and Höelzle, U. The Datacenter as a Computer: An Introduction to the Design of Warehouse-scale Machines. Synthesis Series on Computer Architecture, Morgan & Claypool Publishers, May 2009.

Digital Library

Google Scholar

[3]

Card, S.K., Robertson, G.G., and Mackinlay, J.D. The information visualizer: An information workspace. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (New Orleans, Apr. 28--May 2). ACM Press, New York, 1991, 181--188.

Digital Library

Google Scholar

[4]

Chang F., Dean J., Ghemawat, S., Hsieh, W.C., Wallach, D.A., Burrows, M., Chandra, T., Fikes, A., and Gruber, R.E. BigTable: A distributed storage system for structured data. In Proceedings of the Seventh Symposium on Operating Systems Design and Implementation (Seattle, Nov.). USENIX Association, Berkeley CA, 2006, 205--218.

Digital Library

Google Scholar

[5]

Charles, J., Jassi, P., Ananth, N.S., Sadat, A., and Fedorova, A. Evaluation of the Intel Core i7 Turbo Boost feature. In Proceedings of the IEEE International Symposium on Workload Characterization (Austin, TX, Oct. 4--6). IEEE Computer Society Press, 2009, 188--197.

Digital Library

Google Scholar

[6]

DeWitt, D.J., Naughton, J.F., Schneider, D.A., and Seshadri, S. Practical skew handling in parallel joins. In Proceedings of the 18^th International Conference on Very Large Data Bases, Li-Yan Yuan, Ed. (Vancouver, BC, Aug. 24--27). Morgan Kaufmann Publishers, Inc., San Francisco, 1992, 27--40.

Digital Library

Google Scholar

[7]

Google, Inc. Project Glass; http://g.co/projectglass

Google Scholar

[8]

Lamport, L. The part-time parliament. ACM Transactions on Computer Systems 16, 2 (May 1998), 133--169.

Digital Library

Google Scholar

[9]

Lumb, C.R. and Golding, R. D-SPTF: Decentralized request distribution in brick-based storage systems. SIGOPS Operating System Review 38, 5 (Oct. 2004), 37--47.

Digital Library

Google Scholar

[10]

Mitzenmacher, M. The power of two choices in randomized load balancing. IEEE Transactions on Parallel and Distributed Computing 12, 10 (Oct. 2001), 1094--1104.

Digital Library

Google Scholar

[11]

Mudge, T. and Hölzle, U. Challenges and opportunities for extremely energy-efficient processors. IEEE Micro 30, 4 (July 2010), 20--24.

Digital Library

Google Scholar

[12]

Stoica I., Morris, R., Karger, D., Kaashoek, F., and Balakrishnan, H. Chord: A scalable peer-to-peer lookup service for Internet applications. In Proceedings of SIGCOMM (San Diego, Aug. 27--31). ACM Press, New York, 2001, 149--160.

Digital Library

Google Scholar

Cited By

View all

Xu QYang JZhang FPan JChen KShen YZhou ADu X(2025)Tribase: A Vector Data Query Engine for Reliable and Lossless Pruning Compression using Triangle InequalitiesProceedings of the ACM on Management of Data10.1145/37097433:1(1-28)Online publication date: 11-Feb-2025
https://dl.acm.org/doi/10.1145/3709743
Zhou XLeis VHu JYu XStonebraker M(2025)Practical DB-OS Co-Design with Privileged Kernel BypassProceedings of the ACM on Management of Data10.1145/37097143:1(1-27)Online publication date: 11-Feb-2025
https://dl.acm.org/doi/10.1145/3709714
Kalantzis VXi YHoresh LSaad Y(2025)Straggler-Tolerant Stationary Methods for Linear SystemsSIAM Journal on Scientific Computing10.1137/24M1673346(S1-S22)Online publication date: 17-Jan-2025
https://doi.org/10.1137/24M1673346
Show More Cited By

Index Terms

The tail at scale

Recommendations

Scalable cache memory design for large-scale SMT architectures
WMPI '04: Proceedings of the 3rd workshop on Memory performance issues: in conjunction with the 31st international symposium on computer architecture

The cache hierarchy design in existing SMT and superscalar processors is optimized for latency, but not for band-width. The size of the L1 data cache did not scale over the past decade. Instead, larger unified L2 and L3 caches were introduced. This ...
A Hierarchical Directory Scheme for Large-Scale Cache-Coherent Multipmcessors
IPPS '92: Proceedings of the 6th International Parallel Processing Symposium

Cache coherence problem is a major design issue for shared-memory multiprocessors. As the system size scales, traditional bus-based snoopy cache coherence schemes are no longer adequate. Instead, the directory-based scheme is a promising approach to ...
μManycore: A Cloud-Native CPU for Tail at Scale
ISCA '23: Proceedings of the 50th Annual International Symposium on Computer Architecture

Microservices are emerging as a popular cloud-computing paradigm. Microservice environments execute typically-short service requests that interact with one another via remote procedure calls (often across machines), and are subject to stringent tail-...

Comments

Information & Contributors

Information

Published In

Communications of the ACM Volume 56, Issue 2

February 2013

95 pages

ISSN:0001-0782

EISSN:1557-7317

DOI:10.1145/2408776

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 February 2013

Published in CACM Volume 56, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Popular
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1,495
Total Citations
View Citations
127,138
Total Downloads

Downloads (Last 12 months)14,594
Downloads (Last 6 weeks)2,114

Reflects downloads up to 22 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Xu QYang JZhang FPan JChen KShen YZhou ADu X(2025)Tribase: A Vector Data Query Engine for Reliable and Lossless Pruning Compression using Triangle InequalitiesProceedings of the ACM on Management of Data10.1145/37097433:1(1-28)Online publication date: 11-Feb-2025
https://dl.acm.org/doi/10.1145/3709743
Zhou XLeis VHu JYu XStonebraker M(2025)Practical DB-OS Co-Design with Privileged Kernel BypassProceedings of the ACM on Management of Data10.1145/37097143:1(1-27)Online publication date: 11-Feb-2025
https://dl.acm.org/doi/10.1145/3709714
Kalantzis VXi YHoresh LSaad Y(2025)Straggler-Tolerant Stationary Methods for Linear SystemsSIAM Journal on Scientific Computing10.1137/24M1673346(S1-S22)Online publication date: 17-Jan-2025
https://doi.org/10.1137/24M1673346
Yu ZGu JWu ZLiu NGuo J(2025)HTLL: Latency-Aware Scalable Blocking MutexIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2025.352685936:3(471-486)Online publication date: 1-Mar-2025
https://dl.acm.org/doi/10.1109/TPDS.2025.3526859
Liao HLiu TGuo JHuang BYang DDing J(2025)Retrospecting Available CPU Resources: SMT-Aware Scheduling to Prevent SLA Violations in Data CentersIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.349487936:1(67-83)Online publication date: Jan-2025
https://doi.org/10.1109/TPDS.2024.3494879
Zhu HChen LWen DChen XWang W(2025)Balancing Straggler Mitigation and Information Protection for Matrix Multiplication in Heterogeneous Multi-Group NetworksIEEE Transactions on Communications10.1109/TCOMM.2024.345079773:2(1276-1289)Online publication date: Feb-2025
https://doi.org/10.1109/TCOMM.2024.3450797
Jung GJeong YPark KLee DByun HLee SPark S(2025)dStream: An Online-Based Dynamic Operator-Level Query Mapping Scheme on Discrete CPU-GPU ArchitecturesIEEE Access10.1109/ACCESS.2024.351088513(8239-8256)Online publication date: 2025
https://doi.org/10.1109/ACCESS.2024.3510885
Tian X(2025)Enhanced Distributed Computation for Machine Learning: Coded Strategies and Multidisciplinary ImpactITM Web of Conferences10.1051/itmconf/2025730302673(03026)Online publication date: 17-Feb-2025
https://doi.org/10.1051/itmconf/20257303026
Faltelli MBelocchi GQuaglia FBianchi G(2025)COREC: Concurrent non-blocking single-queue receive driver for low latency networkingComputer Networks10.1016/j.comnet.2024.110982258(110982)Online publication date: Feb-2025
https://doi.org/10.1016/j.comnet.2024.110982
Ezzeddine MBaude FHuet FLaaziz F(2025)Latency Aware and Resource-Efficient Bin Pack Autoscaling for Distributed Event Queues: Parameters Impact and SettingSN Computer Science10.1007/s42979-025-03740-96:3Online publication date: 24-Feb-2025
https://doi.org/10.1007/s42979-025-03740-9
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Jan	FEB	Mar
	25
2024	2025	2026

Abstract

References

Cited By

Index Terms

Recommendations

Scalable cache memory design for large-scale SMT architectures

A Hierarchical Directory Scheme for Large-Scale Cache-Coherent Multipmcessors

μManycore: A Cloud-Native CPU for Tail at Scale

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Digital Edition

Magazine Site

Login options

Full Access

Share

Share this Publication link

Share on social media

Affiliations