Lean Attention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
Renee St. Amant
Principal Research Product Manager
Publications
Publications by Year
-
-
RETROSPECTIVE: Dark Silicon and the End of Multicore Scaling
Hadi Esmaeilzadeh, Emily Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
RETROSPECTIVE: General-Purpose Code Acceleration with Limited-Precision Analog Computation
Renee St. Amant, Amir Yazdanbakhsh, Jongse Park, Hadi Esmaeilzadeh, Arjang Hassibi, Luis Ceze, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
-
General-purpose code acceleration with limited-precision analog computation
Renee St. Amant, A. Yazdanbakhsh, Jongse Park, Bradley Thwaites, Hadi Esmaeilzadeh, A. Hassibi, Luis Ceze, Doug Burger
2014 International Symposium on Computer Architecture | June 2014
IEEE Micro Top Picks from the Computer Architecture Conferences Honorable Mention 2016
-
Power challenges may end the multicore era
H. Esmaeilzadeh, Emily R. Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
Commun. ACM | February 2013, Vol 56(2): pp. 93-102
Communications of the ACM, Special Issue: Research Highlights
-
Dark Silicon and the End of Multicore Scaling
Hadi Esmaeilzadeh, Emily R. Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
IEEE Micro | May 2012, Vol 32(3): pp. 122-134
IEEE Micro Special Issue
-
Dark silicon and the end of multicore scaling
H. Esmaeilzadeh, Emily R. Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
2011 International Symposium on Computer Architecture | June 2011
Selected for IEEE Micro Top Picks and Communications of the ACM Research Highlights
-
Mixed-Signal Approximate Computation: A Neural Predictor Case Study
Renee St. Amant, Daniel A. Jiménez, Doug Burger
IEEE Micro | January 2009, Vol 29: pp. 104-115
IEEE Micro Special Issue
-
Low-power, high-performance analog neural branch prediction
Renee St. Amant, Daniel A. Jiménez, Doug Burger
2008 International Symposium on Microarchitecture | November 2008
Selected for IEEE Micro Top Picks from the Computer Architecture Conferences
Publications by Research Area
-
Lean Attention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
RETROSPECTIVE: Dark Silicon and the End of Multicore Scaling
Hadi Esmaeilzadeh, Emily Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
RETROSPECTIVE: General-Purpose Code Acceleration with Limited-Precision Analog Computation
Renee St. Amant, Amir Yazdanbakhsh, Jongse Park, Hadi Esmaeilzadeh, Arjang Hassibi, Luis Ceze, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
General-purpose code acceleration with limited-precision analog computation
Renee St. Amant, A. Yazdanbakhsh, Jongse Park, Bradley Thwaites, Hadi Esmaeilzadeh, A. Hassibi, Luis Ceze, Doug Burger
2014 International Symposium on Computer Architecture | June 2014
IEEE Micro Top Picks from the Computer Architecture Conferences Honorable Mention 2016
Power challenges may end the multicore era
H. Esmaeilzadeh, Emily R. Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
Commun. ACM | February 2013, Vol 56(2): pp. 93-102
Communications of the ACM, Special Issue: Research Highlights
Dark Silicon and the End of Multicore Scaling
Hadi Esmaeilzadeh, Emily R. Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
IEEE Micro | May 2012, Vol 32(3): pp. 122-134
IEEE Micro Special Issue
Dark silicon and the end of multicore scaling
H. Esmaeilzadeh, Emily R. Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
2011 International Symposium on Computer Architecture | June 2011
Selected for IEEE Micro Top Picks and Communications of the ACM Research Highlights
Mixed-Signal Approximate Computation: A Neural Predictor Case Study
Renee St. Amant, Daniel A. Jiménez, Doug Burger
IEEE Micro | January 2009, Vol 29: pp. 104-115
IEEE Micro Special Issue
Low-power, high-performance analog neural branch prediction
Renee St. Amant, Daniel A. Jiménez, Doug Burger
2008 International Symposium on Microarchitecture | November 2008
Selected for IEEE Micro Top Picks from the Computer Architecture Conferences
-
Lean Attention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
RETROSPECTIVE: General-Purpose Code Acceleration with Limited-Precision Analog Computation
Renee St. Amant, Amir Yazdanbakhsh, Jongse Park, Hadi Esmaeilzadeh, Arjang Hassibi, Luis Ceze, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
General-purpose code acceleration with limited-precision analog computation
Renee St. Amant, A. Yazdanbakhsh, Jongse Park, Bradley Thwaites, Hadi Esmaeilzadeh, A. Hassibi, Luis Ceze, Doug Burger
2014 International Symposium on Computer Architecture | June 2014
IEEE Micro Top Picks from the Computer Architecture Conferences Honorable Mention 2016
Mixed-Signal Approximate Computation: A Neural Predictor Case Study
Renee St. Amant, Daniel A. Jiménez, Doug Burger
IEEE Micro | January 2009, Vol 29: pp. 104-115
IEEE Micro Special Issue
Low-power, high-performance analog neural branch prediction
Renee St. Amant, Daniel A. Jiménez, Doug Burger
2008 International Symposium on Microarchitecture | November 2008
Selected for IEEE Micro Top Picks from the Computer Architecture Conferences
-
Publications by Type
-
Power challenges may end the multicore era
H. Esmaeilzadeh, Emily R. Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
Commun. ACM | February 2013, Vol 56(2): pp. 93-102
Communications of the ACM, Special Issue: Research Highlights
Dark Silicon and the End of Multicore Scaling
Hadi Esmaeilzadeh, Emily R. Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
IEEE Micro | May 2012, Vol 32(3): pp. 122-134
IEEE Micro Special Issue
Mixed-Signal Approximate Computation: A Neural Predictor Case Study
Renee St. Amant, Daniel A. Jiménez, Doug Burger
IEEE Micro | January 2009, Vol 29: pp. 104-115
IEEE Micro Special Issue
-
General-purpose code acceleration with limited-precision analog computation
Renee St. Amant, A. Yazdanbakhsh, Jongse Park, Bradley Thwaites, Hadi Esmaeilzadeh, A. Hassibi, Luis Ceze, Doug Burger
2014 International Symposium on Computer Architecture | June 2014
IEEE Micro Top Picks from the Computer Architecture Conferences Honorable Mention 2016
Dark silicon and the end of multicore scaling
H. Esmaeilzadeh, Emily R. Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
2011 International Symposium on Computer Architecture | June 2011
Selected for IEEE Micro Top Picks and Communications of the ACM Research Highlights
Low-power, high-performance analog neural branch prediction
Renee St. Amant, Daniel A. Jiménez, Doug Burger
2008 International Symposium on Microarchitecture | November 2008
Selected for IEEE Micro Top Picks from the Computer Architecture Conferences
-
RETROSPECTIVE: Dark Silicon and the End of Multicore Scaling
Hadi Esmaeilzadeh, Emily Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
RETROSPECTIVE: General-Purpose Code Acceleration with Limited-Precision Analog Computation
Renee St. Amant, Amir Yazdanbakhsh, Jongse Park, Hadi Esmaeilzadeh, Arjang Hassibi, Luis Ceze, Doug Burger
ISCA@50 25-Year Retrospective: 1996-2020 | Published by ACM SIGARCH and IEEE TCCA | 2023
-