TurboAttention: Efficient Attention Approximation For High Throughputs LLMs
Hao Kang, Srikant Bharadwaj, James Hensman, Tushar Krishna, Victor Ruehle, Saravan Rajmohan
ArXiv | December 2024, Vol abs/2412.08585
Srikant Bharadwaj
Principal Researcher
Publications
Publications by Year
-
LeanAttention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
Predict; Don’t React for Enabling Efficient Fine-Grain DVFS in GPUs
Srikant Bharadwaj, Shomit Das, K. Mazumdar, Bradford M. Beckmann, Stephen Kosonocky
Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems | March 2024
-
Scalable distributed last-level TLBs using low-latency interconnects
Srikant Bharadwaj, Guilherme Cox, Tushar Krishna, Abhishek Bhattacharjee
2018 International Symposium on Microarchitecture | October 2018
Publications by Research Area
-
TurboAttention: Efficient Attention Approximation For High Throughputs LLMs
Hao Kang, Srikant Bharadwaj, James Hensman, Tushar Krishna, Victor Ruehle, Saravan Rajmohan
ArXiv | December 2024, Vol abs/2412.08585
LeanAttention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
-
LeanAttention: Hardware-Aware Scalable Attention Mechanism for the Decode-Phase of Transformers
Rya Sanovar, Srikant Bharadwaj, Renee St. Amant, Victor Ruehle, Saravan Rajmohan
May 2024
Predict; Don’t React for Enabling Efficient Fine-Grain DVFS in GPUs
Srikant Bharadwaj, Shomit Das, K. Mazumdar, Bradford M. Beckmann, Stephen Kosonocky
Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems | March 2024
Scalable distributed last-level TLBs using low-latency interconnects
Srikant Bharadwaj, Guilherme Cox, Tushar Krishna, Abhishek Bhattacharjee
2018 International Symposium on Microarchitecture | October 2018
-
Publications by Type
-
TurboAttention: Efficient Attention Approximation For High Throughputs LLMs
Hao Kang, Srikant Bharadwaj, James Hensman, Tushar Krishna, Victor Ruehle, Saravan Rajmohan
ArXiv | December 2024, Vol abs/2412.08585
-
-
Predict; Don’t React for Enabling Efficient Fine-Grain DVFS in GPUs
Srikant Bharadwaj, Shomit Das, K. Mazumdar, Bradford M. Beckmann, Stephen Kosonocky
Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems | March 2024
Scalable distributed last-level TLBs using low-latency interconnects
Srikant Bharadwaj, Guilherme Cox, Tushar Krishna, Abhishek Bhattacharjee
2018 International Symposium on Microarchitecture | October 2018