This repository contains the reproduction code for the H2O (Heavy Hitter Oracle) KV cache compression algorithm, evaluated on the Pythia-2.8B model. This project demonstrates how identifying "Heavy ...
The Sachdev-Ye-Kitaev (SYK) model is a quantum mechanical system that has garnered significant attention in both condensed matter and high-energy physics due to its unique properties and connections ...