News

This approach enables efficient inference with large language models (LLMs), achieving up to 20x compression with minimal performance loss. Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, Yuqing Yang and Lili Qiu LongLLMLingua mitigates the 'lost in the middle' issue in LLMs, enhancing long-context information processing.