Introducing Min-p Sampling: A Smarter Way to Sample from LLMs

TL;DR: Min-p sampling is a novel decoding strategy for Large Language Models (LLMs) that dynamically adjusts token selection based on model confidence. This method outperforms traditional top-p sampling, delivering more coherent and creative...