Believable sampling with Mirostat
◀ Prev | 2025-08-11, access: $ Basic | Next ▶
basics text sampling It's often hard to choose the right sampling parameters for language generation. This paper introduces Mirostat, a technique for adaptively choosing the value of "k" in top-k sampling to give easier and more consistent control over the information density of the output.