Constrained Decoding from Language Models

Language models produce output based on probablity of tokens in their decoding steps. It is highly likely that sometimes, we want tokens…