Structured Language Model Generation with Outlines
# Introduction Usually, when asking an LLM — abbreviation for "Large Language Model" — for a neat, structured output like JSON objects, for instance, a mix of careful prompt crafting with a "pinch" of luck is required. Otherwise, it might be tricky to get the model to obtain the...
# Introduction Usually, when asking an LLM — abbreviation for "Large Language Model" — for a neat, structured output like JSON objects, for instance, a mix of careful prompt crafting with a "pinch" of luck is required. Otherwise, it might be tricky to get the model to obtain the perfectly structured output you are expecting. Or so it was, until a novel open-source library came onto the scene: outlines.