Skip to content

pterosaur flying icon DACTYL Generation

PyPI PyPI Downloads arXiv Hugging Face

About

dactyl-generation is a Python library developed to support batch inference text generation from different LLM APIs.

Batch inference enables sending multiple prompts at once, often at a 50% discount compared to standard streaming or live APIs.

Installation

You can install via pip:

pip install dactyl-generation

Supported Providers

We support the following LLM API providers.

  • OpenAI
  • Anthropic
  • Mistral
  • Google (Gemini)
  • AWS Bedrock
  • Fireworks AI
  • Together AI

Icons by Icons8.