Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Stream a LiteLLM proxy agent’s response with stream=True.
litellm --model gpt-4o --host 127.0.0.1 --port 4000
from agno.agent import Agent
from agno.models.litellm import LiteLLMOpenAI
agent = Agent(model=LiteLLMOpenAI(id="gpt-4o"), markdown=True)
agent.print_response("Share a 2 sentence horror story", stream=True)
Set up your virtual environment
uv venv --python 3.12
source .venv/bin/activate
uv venv --python 3.12
.venv\Scripts\activate
Set your API key
export LITELLM_API_KEY=xxx
Install dependencies
uv pip install -U 'litellm[proxy]' openai agno
Start the proxy server
litellm --model gpt-4o --host 127.0.0.1 --port 4000
Run Agent
basic.py, then run:python basic.py
Was this page helpful?