Online Processing
Prerequisites
Steps
1. Define the Response Formats
from typing import List
from pydantic import BaseModel, Field
class Topics(BaseModel):
"""A list of topics."""
topics_list: List[str] = Field(description="A list of topics.")
class Poems(BaseModel):
"""A list of poems."""
poems_list: List[str] = Field(description="A list of poems.")2. Create a Muse
3. Create a Poet
Example Output
Online Processing Configuration
1. max_requests_per_minute
max_requests_per_minute2. max_tokens_per_minute
max_tokens_per_minute3. seconds_to_pause_on_rate_limit
seconds_to_pause_on_rate_limitLast updated