Skip to main content

PaLM API - Google

Pre-requisites

  • pip install -q google-generativeai

Sample Usage

from litellm import completion
import os

os.environ['PALM_API_KEY'] = ""
response = completion(
model="palm/chat-bison",
messages=[{"role": "user", "content": "write code for saying hi from LiteLLM"}]
)

Sample Usage - Streaming

from litellm import completion
import os

os.environ['PALM_API_KEY'] = ""
response = completion(
model="palm/chat-bison",
messages=[{"role": "user", "content": "write code for saying hi from LiteLLM"}],
stream=True
)

for chunk in response:
print(chunk)

Chat Models

Model NameFunction CallRequired OS Variables
chat-bisoncompletion('palm/chat-bison', messages)os.environ['PALM_API_KEY']