OpenAI API support

✋ Only tested with the gpt-4o-mini model

Ollama provides experimental compatibility with parts of the OpenAI API. As it's experimental, I prefer to keep the completion methods of Ollama and OpenAI "separated".

Chat completion

openAIUrl := "https://api.openai.com/v1"
model := "gpt-4o-mini"

systemContent := `You are an expert in Star Trek.`
userContent := `Who is Jean-Luc Picard?`

query := llm.OpenAIQuery{
    Model: model,
    Messages: []llm.Message{
        {Role: "system", Content: systemContent},
        {Role: "user", Content: userContent},
    },
    //Verbose: true,
    OpenAIAPIKey: os.Getenv("OPENAI_API_KEY"),
}

answer, err := completion.ChatWithOpenAI(openAIUrl, query)
if err != nil {
    log.Fatal("😡:", err)
}
fmt.Println(answer.Choices[0].Message.Content)

Chat completion with stream

openAIUrl := "https://api.openai.com/v1"
model := "gpt-4o-mini"

systemContent := `You are an expert in Star Trek.`
userContent := `Who is Jean-Luc Picard?`

query := llm.OpenAIQuery{
    Model: model,
    Messages: []llm.Message{
        {Role: "system", Content: systemContent},
        {Role: "user", Content: userContent},
    },
    //Verbose: true,
    OpenAIAPIKey: os.Getenv("OPENAI_API_KEY"),
}

textResult, err = completion.ChatWithOpenAIStream(openAIUrl, query,
    func(answer llm.OpenAIAnswer) error {
        fmt.Print(answer.Choices[0].Delta.Content)
        return nil
    })

if err != nil {
    log.Fatal("😡:", err)
}

Chat completion with tools

🚧 in progress

Create embeddings

// Create an embedding from the question
embeddingFromQuestion, err := embeddings.CreateEmbeddingWithOpenAI(
    openAIUrl,
    llm.OpenAIQuery4Embedding{
        Model:        embeddingsModel,
        Input:       userContent,
        OpenAIAPIKey: os.Getenv("OPENAI_API_KEY"),
    },
    "unique-id",
)

Note

You can find an example in examples/49-embeddings-memory-openai