Class: LLM::LazyConversation

Inherits:

Object

• Object
• LLM::LazyConversation

Defined in:

lib/llm/lazy_conversation.rb

Overview

LLM::LazyConversation provides a conversation object that allows input prompts to be queued and only sent to the LLM when a response is needed.

Examples:

llm = LLM.openai(key)
bot = llm.chat("Be a helpful weather assistant", :system)
bot.chat("What's the weather like in Rio?")
bot.chat("What's the weather like in Algiers?")
bot.messages.each do |message|
  # A single request is made at this point
end

Instance Attribute Summary

• #messages ⇒ LLM::MessageQueue readonly

Instance Method Summary

• #chat(prompt, role = :user, **params) ⇒ LLM::Conversation
• #initialize(provider) ⇒ LazyConversation constructor

  A new instance of LazyConversation.

Constructor Details

#initialize(provider) ⇒ LazyConversation

Returns a new instance of LazyConversation.

Parameters:

• provider (LLM::Provider) —

  A provider

# File 'lib/llm/lazy_conversation.rb', line 27

def initialize(provider)
  @provider = provider
  @messages = LLM::MessageQueue.new(provider)
end

Instance Attribute Details

#messages ⇒ LLM::MessageQueue (readonly)

Returns:

• (LLM::MessageQueue)

# File 'lib/llm/lazy_conversation.rb', line 22

def messages
  @messages
end

Instance Method Details

#chat(prompt, role = :user, **params) ⇒ LLM::Conversation

Returns:

• (LLM::Conversation)

# File 'lib/llm/lazy_conversation.rb', line 35

def chat(prompt, role = :user, **params)
  tap { @messages << [prompt, role, params] }
end