Module: LLM

Defined in:
lib/llm.rb,
lib/llm/bot.rb,
lib/llm/error.rb,
lib/llm/buffer.rb,
lib/llm/client.rb,
lib/llm/message.rb,
lib/llm/version.rb,
lib/llm/response.rb,
lib/llm/eventhandler.rb,
lib/llm/providers/xai.rb,
lib/llm/providers/gemini.rb,
lib/llm/providers/ollama.rb,
lib/llm/providers/openai.rb,
lib/llm/providers/deepseek.rb,
lib/llm/providers/llamacpp.rb,
lib/llm/providers/anthropic.rb

Defined Under Namespace

Modules: Client, EventStream, Utils Classes: Anthropic, Bot, Buffer, DeepSeek, Error, EventHandler, File, Function, Gemini, LlamaCpp, Message, Mime, Multipart, Object, Ollama, OpenAI, Provider, Response, ResponseError, Schema, Tool, XAI

Constant Summary collapse

UnauthorizedError =

HTTPUnauthorized

Class.new(ResponseError)
RateLimitError =

HTTPTooManyRequests

Class.new(ResponseError)
ServerError =

HTTPServerError

Class.new(ResponseError)
NoImageError =

When no images are found in a response

Class.new(ResponseError)
FormatError =

When an given an input object that is not understood

Class.new(Error)
PromptError =

When given a prompt object that is not understood

Class.new(FormatError)
VERSION = 
"0.16.3"

Class Method Summary collapse

Class Method Details

.anthropic ⇒ Anthropic

Returns a new instance of Anthropic.

Parameters:

  • key (String, nil) —

    The secret key for authentication

  • host (String) —

    The host address of the LLM provider

  • port (Integer) —

    The port number

  • timeout (Integer) —

    The number of seconds to wait for a response

  • ssl (Boolean) —

    Whether to use SSL for the connection

  • persistent (Boolean) —

    Whether to use a persistent connection. Requires the net-http-persistent gem.

Returns:

  • (Anthropic) —

    a new instance of Anthropic



30
31
32
33
 
# File 'lib/llm.rb', line 30

def anthropic(**)
  @mutex.synchronize { require_relative "llm/providers/anthropic" unless defined?(LLM::Anthropic) }
  LLM::Anthropic.new(**)
end

.deepseek ⇒ LLM::DeepSeek

Parameters:

  • key (String, nil) —

    The secret key for authentication

Returns:



62
63
64
65
 
# File 'lib/llm.rb', line 62

def deepseek(**)
  @mutex.synchronize { require_relative "llm/providers/deepseek" unless defined?(LLM::DeepSeek) }
  LLM::DeepSeek.new(**)
end

.File(obj) ⇒ LLM::File

Parameters:

  • obj (String, File, LLM::Response) —

    The path to the file, or an existing file reference

Returns:



82
83
84
85
86
87
88
89
90
91
 
# File 'lib/llm/file.rb', line 82

def LLM.File(obj)
  case obj
  when File
    obj.close unless obj.closed?
    LLM.File(obj.path)
  when LLM::File, LLM::Response then obj
  when String then LLM::File.new(obj)
  else raise TypeError, "don't know how to handle #{obj.class} objects"
  end
end

.function(name, &b) ⇒ LLM::Function

Define or get a function

Examples:

LLM.function(:system) do |fn|
  fn.description "Run system command"
  fn.params do |schema|
    schema.object(command: schema.string.required)
  end
  fn.define do |command:|
    system(command)
  end
end

Parameters:

  • name (Symbol) —

    The name of the function

  • b (Proc) —

    The block to define the function

Returns:



99
100
101
102
103
104
105
 
# File 'lib/llm.rb', line 99

def function(name, &b)
  if block_given?
    functions[name.to_s] = LLM::Function.new(name, &b)
  else
    functions[name.to_s]
  end
end

.functions ⇒ Hash<String,LLM::Function>

Returns all known functions

Returns:



110
111
112
 
# File 'lib/llm.rb', line 110

def functions
  @functions ||= {}
end

.gemini ⇒ Gemini

Returns a new instance of Gemini.

Parameters:

  • key (String, nil) —

    The secret key for authentication

  • host (String) —

    The host address of the LLM provider

  • port (Integer) —

    The port number

  • timeout (Integer) —

    The number of seconds to wait for a response

  • ssl (Boolean) —

    Whether to use SSL for the connection

  • persistent (Boolean) —

    Whether to use a persistent connection. Requires the net-http-persistent gem.

Returns:

  • (Gemini) —

    a new instance of Gemini



38
39
40
41
 
# File 'lib/llm.rb', line 38

def gemini(**)
  @mutex.synchronize { require_relative "llm/providers/gemini" unless defined?(LLM::Gemini) }
  LLM::Gemini.new(**)
end

.llamacpp(key: nil) ⇒ LLM::LlamaCpp

Parameters:

  • key (String, nil) (defaults to: nil) —

    The secret key for authentication

Returns:



54
55
56
57
 
# File 'lib/llm.rb', line 54

def llamacpp(key: nil, **)
  @mutex.synchronize { require_relative "llm/providers/llamacpp" unless defined?(LLM::LlamaCpp) }
  LLM::LlamaCpp.new(key:, **)
end

.ollama(key: nil) ⇒ Ollama

Returns a new instance of Ollama.

Parameters:

  • key (String, nil) (defaults to: nil) —

    The secret key for authentication

Returns:

  • (Ollama) —

    a new instance of Ollama



46
47
48
49
 
# File 'lib/llm.rb', line 46

def ollama(key: nil, **)
  @mutex.synchronize { require_relative "llm/providers/ollama" unless defined?(LLM::Ollama) }
  LLM::Ollama.new(key:, **)
end

.openai ⇒ OpenAI

Returns a new instance of OpenAI.

Parameters:

  • key (String, nil) —

    The secret key for authentication

Returns:

  • (OpenAI) —

    a new instance of OpenAI



70
71
72
73
 
# File 'lib/llm.rb', line 70

def openai(**)
  @mutex.synchronize { require_relative "llm/providers/openai" unless defined?(LLM::OpenAI) }
  LLM::OpenAI.new(**)
end

.xai ⇒ XAI

Returns a new instance of XAI.

Parameters:

  • key (String, nil) —

    The secret key for authentication

  • host (String) —

    A regional host or the default (“api.x.ai”)

Returns:

  • (XAI) —

    a new instance of XAI



79
80
81
82
 
# File 'lib/llm.rb', line 79

def xai(**)
  @mutex.synchronize { require_relative "llm/providers/xai" unless defined?(LLM::XAI) }
  LLM::XAI.new(**)
end