Class: ORB::Utils::ORB

Inherits:

Object

• Object
• ORB::Utils::ORB

Defined in:

lib/orb/utils/orb.rb

Class Method Summary

• .tokenize(source) ⇒ Object

  :nodoc:.

Class Method Details

.tokenize(source) ⇒ Object

:nodoc:

# File 'lib/orb/utils/orb.rb', line 6

def self.tokenize(source) # :nodoc:
  tokenizer = ::ORB::Tokenizer2.new(source)
  tokenizer.tokenize
end