socketry / falcon-rails-example

25 stars 1 forks source link

Issues in ollama example #6

Open nileshtrivedi opened 4 months ago

nileshtrivedi commented 4 months ago
46.56s     info: process_action.action_controller: Incoming request: GET "/ollama/index". [ec=0x6180] [pid=34745] [2024-04-19 15:13:08 +0530]
               | {"controller":"OllamaController","action":"index","format":"html","method":"GET","path":"/ollama/index","status":200,"view_runtime":18.506999999999607,"db_runtime":2.4069999999483116,"source_address":"127.0.0.1","allocations":21341,"duration":33.85400000005029}
47.13s     info: process_action.action_controller: Incoming request: CONNECT "/ollama/live". [ec=0x62e8] [pid=34745] [2024-04-19 15:13:09 +0530]
               | {"controller":"OllamaController","action":"live","format":"*/*","method":"CONNECT","path":"/ollama/live","status":200,"view_runtime":null,"db_runtime":0.0,"source_address":"127.0.0.1","allocations":255,"duration":0.7919999998994172}
54.13s     info: OllamaTag: Streaming #<Protocol::Rack::Body::Streaming:0x000000012f698388> to #<Async::HTTP::Protocol::HTTP2::Request::Stream:0x000000012f65e930>. [oid=0x6310] [ec=0x6324] [pid=34745] [2024-04-19 15:13:16 +0530]
               | update_conversation
               | {"prompt":"who are you?"}
54.15s     warn: Async::Task: connected to #<Addrinfo: 127.0.0.1:11434 TCP (localhost)> [fd=21] [oid=0x6360] [ec=0x6324] [pid=34745] [2024-04-19 15:13:16 +0530]
               | Task may have ended with unhandled exception.
               |   NoMethodError: undefined method `new' for nil
               |   → /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/async-rest-0.13.0/lib/async/rest/wrapper/generic.rb:50 in `wrap_response'
               |     /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/async-rest-0.13.0/lib/async/rest/wrapper/generic.rb:39 in `process_response'
               |     /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/async-rest-0.13.0/lib/async/rest/wrapper/generic.rb:18 in `call'
               |     /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/async-rest-0.13.0/lib/async/rest/representation.rb:36 in `block (2 levels) in singleton class'
               |     /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/async-ollama-0.1.0/lib/async/ollama/client.rb:19 in `generate'
               |     lib/ollama_tag.rb:28 in `block in update_conversation'
               |     /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/async-rest-0.13.0/lib/async/rest/resource.rb:43 in `block in open'
               |     /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/async-2.10.1/lib/kernel/sync.rb:20 in `Sync'
               |     /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/async-rest-0.13.0/lib/async/rest/resource.rb:42 in `open'
               |     lib/ollama_tag.rb:25 in `update_conversation'
               |     lib/ollama_tag.rb:54 in `handle'
               |     /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/live-0.5.1/lib/live/page.rb:68 in `handle'
               |     /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/live-0.5.1/lib/live/page.rb:91 in `process_message'
               |     /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/live-0.5.1/lib/live/page.rb:113 in `run'
               |     app/controllers/ollama_controller.rb:20 in `block in live'

Retrying led to a different error:

7m     warn: Async::Task: Streaming #<Protocol::Rack::Body::Streaming:0x000000012e15d108> to #<Async::HTTP::Protocol::HTTP2::Request::Stream:0x000000012ddb33e0>. [oid=0x65b8] [ec=0x65cc] [pid=34742] [2024-04-19 15:19:57 +0530]
               | Task may have ended with unhandled exception.
               |   NameError: undefined local variable or method `details' for an instance of Live::Page
               |   → /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/live-0.5.1/lib/live/page.rb:70 in `handle'
               |     /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/live-0.5.1/lib/live/page.rb:91 in `process_message'
               |     /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/live-0.5.1/lib/live/page.rb:113 in `run'
               |     app/controllers/game_controller.rb:14 in `block in live'
               |     /Users/mac/.asdf/installs/ruby/3.3.0/lib/ruby/gems/3.3.0/gems/async-websocket-0.25.1/lib/async/websocket/adapters/http.rb:41 in `block in open'

Other examples seem to be working fine.