search

grailbio / reflow

A language and runtime for distributed, incremental data processing in the cloud
Apache License 2.0
965 stars 52 forks source link

Error: no taskdb: no providers for type taskdb.TaskDB #144

Closed alperyilmaz closed 1 year ago

alperyilmaz commented 1 year ago

Hi, I tried the newly release version 1.26.0 (go1.18.4). I ran setup-ec2, setup-s3-repository and setup-dynamodb-assoc successfully, after which I can see the config file contains the related entries. But when I run reflow run hello.rf, I get the following error:

/home/ubuntu/grail/go/src/github.com/grailbio/reflow/tool/run.go:105: runtime.Init predictor_config: fatal:
    predictor config: no taskdb: no providers for type taskdb.TaskDB (/home/ubuntu/grail/go/src/github.com/grailbio/reflow/runtime/util.go:88)

hello.rf was taken from Github mainpage. How can I fix this? Is there a problem with my setup or AWS account? In the main page it mentions TaskDB is optional. Can I use reflow without setting up TaskDB?

My config file is at pastebin: https://pastebin.com/raw/VwZqsF4X

fialhopm commented 1 year ago

Thanks for flagging this. You are right: TaskDB should not be required. This seems to be an unintended side effect of a change introduced in 1.19.0, and we will fix it in the next release.

In the meantime, can you try using 1.18.0? Alternatively, if you choose to use 1.26.0 and set up TaskDB, you'll also need to add predictor: predictorconfig to your config file.

fialhopm commented 1 year ago

@alperyilmaz the latest release (1.27.0) includes a fix for this. Let us know if you continue to see issues when running programs without TaskDB