search

featureform / featureform

The Virtual Feature Store. Turn your existing data infrastructure into a feature store.
https://www.featureform.com
Mozilla Public License 2.0
1.8k stars 92 forks source link

[Bug]: Link in quickstart (docker) to definition.py gives access denied. #904

Closed tbolind closed 1 year ago

tbolind commented 1 year ago

Expected Behavior

I'm following the Quickstart (docker), and gets to the part:

featureform apply https://featureform-demo-files.s3.amazonaws.com/definitions.py --insecure

which I expect featureform to apply. Instead it ends up failing because I do not have permission to access that file.

Actual Behavior

featureform apply https://featureform-demo-files.s3.amazonaws.com/definitions.py --insecure

gives an access denied message.

Steps To Reproduce

Follow the quickstart guide or just jump straight to the command:

featureform apply https://featureform-demo-files.s3.amazonaws.com/definitions.py --insecure

What mode are you running Featureform in?

Local

What version of Python are you running?

3.10

Featureform Python Package Version

1.9.5

Featureform Helm Chart Version

No response

Kubernetes Version

No response

Relevant log output

featureform apply https://featureform-demo-files.s3.amazonaws.com/definitions.py --insecure
Traceback (most recent call last):
  File "/home/tbo/.local/lib/python3.10/site-packages/featureform/cli.py", line 266, in read_url
    with urllib.request.urlopen(url) as py:
  File "/usr/lib/python3.10/urllib/request.py", line 216, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python3.10/urllib/request.py", line 525, in open
    response = meth(req, response)
  File "/usr/lib/python3.10/urllib/request.py", line 634, in http_response
    response = self.parent.error(
  File "/usr/lib/python3.10/urllib/request.py", line 563, in error
    return self._call_chain(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/tbo/.local/bin/featureform", line 8, in <module>
    sys.exit(cli())
  File "/home/tbo/.local/lib/python3.10/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/home/tbo/.local/lib/python3.10/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/home/tbo/.local/lib/python3.10/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/tbo/.local/lib/python3.10/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/tbo/.local/lib/python3.10/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/home/tbo/.local/lib/python3.10/site-packages/featureform/cli.py", line 213, in apply
    read_url(file)
  File "/home/tbo/.local/lib/python3.10/site-packages/featureform/cli.py", line 269, in read_url
    raise ValueError(f"Could not apply the provided URL: {e}: {url}")
ValueError: Could not apply the provided URL: HTTP Error 403: Forbidden: https://featureform-demo-files.s3.amazonaws.com/definitions.py
sdreyer commented 1 year ago

Hi @tbolind looking into this

sdreyer commented 1 year ago

Hey @tbolind , the permissions was changed when the file was updated last. Give it a try now

tbolind commented 1 year ago

It can access the file now, but it seems like there is some other problem with executing it:

(venv_ff) dev@vmlcubutm01:~/featureform$ featureform apply https://featureform-demo-files.s3.amazonaws.com/definitions.py --insecure
Applying Run: default
Creating user default_user
Creating provider postgres-quickstart
Creating provider redis-quickstart
Creating source average_user_transaction default
Creating source transactions default
Creating entity user
Creating feature avg_transactions default
Creating label fraudulent default
Creating training-set fraud_training default

COMPLETED
 Resource Type              Name (Variant)                                      Status      Error
 Provider                   local-mode ()                                       CREATED
 Provider                   postgres-quickstart ()                              CREATED
 Provider                   redis-quickstart ()                                 CREATED
 Source                     average_user_transaction (default)                  FAILED       the sources were not completed: dependent source variant failed
 Source                     transactions (default)                              FAILED       register primary table from source table in offline store: table exist: table exists check: dial tcp: lookup
                                                                                            host.docker.internal on 192.168.5.88:53: no such host
 Feature                    avg_transactions (default)                          FAILED       source of could not complete job: source registration failed: name: average_user_transaction, variant: default
 Label                      fraudulent (default)                                FAILED       source of could not complete job: source registration failed: name: transactions, variant: default
 TrainingSet                fraud_training (default)                            FAILED       source of feature could not complete job: source registration failed: name: average_user_transaction, variant:
                                                                                            default

I can't post the full log from the server side since it is too long, but I took the last bit:

(venv_ff) dev@vmlcubutm01:~/featureform$ docker run -d -p 5432:5432 featureformcom/postgres
docker run -d -p 6379:6379 redis
docker run -p 7878:7878 -p 80:80 featureformcom/featureform
ba34be88b0286e86f46c70d01cf706ce20fcefea4dbb46287d51d775a24ddde0
6d1cc230ce913cb34307556a5aaa394dd8adfee404e13046f523c7f4726ea936
/usr/lib/python3/dist-packages/supervisor/options.py:474: UserWarning: Supervisord is running as root and it is searching for its configuration file in default locations (including its current working directory); you probably want to specify a "-c" argument specifying an absolute path to a configuration file for improved security.
  self.warnings.warn(
2023-07-03 07:11:38,477 CRIT Supervisor is running as root.  Privileges were not dropped because no user is specified in the config file.  If you intend to run as root, you can set user=root in the config file to avoid this message.
2023-07-03 07:11:38,478 INFO Included extra file "/etc/supervisor/conf.d/supervisord.conf" during parsing
2023-07-03 07:11:38,487 INFO RPC interface 'supervisor' initialized
2023-07-03 07:11:38,488 CRIT Server 'unix_http_server' running without any HTTP authentication checking
2023-07-03 07:11:38,488 INFO supervisord started with pid 1
2023-07-03 07:11:39,495 INFO spawned: 'api' with pid 7
2023-07-03 07:11:39,504 INFO spawned: 'coordinator' with pid 8
2023-07-03 07:11:39,512 INFO spawned: 'dashboard' with pid 9
2023-07-03 07:11:39,527 INFO spawned: 'dashboard_backend' with pid 10
2023-07-03 07:11:39,536 INFO spawned: 'dashboard_node' with pid 11
2023-07-03 07:11:39,544 INFO spawned: 'etcd' with pid 12
2023-07-03 07:11:39,552 INFO spawned: 'metadata' with pid 13
2023-07-03 07:11:39,569 INFO spawned: 'search' with pid 14
2023-07-03 07:11:39,598 INFO spawned: 'serving' with pid 20
starting HTTP server on port :8443time="2023-07-03T07:11:39Z" level=info msg="[core] [Server #7] Server created" system=system
{"level":"info","msg":"Server starting","Address":"[::]:7878"}
time="2023-07-03T07:11:39Z" level=info msg="[core] [Server #7 ListenSocket #8] ListenSocket created" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] [Channel #1 SubChannel #2] Subchannel Connectivity change to CONNECTING" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] [Channel #1 SubChannel #2] Subchannel picks a new address \"localhost:8080\" to connect" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] [Channel #3 SubChannel #4] Subchannel Connectivity change to CONNECTING" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] [Channel #3 SubChannel #4] Subchannel picks a new address \"0.0.0.0:8082\" to connect" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] [Channel #5 SubChannel #6] Subchannel Connectivity change to CONNECTING" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] [Channel #5 SubChannel #6] Subchannel picks a new address \"localhost:8080\" to connect" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] pickfirstBalancer: UpdateSubConnState: 0xc0001251b8, {CONNECTING <nil>}" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] pickfirstBalancer: UpdateSubConnState: 0xc000125188, {CONNECTING <nil>}" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] pickfirstBalancer: UpdateSubConnState: 0xc000125170, {CONNECTING <nil>}" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] Creating new client transport to \"{\\n  \\\"Addr\\\": \\\"0.0.0.0:8082\\\",\\n  \\\"ServerName\\\": \\\"0.0.0.0:8082\\\",\\n  \\\"Attributes\\\": null,\\n  \\\"BalancerAttributes\\\": null,\\n  \\\"Type\\\": 0,\\n  \\\"Metadata\\\": null\\n}\": connection error: desc = \"transport: Error while dialing: dial tcp 0.0.0.0:8082: connect: connection refused\"" system=system
time="2023-07-03T07:11:39Z" level=warning msg="[core] [Channel #3 SubChannel #4] grpc: addrConn.createTransport failed to connect to {\n  \"Addr\": \"0.0.0.0:8082\",\n  \"ServerName\": \"0.0.0.0:8082\",\n  \"Attributes\": null,\n  \"BalancerAttributes\": null,\n  \"Type\": 0,\n  \"Metadata\": null\n}. Err: connection error: desc = \"transport: Error while dialing: dial tcp 0.0.0.0:8082: connect: connection refused\"" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] [Channel #3 SubChannel #4] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp 0.0.0.0:8082: connect: connection refused\"" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] pickfirstBalancer: UpdateSubConnState: 0xc000125188, {TRANSIENT_FAILURE connection error: desc = \"transport: Error while dialing: dial tcp 0.0.0.0:8082: connect: connection refused\"}" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] [Channel #3] Channel Connectivity change to TRANSIENT_FAILURE" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] Creating new client transport to \"{\\n  \\\"Addr\\\": \\\"localhost:8080\\\",\\n  \\\"ServerName\\\": \\\"localhost:8080\\\",\\n  \\\"Attributes\\\": null,\\n  \\\"BalancerAttributes\\\": null,\\n  \\\"Type\\\": 0,\\n  \\\"Metadata\\\": null\\n}\": connection error: desc = \"transport: Error while dialing: dial tcp 127.0.0.1:8080: connect: connection refused\"" system=system
time="2023-07-03T07:11:39Z" level=warning msg="[core] [Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {\n  \"Addr\": \"localhost:8080\",\n  \"ServerName\": \"localhost:8080\",\n  \"Attributes\": null,\n  \"BalancerAttributes\": null,\n  \"Type\": 0,\n  \"Metadata\": null\n}. Err: connection error: desc = \"transport: Error while dialing: dial tcp 127.0.0.1:8080: connect: connection refused\"" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] [Channel #1 SubChannel #2] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp 127.0.0.1:8080: connect: connection refused\"" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] pickfirstBalancer: UpdateSubConnState: 0xc000125170, {TRANSIENT_FAILURE connection error: desc = \"transport: Error while dialing: dial tcp 127.0.0.1:8080: connect: connection refused\"}" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] [Channel #1] Channel Connectivity change to TRANSIENT_FAILURE" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] Creating new client transport to \"{\\n  \\\"Addr\\\": \\\"localhost:8080\\\",\\n  \\\"ServerName\\\": \\\"localhost:8080\\\",\\n  \\\"Attributes\\\": null,\\n  \\\"BalancerAttributes\\\": null,\\n  \\\"Type\\\": 0,\\n  \\\"Metadata\\\": null\\n}\": connection error: desc = \"transport: Error while dialing: dial tcp 127.0.0.1:8080: connect: connection refused\"" system=system
time="2023-07-03T07:11:39Z" level=warning msg="[core] [Channel #5 SubChannel #6] grpc: addrConn.createTransport failed to connect to {\n  \"Addr\": \"localhost:8080\",\n  \"ServerName\": \"localhost:8080\",\n  \"Attributes\": null,\n  \"BalancerAttributes\": null,\n  \"Type\": 0,\n  \"Metadata\": null\n}. Err: connection error: desc = \"transport: Error while dialing: dial tcp 127.0.0.1:8080: connect: connection refused\"" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] [Channel #5 SubChannel #6] Subchannel Connectivity change to TRANSIENT_FAILURE, last error: connection error: desc = \"transport: Error while dialing: dial tcp 127.0.0.1:8080: connect: connection refused\"" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] pickfirstBalancer: UpdateSubConnState: 0xc0001251b8, {TRANSIENT_FAILURE connection error: desc = \"transport: Error while dialing: dial tcp 127.0.0.1:8080: connect: connection refused\"}" system=system
time="2023-07-03T07:11:39Z" level=info msg="[core] [Channel #5] Channel Connectivity change to TRANSIENT_FAILURE" system=system
{"level":"info","msg":"Connecting to search","host":"","port":""}
{"level":"debug","msg":"Creating new metadata serverAddress::8080"}
{"level":"info","msg":"Connecting to typesense at: http://localhost:7700\n"}
could not connect to search. retrying...
could not connect to search. retrying...
{"level":"debug","msg":"Creating new training data server"}
{"level":"info","msg":"Serving metrics","Port":":9090"}
{"level":"info","msg":"Server starting","Port":"0.0.0.0:8082"}
connecting to etcd: localhost:2379
connecting to metadata: localhost:8080
could not connect to search. retrying...
{"level":"warn","ts":"2023-07-03T07:11:40.032Z","logger":"etcd-client","caller":"v3@v3.5.6/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0xc000d0c1c0/localhost:2379","attempt":0,"error":"rpc error: code = FailedPrecondition desc = etcdserver: authentication is not enabled"}
connected to etcd
2023-07-03T07:11:40.035Z        DEBUG   coordinator     main/main.go:56 Connected to ETCD
2023-07-03T07:11:40.035Z        DEBUG   coordinator     main/main.go:62 Connected to Metadata
2023-07-03T07:11:40.035Z        INFO    coordinator     coordinator/coordinator.go:222  Creating new coordinator
2023-07-03T07:11:40.035Z        DEBUG   coordinator     main/main.go:74 Begin Job Watch
2023-07-03T07:11:40.035Z        INFO    coordinator     coordinator/coordinator.go:250  Watching for new jobs
{"level":"warn","ts":"2023-07-03T07:11:40.040Z","logger":"etcd-client","caller":"v3@v3.5.6/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0xc000d0c1c0/localhost:2379","attempt":0,"error":"rpc error: code = FailedPrecondition desc = etcdserver: authentication is not enabled"}

888b     d888          d8b 888 d8b                                            888
8888b   d8888          Y8P 888 Y8P                                            888
88888b.d88888              888                                                888
888Y88888P888  .d88b.  888 888 888 .d8888b   .d88b.   8888b.  888d888 .d8888b 88888b.
888 Y888P 888 d8P  Y8b 888 888 888 88K      d8P  Y8b     "88b 888P"  d88P"    888 "88b
888  Y8P  888 88888888 888 888 888 "Y8888b. 88888888 .d888888 888    888      888  888
888   "   888 Y8b.     888 888 888      X88 Y8b.     888  888 888    Y88b.    888  888
888       888  "Y8888  888 888 888  88888P'  "Y8888  "Y888888 888     "Y8888P 888  888

Config file path:       "none"
Database path:          "./data.ms"
Server listening on:    "http://localhost:7700"
Environment:            "development"
Commit SHA:             "unknown"
Commit date:            "unknown"
Package version:        "1.2.0"

Thank you for using Meilisearch!

We collect anonymized analytics to improve our product and your experience. To learn more, including how to turn off analytics, visit our dedicated documentation page: https://www.meilisearch.com/docs/learn/what_is_meilisearch/telemetry

Anonymous telemetry:    "Enabled"
Instance UID:           "4ee8de5a-e5ce-4986-9b38-cf909f548431"

 No master key was found. The server will accept unidentified requests.

 A master key of at least 16 bytes will be required when switching to a production environment.

We generated a new secure master key for you (you can safely use this token):

>> --master-key 4ElnhGa2GbSmTxZIn00E0bIpgClJydfdq0DqOkXBC_s <<

Restart Meilisearch with the argument above to use this new and secure master key.

Documentation:          https://www.meilisearch.com/docs
Source code:            https://github.com/meilisearch/meilisearch
Discord:                https://discord.meilisearch.com

[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/38 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000171
[2023-07-03T07:12:46Z INFO  index_scheduler] A batch of tasks was successfully completed.
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/38 HTTP/1.1" 200 273 "-" "Meilisearch Go (v0.23.0)" 0.000408
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/38 HTTP/1.1" 200 339 "-" "Meilisearch Go (v0.23.0)" 0.000202
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "PUT /indexes/resources/documents HTTP/1.1" 202 137 "-" "Meilisearch Go (v0.23.0)" 0.002344
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000354
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000212
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000206
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.003132
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000315
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000280
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000216
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000218
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000174
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000530
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.003393
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000227
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000823
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000172
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000186
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000164
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000180
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000344
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000260
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000185
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000465
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000333
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000278
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000140
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000192
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000218
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000157
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000148
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000464
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000365
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000141
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000151
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000125
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000162
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000267
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000119
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000739
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000321
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.005568
[2023-07-03T07:12:46Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 14 }
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000283
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000188
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000282
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000485
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000253
[2023-07-03T07:12:46Z INFO  index_scheduler] A batch of tasks was successfully completed.
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 273 "-" "Meilisearch Go (v0.23.0)" 0.000708
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/39 HTTP/1.1" 200 339 "-" "Meilisearch Go (v0.23.0)" 0.000306
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "PUT /indexes/resources/documents HTTP/1.1" 202 137 "-" "Meilisearch Go (v0.23.0)" 0.003759
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000286
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000208
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000326
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.002371
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000169
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.008920
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000146
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000770
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000718
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000434
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000458
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000213
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000198
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000193
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000333
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000586
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000179
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000267
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000294
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.002264
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000419
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000497
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000323
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000249
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000213
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000197
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000164
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000236
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000130
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000177
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000127
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000184
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000298
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000213
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000155
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000435
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000190
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000365
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000227
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000306
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000133
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000145
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000147
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000143
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000132
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000271
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000158
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000146
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000250
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000200
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000127
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000217
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000114
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000136
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000292
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000167
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000257
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000237
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000366
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000251
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000154
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000256
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000183
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000292
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000194
[2023-07-03T07:12:46Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 14 }
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000407
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000171
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000189
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000245
[2023-07-03T07:12:46Z INFO  index_scheduler] A batch of tasks was successfully completed.
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 273 "-" "Meilisearch Go (v0.23.0)" 0.001371
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/40 HTTP/1.1" 200 338 "-" "Meilisearch Go (v0.23.0)" 0.000243
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "PUT /indexes/resources/documents HTTP/1.1" 202 137 "-" "Meilisearch Go (v0.23.0)" 0.003765
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000173
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000473
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000189
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000236
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000412
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000120
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.001224
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000229
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000652
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000449
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000480
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000251
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000249
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000623
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000279
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000243
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000282
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000284
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000287
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.005440
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000220
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000140
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000167
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000153
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000401
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000173
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000169
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000245
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000173
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000178
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000244
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000136
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000169
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000179
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000174
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000136
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000131
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000154
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000380
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000155
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000147
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000142
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000224
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000308
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000628
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000205
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000441
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000804
[2023-07-03T07:12:46Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 14 }
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000695
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000317
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000294
[2023-07-03T07:12:46Z INFO  index_scheduler] A batch of tasks was successfully completed.
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000603
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/41 HTTP/1.1" 200 339 "-" "Meilisearch Go (v0.23.0)" 0.000892
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "PUT /indexes/resources/documents HTTP/1.1" 202 137 "-" "Meilisearch Go (v0.23.0)" 0.001605
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000139
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000160
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000121
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000166
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000133
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000157
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000394
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000118
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000110
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000507
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000494
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000778
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000492
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.003967
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000859
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.001037
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000189
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000166
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000180
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000160
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000206
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000190
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000220
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000708
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000247
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000613
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000193
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000188
[2023-07-03T07:12:46Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 14 }
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000471
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000202
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000557
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.001272
[2023-07-03T07:12:46Z INFO  index_scheduler] A batch of tasks was successfully completed.
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/42 HTTP/1.1" 200 339 "-" "Meilisearch Go (v0.23.0)" 0.000642
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "PUT /indexes/resources/documents HTTP/1.1" 202 137 "-" "Meilisearch Go (v0.23.0)" 0.002541
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000114
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000295
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000113
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000674
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000207
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000268
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.001359
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000233
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000971
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000188
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000693
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000212
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000175
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000188
[2023-07-03T07:12:46Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 14 }
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000918
[2023-07-03T07:12:46Z INFO  index_scheduler] A batch of tasks was successfully completed.
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 273 "-" "Meilisearch Go (v0.23.0)" 0.000232
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 273 "-" "Meilisearch Go (v0.23.0)" 0.000197
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/43 HTTP/1.1" 200 338 "-" "Meilisearch Go (v0.23.0)" 0.000205
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "PUT /indexes/resources/documents HTTP/1.1" 202 137 "-" "Meilisearch Go (v0.23.0)" 0.004118
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.002080
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000315
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000267
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000319
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000244
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000247
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000243
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000263
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000237
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000214
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000200
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000238
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000566
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000190
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000684
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000499
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000245
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000299
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.001646
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000772
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000189
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000168
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000492
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000251
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000305
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000241
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000358
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000281
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000767
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000245
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000351
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000234
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000273
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000238
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000316
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000233
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000252
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000319
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000425
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.001921
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000416
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000241
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000236
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000224
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000260
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000181
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000233
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000235
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000217
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000397
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000300
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.001000
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000298
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.001031
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000448
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000483
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000592
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000501
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000242
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000143
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000299
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000251
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000140
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000299
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000120
[2023-07-03T07:12:46Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 14 }
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.003996
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000599
[2023-07-03T07:12:46Z INFO  index_scheduler] A batch of tasks was successfully completed.
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 273 "-" "Meilisearch Go (v0.23.0)" 0.000162
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/44 HTTP/1.1" 200 338 "-" "Meilisearch Go (v0.23.0)" 0.000165
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "PUT /indexes/resources/documents HTTP/1.1" 202 136 "-" "Meilisearch Go (v0.23.0)" 0.002253
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000284
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000218
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000676
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000473
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000194
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000222
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000254
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000189
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000186
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000210
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000221
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000206
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000196
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000203
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000292
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000182
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000253
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000207
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000324
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000173
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000320
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000340
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000140
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000140
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000181
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000482
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000185
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000204
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000306
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000700
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000256
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000169
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000490
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000188
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000323
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000277
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000275
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000310
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000795
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.001021
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000239
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000245
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000247
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000750
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000383
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000229
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000661
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000246
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000339
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000499
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000306
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000233
[2023-07-03T07:12:46Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 14 }
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000181
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000227
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000502
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000220
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 302 "-" "Meilisearch Go (v0.23.0)" 0.000183
[2023-07-03T07:12:46Z INFO  index_scheduler] A batch of tasks was successfully completed.
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 272 "-" "Meilisearch Go (v0.23.0)" 0.000356
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 272 "-" "Meilisearch Go (v0.23.0)" 0.000173
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/45 HTTP/1.1" 200 338 "-" "Meilisearch Go (v0.23.0)" 0.000394
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "PUT /indexes/resources/documents HTTP/1.1" 202 137 "-" "Meilisearch Go (v0.23.0)" 0.002476
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000444
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000173
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000248
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000595
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000318
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000270
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000270
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000282
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000593
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000656
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000224
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000559
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000229
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000476
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000577
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000702
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000136
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000383
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000104
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000150
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000135
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000251
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000521
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000487
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000489
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000502
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000172
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000196
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000213
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000240
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000216
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000251
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000253
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000311
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000230
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000270
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000279
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000265
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000752
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000253
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000387
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000205
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000468
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000277
[2023-07-03T07:12:46Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 14 }
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.002121
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000253
[2023-07-03T07:12:46Z INFO  index_scheduler] A batch of tasks was successfully completed.
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 273 "-" "Meilisearch Go (v0.23.0)" 0.000221
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/46 HTTP/1.1" 200 339 "-" "Meilisearch Go (v0.23.0)" 0.000285
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "PUT /indexes/resources/documents HTTP/1.1" 202 137 "-" "Meilisearch Go (v0.23.0)" 0.003366
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000233
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000594
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000239
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.003206
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000221
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000243
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000818
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000183
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000229
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000227
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000777
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000867
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000905
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000570
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000642
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000169
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.006289
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.001710
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000169
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000455
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.001739
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000268
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000488
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000305
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000489
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000123
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.002720
[2023-07-03T07:12:46Z INFO  index_scheduler::batch] document addition done: DocumentAdditionResult { indexed_documents: 1, number_of_documents: 14 }
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.002887
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000522
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000131
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 303 "-" "Meilisearch Go (v0.23.0)" 0.000118
[2023-07-03T07:12:46Z INFO  index_scheduler] A batch of tasks was successfully completed.
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 273 "-" "Meilisearch Go (v0.23.0)" 0.000651
[2023-07-03T07:12:46Z INFO  actix_web::middleware::logger] 127.0.0.1 "GET /tasks/47 HTTP/1.1" 200 339 "-" "Meilisearch Go (v0.23.0)" 0.000314
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__average_user_transaction__default
{"level":"error","msg":"Generic Get receive error","error":"rpc error: code = Canceled desc = context canceled"}
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__transactions__default
{"level":"error","msg":"Generic Get receive error","error":"rpc error: code = Canceled desc = context canceled"}
Lookup Key: FEATURE_VARIANT__avg_transactions__default
{"level":"error","msg":"Generic Get receive error","error":"rpc error: code = Canceled desc = context canceled"}
Lookup Key: LABEL_VARIANT__fraudulent__default
{"level":"error","msg":"Generic Get receive error","error":"rpc error: code = Canceled desc = context canceled"}
Lookup Key: TRAINING_SET_VARIANT__fraud_training__default
{"level":"error","msg":"Generic Get receive error","error":"rpc error: code = Canceled desc = context canceled"}
2023-07-03T07:12:47.040Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__FEATURE_VARIANT__avg_transactions__default
2023-07-03T07:12:47.044Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__FEATURE_VARIANT__avg_transactions__default

2023-07-03T07:12:47.048Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__FEATURE_VARIANT__avg_transactions__default is on attempt 0
2023-07-03T07:12:47.050Z        INFO    coordinator     coordinator/coordinator.go:699  Running feature materialization job on resource: {avg_transactions default FEATURE_VARIANT}
Lookup Key: FEATURE_VARIANT__avg_transactions__default
{"level":"info","msg":"Setting resource status","request":"resource_id:{resource:{name:\"avg_transactions\" variant:\"default\"} resource_type:FEATURE_VARIANT} status:{status:PENDING}"}
Lookup Key: FEATURE_VARIANT__avg_transactions__default
2023-07-03T07:12:47.058Z        INFO    coordinator     coordinator/coordinator.go:721  feature obj     {"name": "avg_transactions", "source": {"Name":"average_user_transaction","Variant":"default"}, "location": {"Columns":{"entity":"user_id","value":"avg_transaction_amt"}}, "location_col": {"Entity":"user_id","Value":"avg_transaction_amt","TS":"","Source":""}}
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__average_user_transaction__default
{"level":"info","msg":"Setting resource status","request":"resource_id:{resource:{name:\"avg_transactions\" variant:\"default\"} resource_type:FEATURE_VARIANT} status:{status:FAILED error_message:\"source of could not complete job: source registration failed: name: average_user_transaction, variant: default\"}"}
Lookup Key: FEATURE_VARIANT__avg_transactions__default
2023-07-03T07:12:47.067Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__FEATURE_VARIANT__avg_transactions__default", "error": "FEATURE_VARIANT job failed: source of could not complete job: source registration failed: name: average_user_transaction, variant: default: <nil>"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273
2023-07-03T07:12:48.041Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__SOURCE_VARIANT__average_user_transaction__default
2023-07-03T07:12:48.047Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__SOURCE_VARIANT__average_user_transaction__default

2023-07-03T07:12:48.047Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__SOURCE_VARIANT__average_user_transaction__default is on attempt 1
2023-07-03T07:12:48.049Z        INFO    coordinator     coordinator/coordinator.go:576  Running register source job on resource: {average_user_transaction default SOURCE_VARIANT}
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__average_user_transaction__default
Lookup Key: PROVIDER__postgres-quickstart__
2023-07-03T07:12:48.053Z        INFO    coordinator     coordinator/coordinator.go:479  Running SQL transformation job on resource: {average_user_transaction default SOURCE_VARIANT}
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__transactions__default
{"level":"info","msg":"Setting resource status","request":"resource_id:{resource:{name:\"average_user_transaction\" variant:\"default\"} resource_type:SOURCE_VARIANT} status:{status:FAILED error_message:\"the sources were not completed: dependent source variant failed\"}"}
Lookup Key: SOURCE_VARIANT__average_user_transaction__default
2023-07-03T07:12:48.060Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__SOURCE_VARIANT__average_user_transaction__default", "error": "SOURCE_VARIANT job failed: the sources were not completed: dependent source variant failed: <nil>"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273
Lookup Key: FEATURE_VARIANT__avg_transactions__default
{"level":"error","msg":"Generic Get receive error","error":"rpc error: code = Canceled desc = context canceled"}
Lookup Key: LABEL_VARIANT__fraudulent__default
{"level":"error","msg":"Generic Get receive error","error":"rpc error: code = Canceled desc = context canceled"}
Lookup Key: TRAINING_SET_VARIANT__fraud_training__default
{"level":"error","msg":"Generic Get receive error","error":"rpc error: code = Canceled desc = context canceled"}
2023-07-03T07:12:49.042Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__LABEL_VARIANT__fraudulent__default
2023-07-03T07:12:49.045Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__LABEL_VARIANT__fraudulent__default

2023-07-03T07:12:49.046Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__LABEL_VARIANT__fraudulent__default is on attempt 0
2023-07-03T07:12:49.049Z        INFO    coordinator     coordinator/coordinator.go:611  Running label register job: {fraudulent default LABEL_VARIANT}
Lookup Key: LABEL_VARIANT__fraudulent__default
{"level":"info","msg":"Setting resource status","request":"resource_id:{resource:{name:\"fraudulent\" variant:\"default\"} resource_type:LABEL_VARIANT} status:{status:PENDING}"}
Lookup Key: LABEL_VARIANT__fraudulent__default
2023-07-03T07:12:49.059Z        INFO    coordinator     coordinator/coordinator.go:632  feature obj     {"name": "fraudulent", "source": {"Name":"transactions","Variant":"default"}, "location": {"Columns":{"entity":"customerid","value":"isfraud"}}, "location_col": {"Entity":"customerid","Value":"isfraud","TS":"","Source":""}}
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__transactions__default
2023-07-03T07:12:49.067Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__LABEL_VARIANT__fraudulent__default", "error": "LABEL_VARIANT job failed: source of could not complete job: source registration failed: name: transactions, variant: default: <nil>"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273
{"level":"info","msg":"Setting resource status","request":"resource_id:{resource:{name:\"fraudulent\" variant:\"default\"} resource_type:LABEL_VARIANT} status:{status:FAILED error_message:\"source of could not complete job: source registration failed: name: transactions, variant: default\"}"}
Lookup Key: LABEL_VARIANT__fraudulent__default
2023-07-03T07:12:50.042Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__TRAINING_SET_VARIANT__fraud_training__default
2023-07-03T07:12:50.045Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__TRAINING_SET_VARIANT__fraud_training__default

2023-07-03T07:12:50.048Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__TRAINING_SET_VARIANT__fraud_training__default is on attempt 0
2023-07-03T07:12:50.049Z        INFO    coordinator     coordinator/coordinator.go:863  Running training set job on resource: namefraud_trainingvariantdefault
Lookup Key: TRAINING_SET_VARIANT__fraud_training__default
{"level":"info","msg":"Setting resource status","request":"resource_id:{resource:{name:\"fraud_training\" variant:\"default\"} resource_type:TRAINING_SET_VARIANT} status:{status:PENDING}"}
Lookup Key: TRAINING_SET_VARIANT__fraud_training__default
Lookup Key: PROVIDER__postgres-quickstart__
Getting Training Set: {fraud_training default TrainingSet}
Checking if Training Set exists: {fraud_training default TrainingSet}
Lookup Key: FEATURE_VARIANT__avg_transactions__default
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__average_user_transaction__default
{"level":"info","msg":"Setting resource status","request":"resource_id:{resource:{name:\"fraud_training\" variant:\"default\"} resource_type:TRAINING_SET_VARIANT} status:{status:FAILED error_message:\"source of feature could not complete job: source registration failed: name: average_user_transaction, variant: default\"}"}
Lookup Key: TRAINING_SET_VARIANT__fraud_training__default
2023-07-03T07:12:50.076Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__TRAINING_SET_VARIANT__fraud_training__default", "error": "TRAINING_SET_VARIANT job failed: source of feature could not complete job: source registration failed: name: average_user_transaction, variant: default: <nil>"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273
Lookup Key: LABEL_VARIANT__fraudulent__default
{"level":"error","msg":"Generic Get receive error","error":"rpc error: code = Canceled desc = context canceled"}
Lookup Key: TRAINING_SET_VARIANT__fraud_training__default
{"level":"error","msg":"Generic Get receive error","error":"rpc error: code = Canceled desc = context canceled"}
time="2023-07-03T07:12:50Z" level=info msg="[transport] transport: closing: EOF" system=system
time="2023-07-03T07:12:50Z" level=info msg="[transport] transport: loopyWriter exiting with error: transport closed by client" system=system
2023-07-03T07:12:51.042Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__SOURCE_VARIANT__transactions__default
2023-07-03T07:12:51.048Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__SOURCE_VARIANT__transactions__default

2023-07-03T07:12:51.050Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__SOURCE_VARIANT__transactions__default is on attempt 1
2023-07-03T07:12:51.052Z        INFO    coordinator     coordinator/coordinator.go:576  Running register source job on resource: {transactions default SOURCE_VARIANT}
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__transactions__default
Lookup Key: PROVIDER__postgres-quickstart__
2023-07-03T07:12:51.058Z        INFO    coordinator     coordinator/coordinator.go:560  Running primary table job on resource: {transactions default SOURCE_VARIANT}
{"level":"info","msg":"Setting resource status","request":"resource_id:{resource:{name:\"transactions\" variant:\"default\"} resource_type:SOURCE_VARIANT} status:{status:FAILED error_message:\"register primary table from source table in offline store: table exist: table exists check: dial tcp: lookup host.docker.internal on 192.168.5.88:53: no such host\"}"}
Lookup Key: SOURCE_VARIANT__transactions__default
2023-07-03T07:12:51.069Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__SOURCE_VARIANT__transactions__default", "error": "SOURCE_VARIANT job failed: register primary table from source table in offline store: table exist: table exists check: dial tcp: lookup host.docker.internal on 192.168.5.88:53: no such host: <nil>"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273
2023-07-03T07:12:52.050Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__FEATURE_VARIANT__avg_transactions__default
2023-07-03T07:12:52.053Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__FEATURE_VARIANT__avg_transactions__default

2023-07-03T07:12:52.056Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__FEATURE_VARIANT__avg_transactions__default is on attempt 1
2023-07-03T07:12:52.057Z        INFO    coordinator     coordinator/coordinator.go:699  Running feature materialization job on resource: {avg_transactions default FEATURE_VARIANT}
Lookup Key: FEATURE_VARIANT__avg_transactions__default
2023-07-03T07:12:52.062Z        INFO    coordinator     coordinator/coordinator.go:241  resource has failed previously. Ignoring....    {"key": "JOB__FEATURE_VARIANT__avg_transactions__default"}
2023-07-03T07:12:53.050Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__SOURCE_VARIANT__average_user_transaction__default
2023-07-03T07:12:53.054Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__SOURCE_VARIANT__average_user_transaction__default

2023-07-03T07:12:53.063Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__SOURCE_VARIANT__average_user_transaction__default is on attempt 2
2023-07-03T07:12:53.065Z        INFO    coordinator     coordinator/coordinator.go:576  Running register source job on resource: {average_user_transaction default SOURCE_VARIANT}
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__average_user_transaction__default
2023-07-03T07:12:53.069Z        INFO    coordinator     coordinator/coordinator.go:479  Running SQL transformation job on resource: {average_user_transaction default SOURCE_VARIANT}
Lookup Key: PROVIDER__postgres-quickstart__
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__transactions__default
{"level":"info","msg":"Setting resource status","request":"resource_id:{resource:{name:\"average_user_transaction\" variant:\"default\"} resource_type:SOURCE_VARIANT} status:{status:FAILED error_message:\"the sources were not completed: dependent source variant failed\"}"}
Lookup Key: SOURCE_VARIANT__average_user_transaction__default
2023-07-03T07:12:53.078Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__SOURCE_VARIANT__average_user_transaction__default", "error": "SOURCE_VARIANT job failed: the sources were not completed: dependent source variant failed: <nil>"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273
2023-07-03T07:12:54.051Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__LABEL_VARIANT__fraudulent__default
2023-07-03T07:12:54.055Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__LABEL_VARIANT__fraudulent__default

2023-07-03T07:12:54.056Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__LABEL_VARIANT__fraudulent__default is on attempt 1
2023-07-03T07:12:54.058Z        INFO    coordinator     coordinator/coordinator.go:611  Running label register job: {fraudulent default LABEL_VARIANT}
Lookup Key: LABEL_VARIANT__fraudulent__default
2023-07-03T07:12:54.062Z        INFO    coordinator     coordinator/coordinator.go:241  resource has failed previously. Ignoring....    {"key": "JOB__LABEL_VARIANT__fraudulent__default"}
2023-07-03T07:12:55.052Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__TRAINING_SET_VARIANT__fraud_training__default
2023-07-03T07:12:55.056Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__TRAINING_SET_VARIANT__fraud_training__default

2023-07-03T07:12:55.059Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__TRAINING_SET_VARIANT__fraud_training__default is on attempt 1
2023-07-03T07:12:55.061Z        INFO    coordinator     coordinator/coordinator.go:863  Running training set job on resource: namefraud_trainingvariantdefault
Lookup Key: TRAINING_SET_VARIANT__fraud_training__default
2023-07-03T07:12:55.067Z        INFO    coordinator     coordinator/coordinator.go:241  resource has failed previously. Ignoring....    {"key": "JOB__TRAINING_SET_VARIANT__fraud_training__default"}
2023-07-03T07:12:56.052Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__SOURCE_VARIANT__transactions__default
2023-07-03T07:12:56.057Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__SOURCE_VARIANT__transactions__default

2023-07-03T07:12:56.058Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__SOURCE_VARIANT__transactions__default is on attempt 2
2023-07-03T07:12:56.059Z        INFO    coordinator     coordinator/coordinator.go:576  Running register source job on resource: {transactions default SOURCE_VARIANT}
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__transactions__default
Lookup Key: PROVIDER__postgres-quickstart__
2023-07-03T07:12:56.064Z        INFO    coordinator     coordinator/coordinator.go:560  Running primary table job on resource: {transactions default SOURCE_VARIANT}
{"level":"info","msg":"Setting resource status","request":"resource_id:{resource:{name:\"transactions\" variant:\"default\"} resource_type:SOURCE_VARIANT} status:{status:FAILED error_message:\"register primary table from source table in offline store: table exist: table exists check: dial tcp: lookup host.docker.internal on 192.168.5.88:53: no such host\"}"}
Lookup Key: SOURCE_VARIANT__transactions__default
2023-07-03T07:12:56.071Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__SOURCE_VARIANT__transactions__default", "error": "SOURCE_VARIANT job failed: register primary table from source table in offline store: table exist: table exists check: dial tcp: lookup host.docker.internal on 192.168.5.88:53: no such host: <nil>"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273
2023-07-03T07:12:57.053Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__FEATURE_VARIANT__avg_transactions__default
2023-07-03T07:12:57.061Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__FEATURE_VARIANT__avg_transactions__default

2023-07-03T07:12:57.063Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__FEATURE_VARIANT__avg_transactions__default is on attempt 2
2023-07-03T07:12:57.066Z        INFO    coordinator     coordinator/coordinator.go:699  Running feature materialization job on resource: {avg_transactions default FEATURE_VARIANT}
Lookup Key: FEATURE_VARIANT__avg_transactions__default
2023-07-03T07:12:57.072Z        INFO    coordinator     coordinator/coordinator.go:241  resource has failed previously. Ignoring....    {"key": "JOB__FEATURE_VARIANT__avg_transactions__default"}
2023-07-03T07:12:58.053Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__SOURCE_VARIANT__average_user_transaction__default
2023-07-03T07:12:58.073Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__SOURCE_VARIANT__average_user_transaction__default

2023-07-03T07:12:58.075Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__SOURCE_VARIANT__average_user_transaction__default is on attempt 3
2023-07-03T07:12:58.077Z        INFO    coordinator     coordinator/coordinator.go:576  Running register source job on resource: {average_user_transaction default SOURCE_VARIANT}
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__average_user_transaction__default
Lookup Key: PROVIDER__postgres-quickstart__
2023-07-03T07:12:58.082Z        INFO    coordinator     coordinator/coordinator.go:479  Running SQL transformation job on resource: {average_user_transaction default SOURCE_VARIANT}
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__transactions__default
{"level":"info","msg":"Setting resource status","request":"resource_id:{resource:{name:\"average_user_transaction\" variant:\"default\"} resource_type:SOURCE_VARIANT} status:{status:FAILED error_message:\"the sources were not completed: dependent source variant failed\"}"}
Lookup Key: SOURCE_VARIANT__average_user_transaction__default
2023-07-03T07:12:58.089Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__SOURCE_VARIANT__average_user_transaction__default", "error": "SOURCE_VARIANT job failed: the sources were not completed: dependent source variant failed: <nil>"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273
2023-07-03T07:12:59.054Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__LABEL_VARIANT__fraudulent__default
2023-07-03T07:12:59.056Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__LABEL_VARIANT__fraudulent__default

2023-07-03T07:12:59.057Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__LABEL_VARIANT__fraudulent__default is on attempt 2
2023-07-03T07:12:59.058Z        INFO    coordinator     coordinator/coordinator.go:611  Running label register job: {fraudulent default LABEL_VARIANT}
Lookup Key: LABEL_VARIANT__fraudulent__default
2023-07-03T07:12:59.061Z        INFO    coordinator     coordinator/coordinator.go:241  resource has failed previously. Ignoring....    {"key": "JOB__LABEL_VARIANT__fraudulent__default"}
2023-07-03T07:13:00.055Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__TRAINING_SET_VARIANT__fraud_training__default
2023-07-03T07:13:00.058Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__TRAINING_SET_VARIANT__fraud_training__default

2023-07-03T07:13:00.059Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__TRAINING_SET_VARIANT__fraud_training__default is on attempt 2
2023-07-03T07:13:00.060Z        INFO    coordinator     coordinator/coordinator.go:863  Running training set job on resource: namefraud_trainingvariantdefault
Lookup Key: TRAINING_SET_VARIANT__fraud_training__default
2023-07-03T07:13:00.063Z        INFO    coordinator     coordinator/coordinator.go:241  resource has failed previously. Ignoring....    {"key": "JOB__TRAINING_SET_VARIANT__fraud_training__default"}
2023-07-03T07:13:01.055Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__SOURCE_VARIANT__transactions__default
2023-07-03T07:13:01.059Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__SOURCE_VARIANT__transactions__default

2023-07-03T07:13:01.060Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__SOURCE_VARIANT__transactions__default is on attempt 3
2023-07-03T07:13:01.062Z        INFO    coordinator     coordinator/coordinator.go:576  Running register source job on resource: {transactions default SOURCE_VARIANT}
{"level":"info","msg":"Getting Source Variant In Metadata"}
Lookup Key: SOURCE_VARIANT__transactions__default
Lookup Key: PROVIDER__postgres-quickstart__
2023-07-03T07:13:01.070Z        INFO    coordinator     coordinator/coordinator.go:560  Running primary table job on resource: {transactions default SOURCE_VARIANT}
{"level":"info","msg":"Setting resource status","request":"resource_id:{resource:{name:\"transactions\" variant:\"default\"} resource_type:SOURCE_VARIANT} status:{status:FAILED error_message:\"register primary table from source table in offline store: table exist: table exists check: dial tcp: lookup host.docker.internal on 192.168.5.88:53: no such host\"}"}
Lookup Key: SOURCE_VARIANT__transactions__default
2023-07-03T07:13:01.079Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__SOURCE_VARIANT__transactions__default", "error": "SOURCE_VARIANT job failed: register primary table from source table in offline store: table exist: table exists check: dial tcp: lookup host.docker.internal on 192.168.5.88:53: no such host: <nil>"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273
2023-07-03T07:13:02.056Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__FEATURE_VARIANT__avg_transactions__default
2023-07-03T07:13:02.059Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__FEATURE_VARIANT__avg_transactions__default

2023-07-03T07:13:02.060Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__FEATURE_VARIANT__avg_transactions__default is on attempt 3
2023-07-03T07:13:02.062Z        INFO    coordinator     coordinator/coordinator.go:699  Running feature materialization job on resource: {avg_transactions default FEATURE_VARIANT}
Lookup Key: FEATURE_VARIANT__avg_transactions__default
2023-07-03T07:13:02.069Z        INFO    coordinator     coordinator/coordinator.go:241  resource has failed previously. Ignoring....    {"key": "JOB__FEATURE_VARIANT__avg_transactions__default"}
2023-07-03T07:13:03.056Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__SOURCE_VARIANT__average_user_transaction__default
2023-07-03T07:13:03.060Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__SOURCE_VARIANT__average_user_transaction__default

2023-07-03T07:13:03.062Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__SOURCE_VARIANT__average_user_transaction__default is on attempt 4
2023-07-03T07:13:03.062Z        INFO    coordinator     coordinator/coordinator.go:1047 Deleting job with key: JOB__SOURCE_VARIANT__average_user_transaction__default
2023-07-03T07:13:03.064Z        INFO    coordinator     coordinator/coordinator.go:1062 Succesfully deleted job with key: JOB__SOURCE_VARIANT__average_user_transaction__default
2023-07-03T07:13:03.066Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__SOURCE_VARIANT__average_user_transaction__default", "error": "job failed after 3 attempts. Cancelling coordinator flow"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273
2023-07-03T07:13:04.057Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__LABEL_VARIANT__fraudulent__default
2023-07-03T07:13:04.059Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__LABEL_VARIANT__fraudulent__default

2023-07-03T07:13:04.060Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__LABEL_VARIANT__fraudulent__default is on attempt 3
2023-07-03T07:13:04.061Z        INFO    coordinator     coordinator/coordinator.go:611  Running label register job: {fraudulent default LABEL_VARIANT}
Lookup Key: LABEL_VARIANT__fraudulent__default
2023-07-03T07:13:04.068Z        INFO    coordinator     coordinator/coordinator.go:241  resource has failed previously. Ignoring....    {"key": "JOB__LABEL_VARIANT__fraudulent__default"}
2023-07-03T07:13:05.058Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__TRAINING_SET_VARIANT__fraud_training__default
2023-07-03T07:13:05.061Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__TRAINING_SET_VARIANT__fraud_training__default

2023-07-03T07:13:05.063Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__TRAINING_SET_VARIANT__fraud_training__default is on attempt 3
2023-07-03T07:13:05.065Z        INFO    coordinator     coordinator/coordinator.go:863  Running training set job on resource: namefraud_trainingvariantdefault
Lookup Key: TRAINING_SET_VARIANT__fraud_training__default
2023-07-03T07:13:05.071Z        INFO    coordinator     coordinator/coordinator.go:241  resource has failed previously. Ignoring....    {"key": "JOB__TRAINING_SET_VARIANT__fraud_training__default"}
2023-07-03T07:13:06.059Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__SOURCE_VARIANT__transactions__default
2023-07-03T07:13:06.063Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__SOURCE_VARIANT__transactions__default

2023-07-03T07:13:06.064Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__SOURCE_VARIANT__transactions__default is on attempt 4
2023-07-03T07:13:06.064Z        INFO    coordinator     coordinator/coordinator.go:1047 Deleting job with key: JOB__SOURCE_VARIANT__transactions__default
2023-07-03T07:13:06.066Z        INFO    coordinator     coordinator/coordinator.go:1062 Succesfully deleted job with key: JOB__SOURCE_VARIANT__transactions__default
2023-07-03T07:13:06.069Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__SOURCE_VARIANT__transactions__default", "error": "job failed after 3 attempts. Cancelling coordinator flow"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273
2023-07-03T07:13:07.060Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__FEATURE_VARIANT__avg_transactions__default
2023-07-03T07:13:07.062Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__FEATURE_VARIANT__avg_transactions__default

2023-07-03T07:13:07.063Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__FEATURE_VARIANT__avg_transactions__default is on attempt 4
2023-07-03T07:13:07.063Z        INFO    coordinator     coordinator/coordinator.go:1047 Deleting job with key: JOB__FEATURE_VARIANT__avg_transactions__default
2023-07-03T07:13:07.064Z        INFO    coordinator     coordinator/coordinator.go:1062 Succesfully deleted job with key: JOB__FEATURE_VARIANT__avg_transactions__default
2023-07-03T07:13:07.066Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__FEATURE_VARIANT__avg_transactions__default", "error": "job failed after 3 attempts. Cancelling coordinator flow"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273
2023-07-03T07:13:09.061Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__LABEL_VARIANT__fraudulent__default
2023-07-03T07:13:09.065Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__LABEL_VARIANT__fraudulent__default

2023-07-03T07:13:09.067Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__LABEL_VARIANT__fraudulent__default is on attempt 4
2023-07-03T07:13:09.067Z        INFO    coordinator     coordinator/coordinator.go:1047 Deleting job with key: JOB__LABEL_VARIANT__fraudulent__default
2023-07-03T07:13:09.068Z        INFO    coordinator     coordinator/coordinator.go:1062 Succesfully deleted job with key: JOB__LABEL_VARIANT__fraudulent__default
2023-07-03T07:13:09.070Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__LABEL_VARIANT__fraudulent__default", "error": "job failed after 3 attempts. Cancelling coordinator flow"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273
2023-07-03T07:13:10.062Z        INFO    coordinator     coordinator/coordinator.go:1088 Executing new job with key JOB__TRAINING_SET_VARIANT__fraud_training__default
2023-07-03T07:13:10.067Z        DEBUG   coordinator     coordinator/coordinator.go:1005 Checking existence of job with key JOB__TRAINING_SET_VARIANT__fraud_training__default

2023-07-03T07:13:10.070Z        DEBUG   coordinator     coordinator/coordinator.go:1107 Job JOB__TRAINING_SET_VARIANT__fraud_training__default is on attempt 4
2023-07-03T07:13:10.070Z        INFO    coordinator     coordinator/coordinator.go:1047 Deleting job with key: JOB__TRAINING_SET_VARIANT__fraud_training__default
2023-07-03T07:13:10.072Z        INFO    coordinator     coordinator/coordinator.go:1062 Succesfully deleted job with key: JOB__TRAINING_SET_VARIANT__fraud_training__default
2023-07-03T07:13:10.075Z        ERROR   coordinator     coordinator/coordinator.go:245  Error executing job     {"job_name": "JOB__TRAINING_SET_VARIANT__fraud_training__default", "error": "job failed after 3 attempts. Cancelling coordinator flow"}
github.com/featureform/coordinator.(*Coordinator).checkError
        /app/coordinator/coordinator.go:245
github.com/featureform/coordinator.(*Coordinator).WatchForNewJobs.func2
        /app/coordinator/coordinator.go:273

Docker shows I have the following running:

(venv_ff) dev@vmlcubutm01:~/featureform$ docker ps
CONTAINER ID   IMAGE                        COMMAND                  CREATED              STATUS                 PORTS                                                                          NAMES
40090266a60c   featureformcom/featureform   "/usr/bin/supervisord"   About a minute ago   Up About a minute      0.0.0.0:80->80/tcp, :::80->80/tcp, 0.0.0.0:7878->7878/tcp, :::7878->7878/tcp   kind_lamarr
6d1cc230ce91   redis                        "docker-entrypoint.s…"   About a minute ago   Up About a minute      0.0.0.0:6379->6379/tcp, :::6379->6379/tcp                                      practical_goldstine
ba34be88b028   featureformcom/postgres      "docker-entrypoint.s…"   About a minute ago   Up About a minute      0.0.0.0:5432->5432/tcp, :::5432->5432/tcp                                      charming_dhawan