search

goccy / bigquery-emulator

BigQuery emulator server implemented in Go
MIT License
840 stars 107 forks source link

StatusInternalServerError: "sql: connection is already closed" #322

Open bmgandre opened 5 months ago

bmgandre commented 5 months ago

What happened?

After some requests the emulator gets into an error state and respond Internal Server Error for every single new request.

The error is thrown when invoking server.metaRepo.FindProject(ctx, projectID) on withProjectMiddleware function. Inside FindProject the error is thrown when invoking conn.BeginTx(ctx, nil).

What did you expect to happen?

A response and not an Internal Server Error.

How can we reproduce it (as minimally and precisely as possible)?

Perform the following steps multiple times:

  1. Create a dataset
  2. Create a table
  3. Populate a table
  4. Query
  5. Delete the dataset

Anything else we need to know?

Environment: Same behaviour when using a Mac M2, Docker on M2 (running AMD64 image), Gitlab Services Arguments: I tried with both db file and in-memory db, same issue. I always specify a project.

Once I get the first request with Internal Server Error, all other request will throw Internal Server Error.

Tested many different versions: 0.1.30, 0.2.14, 0.3.1, 0.4.4, 0.5.0, 0.6.1.

ohaibbq commented 5 months ago

Could you paste your emulator server logs with --log-level=debug enabled? I encountered this same issue when working on Recidiviz/bigquery-emulator#12 but it will take me a moment to recall the underlying error.

ohaibbq commented 5 months ago

I believe this is what was causing closed connections during development: https://github.com/Recidiviz/bigquery-emulator/pull/12/commits/5ba6165fe944fc7969a7a44c7a8e93f3d593b520

A call to a Project method which delegates to the metadataRepo was trying to use its own connection inside of an already open transaction. Its possible that you're running into this same kind of issue somewhere in the main's handler.go.

bmgandre commented 5 months ago

The output is as following when debug messages are enabled:

[bigquery-emulator] REST server listening at 0.0.0.0:9050
[bigquery-emulator] gRPC server listening at 0.0.0.0:9060
2024-06-10T13:36:01.108-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:36:01.711-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101335593-RepositoryTests-oEAtSAYHba  {"query": "prettyPrint=false"}
2024-06-10T13:36:01.863-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101335593-RepositoryTests-oEAtSAYHba/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:02.009-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101335593-RepositoryTests-oEAtSAYHba/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:02.139-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101335593-RepositoryTests-oEAtSAYHba/tables/vw-test/insertAll    {"query": "prettyPrint=false"}
2024-06-10T13:36:02.266-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101335593-RepositoryTests-oEAtSAYHba/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:02.410-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:02.528-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101335593-RepositoryTests-oEAtSAYHba.vw-test` WHERE recordEffectiveTo >= '3000-01-01'", "values": []}
2024-06-10T13:36:02.528-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["test","status4","Product","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-01T00:00:00"],["test2","status5","product2","2024-01-01T00:00:00","3000-01-01T00:00:00","fa72c6e1-c601-48bc-946a-99b2943b636a","user-id","df76a6b9-1fc4-4342-bf21-c216111737fe","2020-01-01T00:00:00"]]}
2024-06-10T13:36:02.552-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_262271b2_2e06_4139_b2f6_508209083087  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:02.783-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101335593-RepositoryTests-oEAtSAYHba/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:02.903-0400    ERROR   server/middleware.go:246        notFound        {"error": "notFound: table test-status is not found"}
2024-06-10T13:36:02.938-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:36:03.064-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336029-RepositoryTests-BNLvmNPbuj  {"query": "prettyPrint=false"}
2024-06-10T13:36:03.190-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336029-RepositoryTests-BNLvmNPbuj/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:03.322-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336029-RepositoryTests-BNLvmNPbuj/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:03.447-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336029-RepositoryTests-BNLvmNPbuj/tables/vw-test/insertAll    {"query": "prettyPrint=false"}
2024-06-10T13:36:03.573-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336029-RepositoryTests-BNLvmNPbuj  {"query": "prettyPrint=false"}
2024-06-10T13:36:03.695-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336029-RepositoryTests-BNLvmNPbuj/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:03.820-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336029-RepositoryTests-BNLvmNPbuj/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:03.945-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336029-RepositoryTests-BNLvmNPbuj/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:04.075-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:04.199-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336029-RepositoryTests-BNLvmNPbuj.vw-test` WHERE recordEffectiveTo >= '3000-01-01'", "values": []}
2024-06-10T13:36:04.200-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["test","status4","Product","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-01T00:00:00"],["test2","status5","product2","2024-01-01T00:00:00","3000-01-01T00:00:00","fa72c6e1-c601-48bc-946a-99b2943b636a","user-id","df76a6b9-1fc4-4342-bf21-c216111737fe","2020-01-01T00:00:00"]]}
2024-06-10T13:36:04.230-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_8561b3f1_2645_417e_8a18_4d1dd92cb1a2  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:04.458-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336029-RepositoryTests-BNLvmNPbuj/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:04.585-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:04.711-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336029-RepositoryTests-BNLvmNPbuj.test-status` WHERE recordEffectiveTo >= '3000-01-01'", "values": []}
2024-06-10T13:36:04.712-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": []}
2024-06-10T13:36:04.715-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_1afd48d6_4c1b_4b28_8755_3cfd1ef7c5b7  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:04.948-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:36:05.077-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336049-RepositoryTests-wlebvvHdbR  {"query": "prettyPrint=false"}
2024-06-10T13:36:05.211-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336049-RepositoryTests-wlebvvHdbR/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:05.350-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336049-RepositoryTests-wlebvvHdbR/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:05.478-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336049-RepositoryTests-wlebvvHdbR  {"query": "prettyPrint=false"}
2024-06-10T13:36:05.605-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336049-RepositoryTests-wlebvvHdbR/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:05.736-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336049-RepositoryTests-wlebvvHdbR/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:05.865-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336049-RepositoryTests-wlebvvHdbR/tables/test-status/insertAll    {"query": "prettyPrint=false"}
2024-06-10T13:36:05.995-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336049-RepositoryTests-wlebvvHdbR/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:06.132-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:06.259-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336049-RepositoryTests-wlebvvHdbR.vw-test` WHERE recordEffectiveTo >= '3000-01-01'", "values": []}
2024-06-10T13:36:06.259-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": []}
2024-06-10T13:36:06.274-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_90629c33_894c_44d5_8ffc_481b6f29c88b  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:06.508-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336049-RepositoryTests-wlebvvHdbR/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:06.635-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:06.762-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336049-RepositoryTests-wlebvvHdbR.test-status` WHERE recordEffectiveTo >= '3000-01-01'", "values": []}
2024-06-10T13:36:06.763-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["test","status4","Product","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-01T00:00:00"],["test2","status5","product2","2024-01-01T00:00:00","3000-01-01T00:00:00","fa72c6e1-c601-48bc-946a-99b2943b636a","user-id","df76a6b9-1fc4-4342-bf21-c216111737fe","2020-01-01T00:00:00"]]}
2024-06-10T13:36:06.771-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_da32dc56_c52c_402c_b202_8ff6c57e63fd  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:07.017-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:36:07.152-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336070-RepositoryTests-KBUvQswvqr  {"query": "prettyPrint=false"}
2024-06-10T13:36:07.301-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336070-RepositoryTests-KBUvQswvqr/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:07.444-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336070-RepositoryTests-KBUvQswvqr/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:07.580-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336070-RepositoryTests-KBUvQswvqr/tables/vw-test/insertAll    {"query": "prettyPrint=false"}
2024-06-10T13:36:07.714-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336070-RepositoryTests-KBUvQswvqr  {"query": "prettyPrint=false"}
2024-06-10T13:36:07.845-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336070-RepositoryTests-KBUvQswvqr/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:07.981-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336070-RepositoryTests-KBUvQswvqr/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:08.112-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336070-RepositoryTests-KBUvQswvqr/tables/test-status/insertAll    {"query": "prettyPrint=false"}
2024-06-10T13:36:08.247-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336070-RepositoryTests-KBUvQswvqr/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:08.392-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:08.524-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336070-RepositoryTests-KBUvQswvqr.vw-test` WHERE recordEffectiveTo >= '3000-01-01'", "values": []}
2024-06-10T13:36:08.525-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["test","status4","Product","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-01T00:00:00"]]}
2024-06-10T13:36:08.537-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_0b18e0d5_9383_4072_8276_b521b569a4f9  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:08.780-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336070-RepositoryTests-KBUvQswvqr/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:08.918-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:09.051-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336070-RepositoryTests-KBUvQswvqr.test-status` WHERE recordEffectiveTo >= '3000-01-01'", "values": []}
2024-06-10T13:36:09.052-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["test2","status5","product2","2024-01-01T00:00:00","3000-01-01T00:00:00","fa72c6e1-c601-48bc-946a-99b2943b636a","user-id","df76a6b9-1fc4-4342-bf21-c216111737fe","2020-01-01T00:00:00"]]}
2024-06-10T13:36:09.059-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_5d193677_783e_4314_a7eb_5987196096b6  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:09.316-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:36:09.467-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336093-RepositoryTests-dJeYwqPJMb  {"query": "prettyPrint=false"}
2024-06-10T13:36:09.634-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336093-RepositoryTests-dJeYwqPJMb/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:09.789-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336093-RepositoryTests-dJeYwqPJMb/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:09.933-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336093-RepositoryTests-dJeYwqPJMb/tables/vw-test/insertAll    {"query": "prettyPrint=false"}
2024-06-10T13:36:10.076-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336093-RepositoryTests-dJeYwqPJMb/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:10.235-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:10.376-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336093-RepositoryTests-dJeYwqPJMb.vw-test` WHERE recordEffectiveTo >= '3000-01-01' AND recordEffectiveFrom BETWEEN '2024-05-01' AND '2024-05-02'", "values": []}
2024-06-10T13:36:10.376-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["test","status4","Product","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-01T00:00:00"]]}
2024-06-10T13:36:10.393-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_3c7f403c_3307_494e_aa53_be6079b4f904  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:10.644-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336093-RepositoryTests-dJeYwqPJMb/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:10.786-0400    ERROR   server/middleware.go:246        notFound        {"error": "notFound: table test-status is not found"}
2024-06-10T13:36:10.802-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:36:10.951-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336107-RepositoryTests-dfFzELeDTt  {"query": "prettyPrint=false"}
2024-06-10T13:36:11.109-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336107-RepositoryTests-dfFzELeDTt/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:11.262-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336107-RepositoryTests-dfFzELeDTt/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:11.412-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336107-RepositoryTests-dfFzELeDTt/tables/vw-test/insertAll    {"query": "prettyPrint=false"}
2024-06-10T13:36:11.560-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336107-RepositoryTests-dfFzELeDTt  {"query": "prettyPrint=false"}
2024-06-10T13:36:11.705-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336107-RepositoryTests-dfFzELeDTt/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:11.852-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336107-RepositoryTests-dfFzELeDTt/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:12.010-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336107-RepositoryTests-dfFzELeDTt/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:12.166-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:12.312-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336107-RepositoryTests-dfFzELeDTt.vw-test` WHERE recordEffectiveTo >= '3000-01-01' AND recordEffectiveFrom BETWEEN '2024-05-01' AND '2024-05-02'", "values": []}
2024-06-10T13:36:12.313-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["test","status4","Product","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-01T00:00:00"]]}
2024-06-10T13:36:12.326-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_131cb77b_c66a_411e_9fcc_5abf9cecbcd0  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:12.580-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336107-RepositoryTests-dfFzELeDTt/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:12.730-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:12.880-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336107-RepositoryTests-dfFzELeDTt.test-status` WHERE recordEffectiveTo >= '3000-01-01' AND recordEffectiveFrom BETWEEN '2024-05-01' AND '2024-05-02'", "values": []}
2024-06-10T13:36:12.881-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": []}
2024-06-10T13:36:12.884-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_919f2973_e5fa_42e3_983e_e20af6f282b2  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:13.155-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:36:13.318-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336131-RepositoryTests-pBIQlUpqPE  {"query": "prettyPrint=false"}
2024-06-10T13:36:13.488-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336131-RepositoryTests-pBIQlUpqPE/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:13.649-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336131-RepositoryTests-pBIQlUpqPE/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:13.805-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336131-RepositoryTests-pBIQlUpqPE  {"query": "prettyPrint=false"}
2024-06-10T13:36:13.964-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336131-RepositoryTests-pBIQlUpqPE/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:14.126-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336131-RepositoryTests-pBIQlUpqPE/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:14.286-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336131-RepositoryTests-pBIQlUpqPE/tables/test-status/insertAll    {"query": "prettyPrint=false"}
2024-06-10T13:36:14.448-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336131-RepositoryTests-pBIQlUpqPE/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:14.625-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:14.783-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336131-RepositoryTests-pBIQlUpqPE.vw-test` WHERE recordEffectiveTo >= '3000-01-01' AND recordEffectiveFrom BETWEEN '2024-05-01' AND '2024-05-02'", "values": []}
2024-06-10T13:36:14.783-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": []}
2024-06-10T13:36:14.796-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_a726e2c4_c3a2_4b0b_b3b3_9bdbe3aa5461  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:15.076-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336131-RepositoryTests-pBIQlUpqPE/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:15.237-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:15.391-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336131-RepositoryTests-pBIQlUpqPE.test-status` WHERE recordEffectiveTo >= '3000-01-01' AND recordEffectiveFrom BETWEEN '2024-05-01' AND '2024-05-02'", "values": []}
2024-06-10T13:36:15.392-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["test","status4","Product","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-01T00:00:00"]]}
2024-06-10T13:36:15.402-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_bf08eb32_421f_4a81_bf08_0f6f8295860d  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:15.683-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:36:15.848-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336156-RepositoryTests-ICXLacUeNx  {"query": "prettyPrint=false"}
2024-06-10T13:36:16.032-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336156-RepositoryTests-ICXLacUeNx/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:16.207-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336156-RepositoryTests-ICXLacUeNx/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:16.375-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336156-RepositoryTests-ICXLacUeNx/tables/vw-test/insertAll    {"query": "prettyPrint=false"}
2024-06-10T13:36:16.545-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336156-RepositoryTests-ICXLacUeNx  {"query": "prettyPrint=false"}
2024-06-10T13:36:16.711-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336156-RepositoryTests-ICXLacUeNx/tables  {"query": "prettyPrint=false"}
2024-06-10T13:36:16.879-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336156-RepositoryTests-ICXLacUeNx/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:17.045-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336156-RepositoryTests-ICXLacUeNx/tables/test-status/insertAll    {"query": "prettyPrint=false"}
2024-06-10T13:36:17.207-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336156-RepositoryTests-ICXLacUeNx/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:17.382-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:17.542-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336156-RepositoryTests-ICXLacUeNx.vw-test` WHERE recordEffectiveTo >= '3000-01-01' AND recordEffectiveFrom BETWEEN '2024-05-01' AND '2024-05-02'", "values": []}
2024-06-10T13:36:17.543-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["test","status4","Product","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-01T00:00:00"]]}
2024-06-10T13:36:17.557-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_a3269d19_7e99_426c_8bac_947a44ddd71f  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:17.835-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336156-RepositoryTests-ICXLacUeNx/tables/test-status       {"query": "prettyPrint=false"}
2024-06-10T13:36:18.003-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:18.170-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336156-RepositoryTests-ICXLacUeNx.test-status` WHERE recordEffectiveTo >= '3000-01-01' AND recordEffectiveFrom BETWEEN '2024-05-01' AND '2024-05-02'", "values": []}
2024-06-10T13:36:18.171-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": []}
2024-06-10T13:36:18.173-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_19e7a083_96a6_4d8a_8c22_4ffd34a2db5d  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:36:54.956-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:36:55.196-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:36:55.401-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:36:55.601-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336545-AccountPartialExtractor-AewWDlmBSf      {"query": "prettyPrint=false"}
2024-06-10T13:36:55.792-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336545-AccountFullExtractor-LXvczxeaqQ {"query": "prettyPrint=false"}
2024-06-10T13:36:55.970-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336545-JobsCompleteFlow-WlERhKGCLS     {"query": "prettyPrint=false"}
2024-06-10T13:36:56.162-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336545-AccountPartialExtractor-AewWDlmBSf/tables      {"query": "prettyPrint=false"}
2024-06-10T13:36:56.387-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336545-AccountFullExtractor-LXvczxeaqQ/tables {"query": "prettyPrint=false"}
2024-06-10T13:36:56.667-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336545-DependencyInjection-DmsPoVUAjT/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:56.873-0400    ERROR   server/middleware.go:200        notFound        {"error": "notFound: dataset T202406101336545-DependencyInjection-DmsPoVUAjT is not found"}
2024-06-10T13:36:56.873-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336545-JobsCompleteFlow-WlERhKGCLS/tables     {"query": "prettyPrint=false"}
2024-06-10T13:36:57.116-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336545-AccountPartialExtractor-AewWDlmBSf/tables/vw-test   {"query": "prettyPrint=false"}
2024-06-10T13:36:57.326-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336545-AccountFullExtractor-LXvczxeaqQ/tables/vw-test      {"query": "prettyPrint=false"}
2024-06-10T13:36:57.564-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336545-JobsCompleteFlow-WlERhKGCLS/tables/vw-test  {"query": "prettyPrint=false"}
2024-06-10T13:36:57.792-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336545-AccountPartialExtractor-AewWDlmBSf/tables/vw-test/insertAll        {"query": "prettyPrint=false"}
2024-06-10T13:36:58.001-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336545-AccountFullExtractor-LXvczxeaqQ/tables/vw-test/insertAll   {"query": "prettyPrint=false"}
2024-06-10T13:36:58.214-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets/T202406101336545-JobsCompleteFlow-WlERhKGCLS/tables/vw-test/insertAll       {"query": "prettyPrint=false"}
2024-06-10T13:36:58.429-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336576-DependencyInjection-aCpnwRxGqJ/tables/vw-test       {"query": "prettyPrint=false"}
2024-06-10T13:36:58.721-0400    ERROR   server/middleware.go:200        notFound        {"error": "notFound: dataset T202406101336576-DependencyInjection-aCpnwRxGqJ is not found"}
2024-06-10T13:36:58.721-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336545-AccountPartialExtractor-AewWDlmBSf/tables/vw-test   {"query": "prettyPrint=false"}
2024-06-10T13:36:58.922-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336545-AccountPartialExtractor-AewWDlmBSf/tables/vw-test   {"query": "prettyPrint=false"}
2024-06-10T13:36:59.099-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336545-AccountFullExtractor-LXvczxeaqQ/tables/vw-test      {"query": "prettyPrint=false"}
2024-06-10T13:36:59.272-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336545-AccountFullExtractor-LXvczxeaqQ/tables/vw-test      {"query": "prettyPrint=false"}
2024-06-10T13:36:59.495-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:36:59.677-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336545-AccountPartialExtractor-AewWDlmBSf.vw-test` WHERE recordEffectiveTo >= '3000-01-01' AND recordEffectiveFrom BETWEEN '2024-06-10' AND '2024-06-11'", "values": []}
2024-06-10T13:36:59.678-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["test2","status1","product2","2024-06-10T17:36:54.525387","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-03T00:00:00"]]}
2024-06-10T13:36:59.685-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/datasets/T202406101336545-JobsCompleteFlow-WlERhKGCLS/tables/vw-test  {"query": "prettyPrint=false"}
2024-06-10T13:36:59.872-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:37:00.060-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336545-AccountPartialExtractor-AewWDlmBSf.vw-test` WHERE recordEffectiveTo >= '3000-01-01' AND recordEffectiveFrom BETWEEN '2024-06-10' AND '2024-06-11'", "values": []}
2024-06-10T13:37:00.061-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["test2","status1","product2","2024-06-10T17:36:54.525387","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-03T00:00:00"]]}
2024-06-10T13:37:00.067-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:37:00.252-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336545-AccountFullExtractor-LXvczxeaqQ.vw-test` WHERE recordEffectiveTo >= '3000-01-01'", "values": []}
2024-06-10T13:37:00.252-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["insurance","status2","product3","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2024-01-01T00:00:00"],["test","approved","brokerage","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-02T00:00:00"],["test2","status1","product2","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-03T00:00:00"]]}
2024-06-10T13:37:00.260-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:37:00.469-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336545-AccountFullExtractor-LXvczxeaqQ.vw-test` WHERE recordEffectiveTo >= '3000-01-01'", "values": []}
2024-06-10T13:37:00.470-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["insurance","status2","product3","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2024-01-01T00:00:00"],["test","approved","brokerage","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-02T00:00:00"],["test2","status1","product2","2024-05-01T00:00:00","3000-01-01T00:00:00","aba7fcae-664b-4b9d-a937-fa5d9a106c89","user-id","cb44b7b8-78b4-4d72-a62a-08a26df906ce","2020-01-03T00:00:00"]]}
2024-06-10T13:37:00.476-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_37aef06d_e53e_45ee_a20e_b48ca50b07b1  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:37:00.783-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/jobs     {"query": "prettyPrint=false"}
2024-06-10T13:37:00.972-0400    INFO    contentdata/repository.go:166           {"query": "SELECT * FROM `sample_project_emulator.T202406101336545-JobsCompleteFlow-WlERhKGCLS.vw-test` WHERE recordEffectiveTo >= '3000-01-01'", "values": []}
2024-06-10T13:37:00.973-0400    DEBUG   contentdata/repository.go:245   query result    {"rows": [["test","status3","test","2024-01-01T00:00:00","3000-01-01T00:00:00","4a2bccdb-e27a-4c7b-b9af-3803485a3fcb","user-id","6bb78d96-94f5-409d-ae36-70c478ee7591","2010-01-01T00:00:00"],["test2","discharged","test","2024-01-01T00:00:00","3000-01-01T00:00:00","4a2bccdb-e27a-4c7b-b9af-3803485a3fcb","user-id","6bb78d96-94f5-409d-ae36-70c478ee7591","2010-01-01T00:00:00"],["banking","closed_written_off","test","2024-01-01T00:00:00","3000-01-01T00:00:00","4a2bccdb-e27a-4c7b-b9af-3803485a3fcb","user-id","6bb78d96-94f5-409d-ae36-70c478ee7591","2010-01-01T00:00:00"]]}
2024-06-10T13:37:00.978-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_546686a4_bafb_4abc_b026_b69318ce754a  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:37:00.978-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_5412f846_23de_49c7_8736_49d8f8d6a734  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:37:01.268-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_feb0a5a3_3dd6_4905_aa56_8834152edbe6  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:37:01.301-0400    INFO    server/middleware.go:63 DELETE /projects/sample_project_emulator/datasets/T202406101336545-AccountPartialExtractor-AewWDlmBSf   {"query": "prettyPrint=false"}
2024-06-10T13:37:01.301-0400    INFO    server/middleware.go:63 GET /projects/sample_project_emulator/queries/job_fd05a74d_c198_4c4b_84c9_af5a2efc6e17  {"query": "formatOptions.useInt64Timestamp=true&timeoutMs=60000&prettyPrint=false"}
2024-06-10T13:37:01.339-0400    INFO    server/middleware.go:63 DELETE /projects/sample_project_emulator/datasets/T202406101336545-AccountFullExtractor-LXvczxeaqQ      {"query": "prettyPrint=false"}
2024-06-10T13:38:10.881-0400    INFO    server/middleware.go:63 DELETE /projects/sample_project_emulator/datasets/T202406101336545-JobsCompleteFlow-WlERhKGCLS  {"query": "prettyPrint=false"}
2024-06-10T13:38:10.885-0400    INFO    server/middleware.go:63 DELETE /projects/sample_project_emulator/datasets/T202406101336545-JobsCompleteFlow-WlERhKGCLS  {"query": "prettyPrint=false"}
2024-06-10T13:38:10.887-0400    INFO    server/middleware.go:63 DELETE /projects/sample_project_emulator/datasets/T202406101336545-JobsCompleteFlow-WlERhKGCLS  {"query": "prettyPrint=false"}
2024-06-10T13:38:10.888-0400    INFO    server/middleware.go:63 DELETE /projects/sample_project_emulator/datasets/T202406101336545-JobsCompleteFlow-WlERhKGCLS  {"query": "prettyPrint=false"}
2024-06-10T13:38:10.888-0400    INFO    server/middleware.go:63 DELETE /projects/sample_project_emulator/datasets/T202406101336545-JobsCompleteFlow-WlERhKGCLS  {"query": "prettyPrint=false"}
2024-06-10T13:38:13.803-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:38:14.755-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:38:15.383-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:38:19.247-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:38:19.859-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:38:36.200-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:38:55.752-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:38:55.796-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:38:56.705-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:38:57.547-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}
2024-06-10T13:39:00.048-0400    INFO    server/middleware.go:63 POST /projects/sample_project_emulator/datasets {"query": "prettyPrint=false"}

Like I mentioned before, my tests run with these steps:

  1. Create a dataset
  2. Create a table
  3. Populate a table
  4. Query
  5. Delete the dataset

So, I see a lot of notFound, but I included a retry policy and my tests can deal with this. There are multiple errors about the same table name because my test suit run in parallel, so I dynamically set a dataset name but keep the table name the same for all tests.

Notice that the internal server error message itself is not printed, and the string written to the body sql: connection is already closed is not a valid Json, so the BigQuery client library thrown an because it cannot parse the message. This is the stack trace for the .Net client library:

Google.GoogleApiException : The service bigquery has thrown an exception. HttpStatusCode is InternalServerError. No error message was specified.
---- Newtonsoft.Json.JsonReaderException : Unexpected character encountered while parsing value: s. Path '', line 0, position 0.
Stack Trace:
   at Google.Apis.Responses.HttpResponseMessageExtensions.DeserializeErrorAsync(HttpResponseMessage response, String name, ISerializer serializer)
   at Google.Apis.Requests.ClientServiceRequest`1.ParseResponse(HttpResponseMessage response)
   at Google.Apis.Requests.ClientServiceRequest`1.ExecuteAsync(CancellationToken cancellationToken)
   at Google.Cloud.BigQuery.V2.BigQueryClientImpl.GetQueryResultsAsync(JobReference jobReference, TableReference tableReference, GetQueryResultsOptions options, CancellationToken cancellationToken)
   at Google.Cloud.BigQuery.V2.BigQueryClient.ExecuteQueryAsync(String sql, IEnumerable`1 parameters, QueryOptions queryOptions, GetQueryResultsOptions resultsOptions, CancellationToken cancellationToken)   
   [...] 
--- End of stack trace from previous location ---
----- Inner Stack Trace -----
   at Newtonsoft.Json.JsonTextReader.ParseValue()
   at Newtonsoft.Json.JsonReader.ReadForType(JsonContract contract, Boolean hasConverter)
   at Newtonsoft.Json.Serialization.JsonSerializerInternalReader.Deserialize(JsonReader reader, Type objectType, Boolean checkAdditionalContent)
   at Newtonsoft.Json.JsonSerializer.DeserializeInternal(JsonReader reader, Type objectType)
   at Newtonsoft.Json.JsonSerializer.Deserialize(JsonReader reader, Type objectType)
   at Google.Apis.Json.NewtonsoftJsonSerializer.Deserialize(String input, Type type)
   at Google.Apis.Json.NewtonsoftJsonSerializer.Deserialize[T](String input)
   at Google.Apis.Responses.HttpResponseMessageExtensions.DeserializeErrorAsync(HttpResponseMessage response, String name, ISerializer serializer)