Added retries in the exec test script

tinybirdco / ci

Collection of configuration files that enable CI flows for Tinybird projects

MIT License

2 stars 3 forks source link

Added retries in the exec test script #73

Closed alexon1234 closed 4 months ago

alexon1234 commented 4 months ago

Description

When running tests with fixtures, the data might not yet be replicated to all the replicas and might case the test to fail. So we need to do some retries

alexon1234 commented 4 months ago

I'm missing a run with retries to see how it looks like, maybe we can make fail some test on purpose to double check?

I've just run it locally

» ./scripts/exec_test.sh                                  [3:34:44]
** Running ./tests/kpis_default.test **
** tb pipe data kpis --date_from 2023-10-11 --date_to 2023-10-12 --format CSV
🚨 ERROR: Test ./tests/kpis_default.test failed, diff:
2,3c2,4
< "2023-10-11",3,3,1,0
< "2023-10-12",1,1,1,0
---
> "2023-10-11",0,0,\N,0
> "2023-10-12",0,0,\N,0
>