search

transferwise / pipelinewise-target-redshift

Singer.io Target for Amazon Redshift - PipelineWise compatible
https://transferwise.github.io/pipelinewise/
Other
12 stars 65 forks source link

Add log message indicating which stream failed to load #59

Closed Limess closed 4 years ago

Limess commented 4 years ago

We had issues working out which stream failed to load when hitting internal redshift errors

In this case:

psycopg2.InternalError: Value too long for character type
DETAIL:
  -----------------------------------------------
  error:  Value too long for character type
  code:      8001
  context:   Value too long for type character varying(505)
  query:     13569697
  location:  string.cpp:179
  process:   query2_117_13569697 [pid=20964]
  -----------------------------------------------

This should at least help give some context if loading multiple streams at once.