datahq / dataflows

DataFlows is a simple, intuitive lightweight framework for building data processing flows in python.
https://dataflows.org
MIT License
194 stars 39 forks source link

format (or temporal_format_property) is not taken into account with result() #128

Closed cschloer closed 4 years ago

cschloer commented 4 years ago

Running a pipeline with a Date field looking like:

          {
            "name": "Date",
            "type": "date",
            "outputFormat": "%Y-%m-%d",
            "format": "default"
          }

returns a string looking like 2018-07-30T00:00:00

The same thing actually happens with

          {
            "name": "Date",
            "type": "date",
            "format": "%Y-%m-%d"
          }

which is weird because it's not even returning a string that looks like a Date (rather a Datetime).

It would be important to add

  1. The format is reflected in the return values of results()
  2. The ability to input a temporal_format_property to the results function.

@roll @akariv

cschloer commented 4 years ago

Ignore this issue - my fault. Issue with celery converting datetime to string on my end.