search

treasure-data / embulk-input-td

Treasure Data Input Plugin for Embulk
8 stars 6 forks source link

Support for timestamp columns #20

Closed guilhermekoehlerr closed 5 years ago

guilhermekoehlerr commented 5 years ago
sakama commented 5 years ago

Sorry taking long time to review. I confirmed your implementation works with below query

in:
  type: td
  apikey: ABCDEFGHIJKLMN
  database: test
  query: |
    SELECT FROM_UNIXTIME(time) AS time, id, account, purchase, comment FROM example_tables limit 10
$ embulk preview /path/to/config.yml
+-------------------------+---------+--------------+-------------------------+----------------------------+
|          time:timestamp | id:long | account:long |         purchase:string |             comment:string |
+-------------------------+---------+--------------+-------------------------+----------------------------+
| 2015-01-27 10:23:49 UTC |       1 |       32,864 | 2015-01-27 00:00:00.000 |                     embulk |
| 2015-01-27 10:01:23 UTC |       2 |       14,824 | 2015-01-27 00:00:00.000 |               embulk jruby |
| 2015-01-27 17:20:02 UTC |       3 |       27,559 | 2015-01-28 00:00:00.000 | Embulk "csv" parser plugin |
| 2015-01-29 02:54:36 UTC |       4 |       11,270 | 2015-01-29 00:00:00.000 |                       NULL |
| 2015-01-27 10:23:49 UTC |       1 |       32,864 | 2015-01-27 00:00:00.000 |                     embulk |
| 2015-01-27 10:01:23 UTC |       2 |       14,824 | 2015-01-27 00:00:00.000 |               embulk jruby |
| 2015-01-27 17:20:02 UTC |       3 |       27,559 | 2015-01-28 00:00:00.000 | Embulk "csv" parser plugin |
| 2015-01-29 02:54:36 UTC |       4 |       11,270 | 2015-01-29 00:00:00.000 |                       NULL |
| 2015-01-27 10:23:49 UTC |       1 |       32,864 | 2015-01-27 00:00:00.000 |                     embulk |
| 2015-01-27 10:01:23 UTC |       2 |       14,824 | 2015-01-27 00:00:00.000 |               embulk jruby |
+-------------------------+---------+--------------+-------------------------+----------------------------+