SWS-Methodology / faoswsTrade

World trade data processing for the FAO Statistical Working System
http://www.fao.org/economic/ess/ess-home/en/
5 stars 2 forks source link

Differencies in column formats of Tariffline data across years #139

Closed malexan closed 7 years ago

malexan commented 7 years ago

Locally I have TL data for 3 years from 2013 to 2015. 2013 data set is old one (from my autumn visit) and flow column has integer format. 2014 and 2015 data sets were updated during my recent visit, they contain flow as character.

> sapply(list(tldata13, tldata14, tldata15), function(x) class(x$flow))
[1] "integer"   "character" "character"

Current version of time series report functions do not expect this and I can not complete them.

Do we accept the SWS keeps different column types across years and we have to adapt the functions to deal with the situation? Either it was an error during extraction of the data sets from SWS?

In the latter case should flow column be character or integer? I suspect it should be character.

chrMongeau commented 7 years ago

Do we accept the SWS keeps different column types across years

No, the tyear variable is always a character:

> plyr::mlply(
+   2000:2015,
+   .fun = function(year) {
+     str(faosws::ReadDatatable(
+       paste0("ct_tariffline_unlogged_", year),
+       columns = c(
+         "tyear",
+         "rep",
+         "prt",
+         "flow",
+         "comm",
+         "tvalue",
+         "weight",
+         "qty",
+         "qunit",
+         "chapter"
+       ),
+       limit = 10L
+     ))
+   }
+ )
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2000" "2000" "2000" "2000" ...
 $ rep    : chr  "50" "50" "50" "50" ...
 $ prt    : chr  "48" "36" "250" "40" ...
 $ flow   : chr  "1" "2" "2" "2" ...
 $ comm   : chr  "5407410" "6108210" "6117101" "6209301" ...
 $ tvalue : num  34033 5070 1830 11367 32250 ...
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : int  17536 1825 NA 300 NA NA 720 867 205 NA
 $ qunit  : chr  "4" "11" "1" "11" ...
 $ chapter: chr  "54" "61" "61" "62" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2001" "2001" "2001" "2001" ...
 $ rep    : chr  "50" "50" "50" "50" ...
 $ prt    : chr  "48" "104" "699" "702" ...
 $ flow   : chr  "2" "1" "1" "1" ...
 $ comm   : chr  "0709909" "2008190" "2510101" "2814200" ...
 $ tvalue : num  297378.4 67083.6 9062.8 94.2 143.7 ...
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "07" "20" "25" "28" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2002" "2002" "2002" "2002" ...
 $ rep    : chr  "660" "660" "660" "660" ...
 $ prt    : chr  "312" "530" "124" "530" ...
 $ flow   : chr  "1" "1" "1" "1" ...
 $ comm   : chr  "02011000" "02045000" "03056010" "03070010" ...
 $ tvalue : num  247 1476 470 300 151 ...
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "02" "02" "03" "03" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2003" "2003" "2003" "2003" ...
 $ rep    : chr  "660" "660" "690" "690" ...
 $ prt    : chr  "840" "124" "480" "250" ...
 $ flow   : chr  "1" "1" "1" "1" ...
 $ comm   : chr  "02069000" "02101090" "04012010" "04013020" ...
 $ tvalue : num  2595.9 7890 88.1 111.4 360 ...
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "02" "02" "04" "04" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2004" "2004" "2004" "2004" ...
 $ rep    : chr  "112" "112" "112" "112" ...
 $ prt    : chr  "440" "208" "56" "428" ...
 $ flow   : chr  "1" "1" "1" "1" ...
 $ comm   : chr  "3502902000" "8481808700" "8538909100" "2916150000" ...
 $ tvalue : int  200 3000 800 100 200 100 200 100 100 100
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "35" "84" "85" "29" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2005" "2005" "2005" "2005" ...
 $ rep    : chr  "876" "776" "876" "776" ...
 $ prt    : chr  "242" "554" "899" "554" ...
 $ flow   : chr  "1" "1" "1" "1" ...
 $ comm   : chr  "07091000" "08012000" "08093000" "14010000" ...
 $ tvalue : num  36.2 7.19 220.62 47.26 188.18 ...
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "07" "08" "08" "14" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2006" "2006" "2006" "2006" ...
 $ rep    : chr  "740" "740" "876" "876" ...
 $ prt    : chr  "528" "528" "242" "156" ...
 $ flow   : chr  "1" "1" "1" "1" ...
 $ comm   : chr  "07130080" "08081000" "08129000" "15122900" ...
 $ tvalue : num  648 72 40.2 53.8 91.5 ...
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "07" "08" "08" "15" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2007" "2007" "2007" "2007" ...
 $ rep    : chr  "690" "184" "690" "184" ...
 $ prt    : chr  "699" "554" "480" "840" ...
 $ flow   : chr  "3" "1" "1" "1" ...
 $ comm   : chr  "02023000" "02041000" "04061090" "07032000" ...
 $ tvalue : num  45500.7 3006.1 674.3 24.3 32.5 ...
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "02" "02" "04" "07" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2008" "2008" "2008" "2008" ...
 $ rep    : chr  "740" "798" "798" "798" ...
 $ prt    : chr  "899" "156" "36" "554" ...
 $ flow   : chr  "1" "1" "1" "1" ...
 $ comm   : chr  "00000000" "06040000" "19041010" "27120000" ...
 $ tvalue : num  1.00e+07 1.29e+01 1.07e+03 1.42e+03 1.39e+03 ...
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "00" "06" "19" "27" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2009" "2009" "2009" "2009" ...
 $ rep    : chr  "90" "90" "90" "90" ...
 $ prt    : chr  "344" "36" "598" "458" ...
 $ flow   : chr  "1" "1" "1" "1" ...
 $ comm   : chr  "7009" "8443" "9017" "3303" ...
 $ tvalue : num  105.8 23821.1 224.6 54.8 634.9 ...
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "70" "84" "90" "33" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2010" "2010" "2010" "2010" ...
 $ rep    : chr  "72" "120" "120" "184" ...
 $ prt    : chr  "410" "642" "756" "840" ...
 $ flow   : chr  "1" "1" "1" "1" ...
 $ comm   : chr  "84813090" "38220000" "38220000" "29420000" ...
 $ tvalue : num  147.2 43.3 142.3 2008.8 26.3 ...
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "84" "38" "38" "29" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2011" "2011" "2011" "2011" ...
 $ rep    : chr  "52" "52" "52" "52" ...
 $ prt    : chr  "76" "380" "410" "554" ...
 $ flow   : chr  "1" "1" "1" "1" ...
 $ comm   : chr  "8424909000" "7011100000" "8204110000" "9018320000" ...
 $ tvalue : num  5.5 21 3 119 3.09 ...
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "84" "70" "82" "90" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2012" "2012" "2012" "2012" ...
 $ rep    : chr  "52" "52" "52" "52" ...
 $ prt    : chr  "124" "792" "158" "250" ...
 $ flow   : chr  "1" "1" "1" "1" ...
 $ comm   : chr  "6211110000" "8482800000" "8482910000" "5108200000" ...
 $ tvalue : num  8 35 2.5 108 111 73 573 105 757 15
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "62" "84" "84" "51" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2013" "2013" "2013" "2013" ...
 $ rep    : chr  "76" "76" "76" "76" ...
 $ prt    : chr  "858" "32" "68" "250" ...
 $ flow   : chr  "1" "1" "2" "1" ...
 $ comm   : chr  "30042059" "30042063" "35040011" "29051929" ...
 $ tvalue : int  421 11937 792 16 48 46 51 253 12 7
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "30" "30" "35" "29" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2014" "2014" "2014" "2014" ...
 $ rep    : chr  "642" "642" "642" "642" ...
 $ prt    : chr  "276" "276" "380" "250" ...
 $ flow   : chr  "2" "1" "1" "1" ...
 $ comm   : chr  "390330" "200710" "390110" "350699" ...
 $ tvalue : num  5.26 16.73 0.31 82.63 39.32 ...
 $ weight : num  NA NA NA NA NA NA NA NA NA NA
 $ qty    : num  NA NA NA NA NA NA NA NA NA NA
 $ qunit  : chr  "1" "1" "1" "1" ...
 $ chapter: chr  "39" "20" "39" "35" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  10 variables:
 $ tyear  : chr  "2015" "2015" "2015" "2015" ...
 $ rep    : chr  "100" "100" "100" "100" ...
 $ prt    : chr  "380" "156" "156" "380" ...
 $ flow   : chr  "2" "1" "1" "1" ...
 $ comm   : chr  "500000" "50020000" "50020000" "50020000" ...
 $ tvalue : num  16862 488590 453469 12900 48673 ...
 $ weight : int  NA 8037 7775 276 922 92 3717 342 3990 104
 $ qty    : int  NA 8037 7775 276 922 92 3717 342 3990 104
 $ qunit  : chr  "1" "8" "8" "8" ...
 $ chapter: chr  "50" "50" "50" "50" ...
 - attr(*, ".internal.selfref")=<externalptr>
malexan commented 7 years ago

Thanks Christian,

So it is a problem with old data set.

malexan commented 7 years ago

@chrMongeau, could you check similar question for Eurostat 2013 and 2014? I need column flow.

chrMongeau commented 7 years ago

flow is always character:

> plyr::mlply(
+   2000:2015,
+   .fun = function(year) {
+     str(faosws::ReadDatatable(
+       paste0("ce_combinednomenclature_unlogged_", year),
+       columns = c(
+         "period",
+         "declarant",
+         "partner",
+         "flow",
+         "product_nc",
+         "value_1k_euro",
+         "qty_ton",
+         "sup_quantity",
+         "stat_regime"
+       ),
+       limit = 10L
+     ))
+   }
+ )
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "200052" "200052" "200052" "200052" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "2" "2" "1" "2" ...
 $ product_nc   : chr  "05090090" "20081951" "29095010" "42032991" ...
 $ value_1k_euro: num  4.59 0.41 0.12 2.38 0.67 ...
 $ qty_ton      : num  0.1 0 0 0 0 ...
 $ sup_quantity : num  NA NA NA 148 NA 53 59 NA NA NA
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "200152" "200152" "200152" "200152" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "1" "2" "1" "1" ...
 $ product_nc   : chr  "01051119" "01051119" "01051191" "01051199" ...
 $ value_1k_euro: num  152.5 191.8 248 12.1 59.9 ...
 $ qty_ton      : num  18.6 4.6 8.5 0.6 7 ...
 $ sup_quantity : num  89032 113210 219439 11490 180406 ...
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "200252" "200252" "200252" "200252" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "2" "2" "2" "2" ...
 $ product_nc   : chr  "03054950" "06022010" "08103010" "12111000" ...
 $ value_1k_euro: num  0.01 0.2 0.14 0.01 0.23 ...
 $ qty_ton      : num  0 0 0 0 0 0 36.1 0 0 0
 $ sup_quantity : num  NA NA NA NA NA NA NA NA NA NA
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "200352" "200352" "200352" "200352" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "1" "2" "2" "2" ...
 $ product_nc   : chr  "03026975" "03037987" "06031030" "08029050" ...
 $ value_1k_euro: num  0.4 0.04 0.6 0.02 0.02 0.04 0.43 0.08 0.51 0.03
 $ qty_ton      : num  0 0 0 0 0 0 0 0 0 0
 $ sup_quantity : num  NA NA 462 NA NA NA 13 NA 189 NA
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "200452" "200452" "200452" "200452" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "2" "2" "2" "1" ...
 $ product_nc   : chr  "20083071" "28013010" "29251995" "33011390" ...
 $ value_1k_euro: num  0.01 0.7 0.93 0.56 0.66 0.15 0.65 0.05 0.17 0.06
 $ qty_ton      : num  0 0 0 0 0 0 0 0 0 0
 $ sup_quantity : num  NA NA NA NA NA NA 29 1 NA NA
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "200552" "200552" "200552" "200552" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "1" "1" "2" "2" ...
 $ product_nc   : chr  "27SSS343" "29034300" "32121090" "39219049" ...
 $ value_1k_euro: num  0 0.58 0.15 0.1 0.21 0.23 0.07 1.25 0.89 0.96
 $ qty_ton      : num  37 0 0 0 0 0.6 0 0 0 0.6
 $ sup_quantity : num  NA NA NA NA NA 1 NA 280 NA 6
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "200652" "200652" "200652" "200652" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "2" "1" "2" "2" ...
 $ product_nc   : chr  "03041035" "05119190" "08103010" "26" ...
 $ value_1k_euro: num  0.23 424.04 0.02 1841.69 3.22 ...
 $ qty_ton      : num  0 342 0 6214 0 ...
 $ sup_quantity : num  NA NA NA NA 891 NA NA NA NA NA
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "200752" "200752" "200752" "200752" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "1" "1" "2" "2" ...
 $ product_nc   : chr  "01011010" "14" "16024915" "28020000" ...
 $ value_1k_euro: num  45.18 927.88 0.01 0.03 0.22 ...
 $ qty_ton      : num  0 407 0 0 0 ...
 $ sup_quantity : num  5 NA NA NA NA NA NA NA NA 81
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "200852" "200852" "200852" "200852" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "1" "2" "1" "2" ...
 $ product_nc   : chr  "01" "01" "01011010" "01011010" ...
 $ value_1k_euro: num  41871 16706 249 157 737 ...
 $ qty_ton      : num  997.3 25.3 0 0 0 ...
 $ sup_quantity : num  NA NA 332 14 3 1 0 0 380 2
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "200952" "200952" "200952" "200952" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "2" "2" "1" "1" ...
 $ product_nc   : chr  "27030000" "30066019" "63011000" "70112000" ...
 $ value_1k_euro: num  0.09 0.29 104.2 0.02 502.45 ...
 $ qty_ton      : num  0 0 0 0 0 0 0 0 0 0
 $ sup_quantity : num  NA NA 6623 NA 1479 ...
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "201052" "201052" "201052" "201052" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "2" "1" "2" "1" ...
 $ product_nc   : chr  "39207990" "40012100" "49051000" "62046251" ...
 $ value_1k_euro: num  0.81 0.02 0.08 0.09 0 1.04 0.04 0.22 0.06 0.01
 $ qty_ton      : num  0 0 0 0 0 0 0 0 0 0
 $ sup_quantity : num  NA NA NA 2 NA 11 NA NA NA NA
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "201152" "201152" "201152" "201152" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "2" "1" "1" "1" ...
 $ product_nc   : chr  "29054100" "52121110" "58042190" "71081200" ...
 $ value_1k_euro: num  0.01 0.01 0.13 127.07 0.05 ...
 $ qty_ton      : num  0 0 0 0 0 ...
 $ sup_quantity : num  NA 9 NA 3020 NA NA 2 NA NA NA
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "201252" "201252" "201252" "201252" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "2" "1" "2" "2" ...
 $ product_nc   : chr  "63011000" "72119080" "73044999" "90118000" ...
 $ value_1k_euro: num  0.84 0.09 0.04 1.91 1.04 0.04 0.04 0.12 0.73 0.01
 $ qty_ton      : num  0.1 0 0 0 0 0 0 0 0.3 0
 $ sup_quantity : num  52 NA NA 13 174 NA NA NA 23 NA
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "201352" "201352" "201352" "201352" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "1" "1" "1" "2" ...
 $ product_nc   : chr  "28273910" "71101980" "72071919" "82119500" ...
 $ value_1k_euro: num  0.09 1.36 0.19 0.07 0.2 ...
 $ qty_ton      : num  0 0 0 0 0 ...
 $ sup_quantity : num  NA 4730 NA NA NA ...
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "201452" "201452" "201452" "201452" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "1" "1" "2" "2" ...
 $ product_nc   : chr  "44129950" "72039000" "72106100" "90251120" ...
 $ value_1k_euro: num  0.09 0.07 0.01 0.07 0.2 0.4 0.01 0.02 0.46 0.12
 $ qty_ton      : num  0 0 0 0 0 0 0 0 0 0.1
 $ sup_quantity : num  1 NA NA 20 NA NA NA NA NA 10
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr> 
Classes ‘data.table’ and 'data.frame':  10 obs. of  9 variables:
 $ period       : chr  "201552" "201552" "201552" "201552" ...
 $ declarant    : chr  "001" "001" "001" "001" ...
 $ partner      : chr  "0003" "0003" "0003" "0003" ...
 $ flow         : chr  "1" "2" "1" "2" ...
 $ product_nc   : chr  "01" "01" "01012100" "01012100" ...
 $ value_1k_euro: num  28526 34254 1393 336 356 ...
 $ qty_ton      : num  3679.4 20196.9 5.1 9.5 7.8 ...
 $ sup_quantity : num  NA NA 11 39 16 11 2 43 27 2
 $ stat_regime  : chr  "4" "4" "4" "4" ...
 - attr(*, ".internal.selfref")=<externalptr>
malexan commented 7 years ago

Thanks!