search

RevolutionAnalytics / dplyr-spark

spark backend for dplyr
48 stars 18 forks source link

type mapping when fetching results #20

Closed piccolbo closed 9 years ago

piccolbo commented 9 years ago

observed all R atomic types are mapped back to either numeric or character. Information loss happens at load time for factor, fetch time for all the others. Seems deliberate choice in RJDBC, reported s-u/RJDBC#19. May try to work around it with explicit query describe tableid which provides the information and then overriding collect for type tbl_SparkSQL

piccolbo commented 9 years ago

Gave up on raw, other atomic look like working.