search

wesm / feather

Feather: fast, interoperable binary data frame storage for Python, R, and more powered by Apache Arrow
Apache License 2.0
2.74k stars 169 forks source link

feather installation failed with "big endian" issue #389

Closed bergen288 closed 4 years ago

bergen288 commented 4 years ago

I am trying to install R packages on AIX7.2 server. My feather installation failed with following error. According to my google search, this issue should have been fixed long time ago: https://github.com/tidyverse/tidyverse/issues/36. My version is feather_0.3.5.tar.gz. Can someone please tell me how to fix it?

* installing *source* package 'feather' ...
** package 'feather' successfully unpacked and MD5 sums checked
** using staged installation
Platform is big endian. This is currently unsupported.
ERROR: configuration failed for package 'feather'
* removing '/software/R/site-library/feather'
wesm commented 4 years ago

Can you install the "arrow" package on this system?

bergen288 commented 4 years ago

Yes, I have installed arrow package successfully. There is a note to run "arrow::install_arrow()" after installation. But I received the following another note: 

> library(arrow)

Attaching package: 'arrow'

The following object is masked from 'package:utils':

    timestamp

> arrow::install_arrow()
Refer to the R package README <https://github.com/apache/arrow/blob/master/r/README.md> and `vignette('install', package = 'arrow')` for installation guidance.
nealrichardson commented 4 years ago

As it turns out, that's not a successful installation of arrow, or not a useful one: it has only installed the install_arrow() function and not the C++ library.

There has recently been some work in the Arrow C++ library to get it to work on big endian platforms. Not sure how much more is needed to get the R package to work. If you're interested in pursuing this, please open a JIRA issue and include the output of:

sessionInfo()
Sys.setenv(ARROW_R_DEV="true")
install.packages("arrow")

Aside: the "fix" you referenced was not actually a fix for big endian support: it was to remove feather as a hard dependency of tidyverse. The big endian check is still in https://github.com/wesm/feather/blob/master/R/configure.