search

MichaelChirico / r-bugs

A ⚠️read-only⚠️mirror of https://bugs.r-project.org/
20 stars 0 forks source link

[BUGZILLA #6701] lookup.xport in foreign ignoring some datasets #2068

Open MichaelChirico opened 4 years ago

MichaelChirico commented 4 years ago

From: Svetlana Eden <svetlana.eden@<::CENSORED -- SEE ORIGINAL ON BUGZILLA::>>

The Details.

In the following version.

version
     _

platform i386-pc-linux-gnu arch i386 os linux-gnu system i386, linux-gnu status major 1 minor 8.1 year 2003 month 11 day 21 language R

lookup.xport ignores some datasets in sas export file.

File "emptySasData3.xpt" (available at http://biostat.mc.vanderbilt.edu/tmp/emptySasData3.xpt) is a recreation of sensitive data. It was generated in SAS as an export file containing 51 empty datasets, but it has a structure of the non-empty data that revealed the problem (and can not be shared). It means that lookup.xport ignores non-empty datasets also.

The file "emptySasData3.xpt" has 51 empty datasets. lookup.xport reads only 37 first datasets. (In non-empty data lookup.xport ignored datasets in the middle (not in the end) )

look <- lookup.xport("emptySasData3.xpt")
names(look)

[1] "AE" "BII" "BIO" "BLI" "BP" "C" "D" "DEA" "DEM" "DHT" [11] "DIS" "DP" "E" "EC" "EL" "G" "HS" "HU" "IN"
"IP" [21] "L" "LT" "MC" "MO" "NO" "PAS" "PAT" "PATH" "PO"
"PR" [31] "PS" "PV" "Q" "RA" "RE" "SA" "SL"

The following datasets were not read by lookup.xport UR, URN, VIS, VIT, VO.

The example of the SAS code used to builds the empty data from the non-empty data in "export.xpt".

options nofmterr; proc options;run; libname x sasv5xpt "H:\projects\export.xpt"; libname y sasv5xpt "H:\projects\emptySasData3.xpt"; data ae; set x.ae(obs = 0); run; ... data vit; set x.vital(obs = 0); run; data vo; set x.volume(obs = 0); run; proc copy in = work out = y; run;

I think I did not miss anything, thank you,

Svetlana

-- Svetlana Eden Biostatistician II School of Medicine Department of Biostatistics Vanderbilt University

METADATA

MichaelChirico commented 4 years ago

From: Peter Dalgaard <p.dalgaard@<::CENSORED -- SEE ORIGINAL ON BUGZILLA::>> svetlana.eden@<::CENSORED -- SEE ORIGINAL ON BUGZILLA::> writes:

The following datasets were not read by lookup.xport
UR, URN, VIS, VIT, VO.

The example of the
SAS code used to builds the empty data
from the non-empty data in "export.xpt".

options nofmterr;
proc options;run;
libname x sasv5xpt "H:\projects\export.xpt";
libname y sasv5xpt "H:\projects\emptySasData3.xpt";
        ********

SAS version 5 XPORT libraries? Why? Does it work any different with

libname x xport "H:\what\ever";

?

data ae; set x.ae(obs = 0); run;
...
data vit; set x.vital(obs = 0); run;
data vo; set x.volume(obs = 0); run;
proc copy in = work out = y; run;

-- O_ ---- Peter Dalgaard Blegdamsvej 3
c/ /' --- Dept. of Biostatistics 2200 Cph. N
<CENSORING FROM DETECTED PHONE NUMBER ONWARDS; SEE BUGZILLA>

METADATA

MichaelChirico commented 4 years ago

NOTES: SAS version5 is probably not supported.

METADATA

MichaelChirico commented 4 years ago

Audit (from Jitterbug): Sun Mar 28 11:03:42 2004 ripley changed notes Sun Mar 28 11:03:42 2004 ripley moved from incoming to Add-ons

METADATA

MichaelChirico commented 4 years ago

I just asked a SAS user and was told that the SAS export engine 5 is still used even though SAS itself is on version 9.6. So this is not about what SAS version is supported. However I don't know how to test if this issue is reproducible. The link to download the file doesn't work any more.

Could this be closed?

METADATA

MichaelChirico commented 4 years ago

Created attachment 2528 [details] SAS export file with multiple files

This is a SAS export file with three data sets one of which is empty.

METADATA

INCLUDED PATCH

MichaelChirico commented 4 years ago

I tested lookup.xport on the sample file and it worked fine. I would say this issue can be closed as no longer reproducible -- although I'm not sure if there was something more specific about the number 37. That said, I believe that both SAS and R have had substantial changes since this report.

METADATA