search

sassoftware / saspy

A Python interface module to the SAS System. It works with Linux, Windows, and Mainframe SAS as well as with SAS in Viya.
https://sassoftware.github.io/saspy
Other
367 stars 149 forks source link

python pandas is so slowly #509

Closed cfkstat closed 1 year ago

cfkstat commented 1 year ago

Pandas is the very low computational efficiency. Why not use polars or data.table for higher computational efficiency, especially in reading and writing IO?

tomweber-sas commented 1 year ago

Well, I wrote this 7 years ago, and Pandas was the defacto table interface for Python. I looked up these two you mention. Polars appears to be less than a year old since its first release, so that's only just being made up. The data.table seems like its first version was 5 years ago. I haven't heard of these before, so I haven't looked into trying to interface with them. Guess that's the answer to 'why'.