FireDucks is a high-performance compiler-accelerated dataframe library for python. It is being developed with speed and pandas compatibility in mind.
FireDucks is released on pypi.org under the 3-Clause BSD License (the Modified BSD License).
FireDucks is currently available for Linux (manylinux) on the x86_64 architecture (we will support it for other platforms based on user requests)
and it can be simply installed using pip as follows:
pip install fireducksPlease make sure you are using Python >3.8, <=3.12, otherwise you may encounter error saying: "No matching distribution found for fireducks".
⚠ Since FireDucks 1.1.0, we have upgraded dependent pyarrow to 18.0.0. Therefore, python 3.8 is no longer supported.
FireDucks provides two types of usage: Import Hook and Explicit Import.
FireDucks provides an import hook utility. This utility runs the given Python
script by automatically replacing import pandas statement with FireDucks. So
this utility enables you to use FireDucks for your existing program as it is.
The import hook can be activated by Python interpreter's -m option as follows.
python3 -m fireducks.pandas your_script.pyFor IPython/Jupyter Notebook, a magic command is available as follows.
%load_ext fireducks.pandas
import pandas as pdThis is very useful when your program includes many Python scripts which import
pandas internally. You don't need to replace individual import statements from
those scripts manually.
If you use any external libraries (like matplotlib etc.) which may internally use pandas DataFrame, please make sure to enable the hook to avoid any unintended executional issues.
📢 The import hook feature has changed its name to fireducks.pandas from
FireDucks 0.11.0.
An old module name fireducks.imhook is also available as an alias.
FireDucks has pandas-like module fireducks.pandas which can be imported instead
of pandas. If you want to use FireDucks for an existing pandas program, replace
the import statement as follows.
# import pandas as pd
import fireducks.pandas as pd💻 Web site: https://fireducks-dev.github.io
This repository is used for communication such as issue report and Q&A. Please open new issue.
✉ Contact: mailto:contact@fireducks.jp.nec.com
🤝Slack: https://join.slack.com/t/fireducks/shared_invite/zt-2j4lucmtj-IGR7AWlXO62Lu605pnBJ2w