This pull request refactors the get_data_path function to use a constant for the file directory instead of hardcoding the path in the function.
The constant TOKENIZED_FILE_DIR is imported from preprocess/preprocess.py. This makes the code more modular and easier to maintain, as any changes to the file directory can be made in one place.
This pull request refactors the get_data_path function to use a constant for the file directory instead of hardcoding the path in the function.
The constant
TOKENIZED_FILE_DIRis imported frompreprocess/preprocess.py. This makes the code more modular and easier to maintain, as any changes to the file directory can be made in one place.