Open takposha opened 5 months ago
The Config class does appear to track token usage across the topic modeling and question generation portions of the pipeline.
Config
However, this needs to be tested further to ensure that there are no bugs in the token usage tracking.
There also needs to be some implementation to log the tokens used for future analysis.
The
Configclass does appear to track token usage across the topic modeling and question generation portions of the pipeline.However, this needs to be tested further to ensure that there are no bugs in the token usage tracking.
There also needs to be some implementation to log the tokens used for future analysis.