twcc / AFS_tools

6 stars 1 forks source link

AFS Toolkits

Get Token Number

Use this tool to do token calcuation offline, usage:

python get_token.py -f ./jsonl/get_token_inputs.jsonl

and output will be like

token calcuate

Do Semantic Test

After you deploy a AFS Cloud, you can get service endpoint and API information, as well as paste those information to get_semantic.py you can run this command:

python get_semantic.py -f ./jsonl/TWS_AFS_CLOUD_EVAL.jsonl 

and output will be like

semantic evalution

You can change to your dataset accordingly.

Use Case

You can observe use case for service integration ideas.