In the current design of llm kv cache, we use the tensor builder to build the blob of kv cache. However, we don't use the arrow buffer of the tensor builder. It's better to delete the tensor builder dependencies and create a new class to wrapper the tensor builder without the arrow dependencies.
Describe your problem
In the current design of llm kv cache, we use the tensor builder to build the blob of kv cache. However, we don't use the arrow buffer of the tensor builder. It's better to delete the tensor builder dependencies and create a new class to wrapper the tensor builder without the arrow dependencies.
Original:
Expected: