run-llama / llama_parse

Parse files for optimal RAG
https://www.llamaindex.ai
MIT License
3k stars 286 forks source link

Request Field for Logging User-Specified Job-Level metadata #387

Open adreichert opened 1 month ago

adreichert commented 1 month ago

Summary

I'd like to request that both the REST API and the Python package offer a field that permits users to upload small, custom strings. This field would NOT be used for parsing by LlamaParse. The user could populate it with freeform strings, small JSON documents, or anything else they wanted. Later, they could read this from the job details endpoint. In the past, I've used such fields for the following:

Example

% curl -L -X POST 'https://api.cloud.llamaindex.ai/api/v1/parsing/upload' \      
[...]
-F 'user_metadata="DEBUG"'
[...]
 curl -L -X GET 'https://api.cloud.llamaindex.ai/api/v1/parsing/job/<ID>/details' \ 
[...]
user_metadata="DEBUG"
hexapode commented 1 month ago

Great Feedback. We will add it to a future release (most likely in the next 2-3 weeks)