[FIX] If more than 25 files are uploaded at once, the emacs client becomes unresponsive or the server responds with an error

[yuzhou721]

Describe the bug

Such as the title

To Reproduce

Steps to reproduce the behavior: After setting up the directory, execute khoj--server-index-files

Screenshots

message buffer

khoj.el: Failed to update allcontent index. Status: http 400. Response: {"detail":"There was an error parsing the body"}
error in process sentinel: url-http-async-sentinel: Output file descriptor of app.khoj.dev is closed
error in process sentinel: Output file descriptor of app.khoj.dev is closed

Platform

• Server:
  • [x] Cloud-Hosted (https://app.khoj.dev)
  • [ ] Self-Hosted Docker
  • [ ] Self-Hosted Python package
  • [ ] Self-Hosted source code
• Client:
  • [ ] Obsidian
  • [x] Emacs
  • [ ] Desktop app
  • [ ] Web browser
  • [ ] WhatsApp
• OS:
  • [ ] Windows
  • [x] macOS
  • [ ] Linux
  • [ ] Android
  • [ ] iOS

If self-hosted

• Server Version [e.g. 1.0.1]:

Additional context

Sending a lot of files with url.el doesn't seem very stable, could you change it to curl? If possible I can submit a RP

[yuzhou721]

Found two issues:

1. File name encoding issue (Chinese characters in file names will cause errors on the backend)
2. Tried sending in batches, able to send all 20 at a time.