apache / pinot

Apache Pinot - A realtime distributed OLAP datastore
https://pinot.apache.org/
Apache License 2.0
5.52k stars 1.29k forks source link

[WIP] Adds check if controller tmp dir exists #14503

Open Harnoor7 opened 2 days ago

Harnoor7 commented 2 days ago

Problem: Have observed rare exception:java.io.FileNotFoundException: /tmp/pinot-controller-tmp/fileUploadTemp/tmp-<id> (No such file or directory). Assumption is that OS might have deleted older file under tmp directory and hence deleted controllder tmp dir files.

Solution: Add validation to ensure the temp dirs are present whenever they are accessed. If absent then pinot should create them. solution is based on : https://howtodoinjava.com/java/io/create-directories/#2-1-files-createdirectory

Instructions:

  1. The PR has to be tagged with at least one of the following labels (*):
    1. feature
    2. bugfix
    3. performance
    4. ui
    5. backward-incompat
    6. release-notes (**)
  2. Remove these instructions before publishing the PR.

(*) Other labels to consider:

(**) Use release-notes label for scenarios like: