pariyatti / kosa

Digital library service
GNU Affero General Public License v3.0
8 stars 3 forks source link

Change all Looped Card URLs to HTTPS #99

Open deobald opened 1 year ago

deobald commented 1 year ago

See Daily Doha changes here: https://github.com/pariyatti/Daily_emails_RSS/commit/3853b751062c7027e6ff10cb80d28ddaa74a1908

balwa commented 1 year ago

Started on sandbox to update the looped cards using terraform.

# Manually set to 1 to update the txt files
  update_txt_files = 1
deobald commented 1 year ago

I've added some additional logging to kuti.storage.open-uri. It now logs the entire response object on failure to download. These errors are happening because of an SSL Handshake exception:

10:50:50.910 DEBUG kuti.storage.open-uri - #### Body was empty. Retrying 5 / 5 ####
10:50:54.912 DEBUG kuti.storage.open-uri - Downloading 'https://download.pariyatti.org/dwob/itivuttaka_1_17.mp3' to '/var/folders/k4/8wzd7lls0mv381ryx_cmf9z00000gn/T/kuti-download-3266515244464202994.mp3'.
10:50:54.969 DEBUG kuti.storage.open-uri - #### Body was empty. Response: {:opts {:follow-redirects true, :as :stream, :method :get, :url "https://download.pariyatti.org/dwob/itivuttaka_1_17.mp3"}, :error #error {
 :cause "Received fatal alert: handshake_failure"
 :via
 [{:type javax.net.ssl.SSLHandshakeException
   :message "Received fatal alert: handshake_failure"
   :at [sun.security.ssl.Alert createSSLException "Alert.java" 131]}]
 :trace
 [[sun.security.ssl.Alert createSSLException "Alert.java" 131]
  [sun.security.ssl.Alert createSSLException "Alert.java" 117]
  [sun.security.ssl.TransportContext fatal "TransportContext.java" 358]
  [sun.security.ssl.Alert$AlertConsumer consume "Alert.java" 293]
  [sun.security.ssl.TransportContext dispatch "TransportContext.java" 204]
  [sun.security.ssl.SSLTransport decode "SSLTransport.java" 172]
  [sun.security.ssl.SSLEngineImpl decode "SSLEngineImpl.java" 736]
  [sun.security.ssl.SSLEngineImpl readRecord "SSLEngineImpl.java" 691]
  [sun.security.ssl.SSLEngineImpl unwrap "SSLEngineImpl.java" 506]
  [sun.security.ssl.SSLEngineImpl unwrap "SSLEngineImpl.java" 482]
  [javax.net.ssl.SSLEngine unwrap "SSLEngine.java" 679]
  [org.httpkit.client.HttpsRequest doHandshake "HttpsRequest.java" 98]
  [org.httpkit.client.HttpClient doRead "HttpClient.java" 193]
  [org.httpkit.client.HttpClient run "HttpClient.java" 494]
  [java.lang.Thread run "Thread.java" 833]]}}
10:50:54.969 DEBUG kuti.storage.open-uri - #### Retries consumed. Giving up. ####

...I've asked @ya-juley in the email thread if he can think of anything suspicious that might be causing this. As mentioned there, this particular URL works via curl.