search

icecc / icecream

Distributed compiler with a central scheduler to share build load
GNU General Public License v2.0
1.58k stars 248 forks source link

Apply env(ICECC_SLOW_NETWORK) also to setsockopt() #623

Open jankratochvil opened 1 year ago

jankratochvil commented 1 year ago

When trying to use ccache across the world (450ms RTT) I am unable to start any remote job. I always get mysterious:

[1481618] 2023-08-11 16:01:04: setting error state for channel 192.168.67.1: (B eof: 0)
[1481618] 2023-08-11 16:01:04: remove daemon host1.jankratochvil.net

or

[1223472] 2023-08-11 09:35:48: Connected to scheduler (I am known as 192.168.67.1)
[1223472] 2023-08-11 09:36:51: accepted 10 192.168.67.2 as 1
[1223472] 2023-08-11 09:36:52: handle_transfer_env, client status unknown
[1223472] 2023-08-11 09:36:52: start_install_environment: /var/cache/icecream target x86_64 Name: 03bff24def5e8aca4423fafc5e114c8e
[1223472] 2023-08-11 09:37:00: Created fork for receiving environment on pid 1410411
[1223472] 2023-08-11 09:37:00: PID of child thread running untaring environment: 1410411
[1223472] 2023-08-11 09:38:49: scheduler closed connection
[1223472] 2023-08-11 09:38:49: handle_end 1 192.168.67.2
[1223472] 2023-08-11 09:38:49: finish_transfer_env for x86_64/03bff24def5e8aca4423fafc5e114c8e (cancel)
[1223472] 2023-08-11 09:38:49: finish_transfer_env kill and waiting for child PID 1410411
[1410411] 2023-08-11 09:38:49: copy_data(): Error after write: Write failed
[1410411] 2023-08-11 09:38:49: start_install_environment: r  < ARCHIVE_WARN Truncated input file (needed 1071104 bytes, only 0 available)
[1223472] 2023-08-11 09:38:49: reannounce_environments
[1223472] 2023-08-11 09:38:49: scheduler dead ?!
[1223472] 2023-08-11 09:38:49: cleared children
jankratochvil commented 1 year ago

There is still some problem:

ICECC[1146277] 2023-08-11 17:10:44: timed out while trying to send data
ICECC[1146277] 2023-08-11 17:10:44: flush_writebuf() failed(Error: Resource temporarily unavailable)
ICECC[1146291] 2023-08-11 17:11:13: write of source chunk to host 192.168.67.1
ICECC[1146291] 2023-08-11 17:11:13: failed (Error: Resource temporarily unavailable)
ICECC[1146291] 2023-08-11 17:11:13: </write_fd_to_server from cpp: 56987ms>
ICECC[1146291] 2023-08-11 17:11:13: got exception Error 15 - write to host failed (192.168.67.1)