search

WIPACrepo / pyglidein

Some python scripts to launch HTCondor glideins
MIT License
6 stars 20 forks source link

work with containers #62

Closed dsschult closed 7 years ago

dsschult commented 7 years ago

Containers are a thing now. NERSC requires them, and I wouldn't be surprised for other sites to follow along.

So, figure out the correct way to submit a glidein inside a container. Mostly it's documentation with an example, but there might be issues with the wrapper script or glidein_start.sh.

dsschult commented 7 years ago

From NERSC:

Found an issue with HTCondor: 

01/10/17 12:54:37 my_popenv failed
01/10/17 12:54:37 ERROR "fopen of "/var/run/utmp"" at line 273 in file /home/dschultz/pyglidein/tmp15Mj7h/htcondor-8_4_2/src/condor_sysapi/idle_time.cpp

Apparently we can't map anything in /var into the container for security reasons.

briedel commented 7 years ago

Is that setting from within condor or something we set? We are running a small CoreOS based test cluster using HTCondor without that issue.

dsschult commented 7 years ago

I bet there's a way to turn it off, but we might need to find the right knob. Probably the one to monitor user activity and treat like a workstation that might go back to the user.

dsschult commented 7 years ago

The setting STARTD_HAS_BAD_UTMP = TRUE might do it.

dsschult commented 7 years ago

As noted on #9, we need to fix os_arch.sh to run on docker.

dsschult commented 7 years ago

95e326d fixes os_arch.sh

hskarlupka commented 7 years ago

Submit jobs via Shifter

dsschult commented 7 years ago

closing this ticket in favor of #106, as that's more detailed to the issue.