| Name | 5cMKDmcWBi8n9Rq4apOajLDm4fhM0noT9bVo0NGKDmXYJKDmQdT8cn_4 |
| Workunit | 237743744 |
| Created | 4 Dec 2025, 13:27:29 UTC |
| Sent | 4 Dec 2025, 13:27:31 UTC |
| Report deadline | 12 Dec 2025, 13:27:31 UTC |
| Received | 4 Dec 2025, 14:22:48 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 0 (0x00000000) |
| Computer ID | 10988175 |
| Run time | 2 min 19 sec |
| CPU time | 22 sec |
| Validate state | Invalid |
| Credit | 0.00 |
| Device peak FLOPS | 34.44 GFLOPS |
| Application version | ATLAS Simulation v3.01 (native_mt) x86_64-pc-linux-gnu |
| Peak working set size | 518.47 MB |
| Peak swap size | 1.53 GB |
| Peak disk usage | 392.36 MB |
Stderr output
<core_client_version>7.24.1</core_client_version> <![CDATA[ <stderr_txt> 07:18:54 (431045): wrapper (7.7.26015): starting 07:18:54 (431045): wrapper: running run_atlas (--nthreads 4) [2025-12-04 07:18:54] Arguments: --nthreads 4 [2025-12-04 07:18:54] Threads: 4 [2025-12-04 07:18:54] Checking for CVMFS [2025-12-04 07:18:54] Probing /cvmfs/atlas.cern.ch... OK [2025-12-04 07:18:54] Probing /cvmfs/atlas-condb.cern.ch... OK [2025-12-04 07:18:54] Running cvmfs_config stat atlas.cern.ch [2025-12-04 07:18:54] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE [2025-12-04 07:18:54] 2.13.3.0 24648 474 66712 153639 2 78 3221363 20480001 5106 130560 0 1058089 99.405 484602 507 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1 [2025-12-04 07:18:54] CVMFS is ok [2025-12-04 07:18:54] Efficiency of ATLAS tasks can be improved by the following measure(s): [2025-12-04 07:18:54] Small home clusters do not require a local http proxy but it is suggested if [2025-12-04 07:18:54] more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks. [2025-12-04 07:18:54] Further information can be found at the LHC@home message board. [2025-12-04 07:18:54] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 [2025-12-04 07:18:54] Checking for apptainer binary... [2025-12-04 07:18:54] apptainer is not installed, using version from CVMFS [2025-12-04 07:18:54] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname [2025-12-04 07:18:55] office [2025-12-04 07:18:55] apptainer works [2025-12-04 07:18:55] Set ATHENA_PROC_NUMBER=4 [2025-12-04 07:18:55] Set ATHENA_CORE_NUMBER=4 [2025-12-04 07:18:55] Starting ATLAS job with PandaID=6897139739 [2025-12-04 07:18:55] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/var/lib/boinc-client/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh [2025-12-04 07:21:10] *** The last 200 lines of the pilot log: *** [2025-12-04 07:21:10] 2025-12-04 14:19:25,762 | INFO | PID=434891 has CPU usage=0.0% CMD=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/bin/python3 pilot3/pilot.py -q BOINC_MCORE -i PR [2025-12-04 07:21:10] 2025-12-04 14:19:25,762 | INFO | .. there are 7 such processes running [2025-12-04 07:21:10] 2025-12-04 14:19:26,762 | INFO | time since job start (22s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:28,768 | INFO | time since job start (24s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:30,773 | INFO | time since job start (26s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:32,778 | INFO | time since job start (28s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:33,318 | INFO | using path: /var/lib/boinc-client/slots/0/PanDA_Pilot-6897139739/memory_monitor_output.txt (trf name=prmon) [2025-12-04 07:21:10] 2025-12-04 14:19:34,779 | INFO | time since job start (30s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:35,825 | INFO | monitor loop #7: job 0:6897139739 is in state 'running' [2025-12-04 07:21:10] 2025-12-04 14:19:35,955 | INFO | memory monitor command has pid 447493 (appending to cmd dictionary) [2025-12-04 07:21:10] 2025-12-04 14:19:36,785 | INFO | time since job start (32s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:38,789 | INFO | time since job start (34s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:40,795 | INFO | time since job start (36s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:42,799 | INFO | time since job start (38s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:44,805 | INFO | time since job start (40s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:46,161 | INFO | (instant) CPU consumption time for pid=441572: 16) [2025-12-04 07:21:10] 2025-12-04 14:19:46,162 | INFO | using path: /var/lib/boinc-client/slots/0/PanDA_Pilot-6897139739/memory_monitor_output.txt (trf name=prmon) [2025-12-04 07:21:10] 2025-12-04 14:19:46,809 | INFO | time since job start (42s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:47,985 | INFO | PID=434891 has CPU usage=4.7% CMD=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/bin/python3 pilot3/pilot.py -q BOINC_MCORE -i PR [2025-12-04 07:21:10] 2025-12-04 14:19:47,985 | INFO | .. there are 7 such processes running [2025-12-04 07:21:10] 2025-12-04 14:19:48,665 | INFO | monitor loop #8: job 0:6897139739 is in state 'running' [2025-12-04 07:21:10] 2025-12-04 14:19:48,986 | INFO | time since job start (44s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:50,994 | INFO | time since job start (46s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:52,999 | INFO | time since job start (48s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:55,006 | INFO | time since job start (51s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:57,007 | INFO | time since job start (53s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:58,284 | CRITICAL | execute payloads caught an exception (cannot recover): [Errno 107] Transport endpoint is not connected: '/usr/bin/condor_config_val', Traceback (most recent call l [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/control/payload.py", line 272, in execute_payloads [2025-12-04 07:21:10] exit_code, diagnostics = payload_executor.run() [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/control/payloads/generic.py", line 993, in run [2025-12-04 07:21:10] set_pilot_state(job=self.__job, state=state) [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/auxiliary.py", line 349, in set_pilot_state [2025-12-04 07:21:10] update_condor_classad(state=state) [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/condor.py", line 106, in update_condor_classad [2025-12-04 07:21:10] path = find_condor_chirp() [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/condor.py", line 261, in find_condor_chirp [2025-12-04 07:21:10] if Path(p).is_file() and os.access(p, os.X_OK): [2025-12-04 07:21:10] File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/lib/python3.9/pathlib.py", line 1456, in is_file [2025-12-04 07:21:10] File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/lib/python3.9/pathlib.py", line 1232, in stat [2025-12-04 07:21:10] OSError: [Errno 107] Transport endpoint is not connected: '/usr/bin/condor_config_val' [2025-12-04 07:21:10] [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/common/exception.py", line 466, in run [2025-12-04 07:21:10] self._target(**self.kwargs) [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/control/payload.py", line 924, in failed_post [2025-12-04 07:21:10] set_pilot_state(job=job, state='stageout') [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/auxiliary.py", line 349, in set_pilot_state [2025-12-04 07:21:10] update_condor_classad(state=state) [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/condor.py", line 106, in update_condor_classad [2025-12-04 07:21:10] path = find_condor_chirp() [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/condor.py", line 261, in find_condor_chirp [2025-12-04 07:21:10] if Path(p).is_file() and os.access(p, os.X_OK): [2025-12-04 07:21:10] File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/lib/python3.9/pathlib.py", line 1456, in is_file [2025-12-04 07:21:10] File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/lib/python3.9/pathlib.py", line 1232, in stat [2025-12-04 07:21:10] unexpected exception caught by thread run() function: (<class 'OSError'>, OSError(107, 'Transport endpoint is not connected'), <traceback object at 0x7517510e47c0>) [2025-12-04 07:21:10] Traceback (most recent call last): [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/common/exception.py", line 466, in run [2025-12-04 07:21:10] self._target(**self.kwargs) [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/control/payload.py", line 924, in failed_post [2025-12-04 07:21:10] set_pilot_state(job=job, state='stageout') [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/auxiliary.py", line 349, in set_pilot_state [2025-12-04 07:21:10] update_condor_classad(state=state) [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/condor.py", line 106, in update_condor_classad [2025-12-04 07:21:10] path = find_condor_chirp() [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/condor.py", line 261, in find_condor_chirp [2025-12-04 07:21:10] if Path(p).is_file() and os.access(p, os.X_OK): [2025-12-04 07:21:10] File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/lib/python3.9/pathlib.py", line 1456, in is_file [2025-12-04 07:21:10] File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/lib/python3.9/pathlib.py", line 1232, in stat [2025-12-04 07:21:10] OSError: [Errno 107] Transport endpoint is not connected: '/usr/bin/condor_config_val' [2025-12-04 07:21:10] [2025-12-04 07:21:10] None [2025-12-04 07:21:10] exception has been put in bucket queue belonging to thread 'failed_post' [2025-12-04 07:21:10] setting graceful stop in 10 s since there is no point in continuing [2025-12-04 07:21:10] 2025-12-04 14:19:58,824 | WARNING | process 441572 can no longer be monitored (due to stat problems) - aborting [2025-12-04 07:21:10] 2025-12-04 14:19:58,825 | INFO | using path: /var/lib/boinc-client/slots/0/PanDA_Pilot-6897139739/memory_monitor_summary.json (trf name=prmon) [2025-12-04 07:21:10] 2025-12-04 14:19:59,012 | INFO | time since job start (55s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:19:59,908 | WARNING | thread 'failed_post' received an exception from bucket: [Errno 107] Transport endpoint is not connected: '/usr/bin/condor_config_val' [2025-12-04 07:21:10] 2025-12-04 14:20:01,018 | INFO | time since job start (57s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:20:01,328 | INFO | monitor loop #9: job 0:6897139739 is in state 'failed' [2025-12-04 07:21:10] 2025-12-04 14:20:01,328 | INFO | will abort job monitoring soon since job state=failed (job is still in queue) [2025-12-04 07:21:10] 2025-12-04 14:20:03,023 | INFO | time since job start (59s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:20:03,831 | INFO | monitor loop #10: job 0:6897139739 is in state 'failed' [2025-12-04 07:21:10] 2025-12-04 14:20:03,831 | INFO | will abort job monitoring soon since job state=failed (job is still in queue) [2025-12-04 07:21:10] 2025-12-04 14:20:05,028 | INFO | time since job start (61s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:20:06,334 | INFO | monitor loop #11: job 0:6897139739 is in state 'failed' [2025-12-04 07:21:10] 2025-12-04 14:20:06,335 | INFO | will abort job monitoring soon since job state=failed (job is still in queue) [2025-12-04 07:21:10] 2025-12-04 14:20:07,033 | INFO | time since job start (63s) is within the limit (172800.0s) [2025-12-04 07:21:10] 2025-12-04 14:20:08,600 | WARNING | aborting monitor loop since graceful_stop has been set (timing out remaining threads) [2025-12-04 07:21:10] 2025-12-04 14:20:08,601 | INFO | found 1 job(s) in 20 queues [2025-12-04 07:21:10] 2025-12-04 14:20:08,601 | INFO | aborting job 6897139739 [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/common/exception.py", line 466, in run [2025-12-04 07:21:10] self._target(**self.kwargs) [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/control/monitor.py", line 247, in control [2025-12-04 07:21:10] raise PilotException(error) from error [2025-12-04 07:21:10] monitor: exception caught: [Errno 107] Transport endpoint is not connected: '/usr/bin/condor_config_val' [2025-12-04 07:21:10] unexpected exception caught by thread run() function: (<class 'pilot.common.exception.PilotException'>, PilotException(OSError(107, 'Transport endpoint is not connected')), <traceback object at 0x7517 [2025-12-04 07:21:10] Traceback (most recent call last): [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/control/monitor.py", line 143, in control [2025-12-04 07:21:10] run_checks(queues, args) [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/control/monitor.py", line 457, in run_checks [2025-12-04 07:21:10] abort_jobs_in_queues(queues, args.signal) [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/queuehandling.py", line 190, in abort_jobs_in_queues [2025-12-04 07:21:10] declare_failed_by_kill(job, queues.failed_jobs, sig) [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/queuehandling.py", line 65, in declare_failed_by_kill [2025-12-04 07:21:10] set_pilot_state(job=job, state="failed") [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/auxiliary.py", line 349, in set_pilot_state [2025-12-04 07:21:10] update_condor_classad(state=state) [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/condor.py", line 106, in update_condor_classad [2025-12-04 07:21:10] path = find_condor_chirp() [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/util/condor.py", line 261, in find_condor_chirp [2025-12-04 07:21:10] if Path(p).is_file() and os.access(p, os.X_OK): [2025-12-04 07:21:10] File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/lib/python3.9/pathlib.py", line 1456, in is_file [2025-12-04 07:21:10] File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/lib/python3.9/pathlib.py", line 1232, in stat [2025-12-04 07:21:10] OSError: [Errno 107] Transport endpoint is not connected: '/usr/bin/condor_config_val' [2025-12-04 07:21:10] [2025-12-04 07:21:10] The above exception was the direct cause of the following exception: [2025-12-04 07:21:10] [2025-12-04 07:21:10] Traceback (most recent call last): [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/common/exception.py", line 466, in run [2025-12-04 07:21:10] self._target(**self.kwargs) [2025-12-04 07:21:10] File "/var/lib/boinc-client/slots/0/pilot3/pilot/control/monitor.py", line 247, in control [2025-12-04 07:21:10] raise PilotException(error) from error [2025-12-04 07:21:10] pilot.common.exception.PilotException: error code: 1301, message: An unknown pilot exception has occurred [2025-12-04 07:21:10] details: [Errno 107] Transport endpoint is not connected: '/usr/bin/condor_config_val' [2025-12-04 07:21:10] [2025-12-04 07:21:10] None [2025-12-04 07:21:10] exception has been put in bucket queue belonging to thread 'monitor' [2025-12-04 07:21:10] setting graceful stop in 10 s since there is no point in continuing [2025-12-04 07:21:10] 2025-12-04 14:20:08,696 | INFO | all data control threads have been joined [2025-12-04 07:21:10] 2025-12-04 14:20:08,837 | INFO | monitor loop #12: job 0:6897139739 is in state 'failed' [2025-12-04 07:21:10] 2025-12-04 14:20:08,838 | INFO | will abort job monitoring soon since job state=failed (job is still in queue) [2025-12-04 07:21:10] 2025-12-04 14:20:08,838 | WARNING | job:job_monitor:received graceful stop - abort after this iteration [2025-12-04 07:21:10] 2025-12-04 14:20:08,838 | INFO | will abort loop [2025-12-04 07:21:10] received exception from bucket queue in generic workflow: error code: 1301, message: An unknown pilot exception has occurred [2025-12-04 07:21:10] details: [Errno 107] Transport endpoint is not connected: '/usr/bin/condor_config_val' [2025-12-04 07:21:10] 2025-12-04 14:20:09,119 | WARNING | data:copytool_out:received graceful stop - abort after this iteration [2025-12-04 07:21:10] 2025-12-04 14:20:09,543 | WARNING | job:queue_monitor:received graceful stop - abort after this iteration [2025-12-04 07:21:10] 2025-12-04 14:20:09,543 | WARNING | since job:queue_monitor is responsible for sending job updates, we sleep for 20 s [2025-12-04 07:21:10] 2025-12-04 14:20:09,701 | INFO | [data] control thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:09,739 | INFO | all payload control threads have been joined [2025-12-04 07:21:10] 2025-12-04 14:20:09,753 | INFO | [data] copytool_in thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:09,805 | INFO | [payload] run_realtimelog thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:09,811 | INFO | [job] retrieve thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:09,842 | INFO | [job] job monitor thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:09,875 | INFO | [job] validate thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:10,038 | INFO | [job] create_data_payload thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:10,145 | INFO | all job control threads have been joined [2025-12-04 07:21:10] 2025-12-04 14:20:10,189 | INFO | [payload] validate_pre thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:10,263 | INFO | [payload] validate_post thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:10,745 | INFO | [payload] control thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:11,124 | INFO | [data] copytool_out thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:11,150 | INFO | [job] control thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:11,590 | WARNING | data:queue_monitoring:received graceful stop - abort after this iteration [2025-12-04 07:21:10] 2025-12-04 14:20:14,425 | INFO | [payload] execute_payloads thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:15,595 | INFO | [data] queue_monitor thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:32,647 | INFO | [job] queue monitor thread has finished [2025-12-04 07:21:10] 2025-12-04 14:20:33,931 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:20:36,036 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:20:38,146 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:20:40,256 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:20:42,365 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:20:44,475 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:20:46,585 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:20:48,694 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:20:50,803 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:20:52,912 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:20:55,022 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:20:57,132 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:20:59,238 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:21:01,344 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:21:03,454 | INFO | waiting for thread to finish: ['<_MainThread(MainThread, started 128743062501184)>', '<ExcThread(cgroup_monitor, started 128742349321984)>'] [2025-12-04 07:21:10] 2025-12-04 14:21:03,738 | INFO | [monitor] cgroup control has ended [2025-12-04 07:21:10] 2025-12-04 14:21:05,464 | INFO | caller=run is remaining thread - safe to abort (names=['<_MainThread(MainThread, started 128743062501184)>']) [2025-12-04 07:21:10] 2025-12-04 14:21:10,484 | INFO | all workflow threads have been joined [2025-12-04 07:21:10] 2025-12-04 14:21:10,484 | INFO | end of generic workflow (traces error code: 0) [2025-12-04 07:21:10] 2025-12-04 14:21:10,484 | INFO | traces error code: 0 [2025-12-04 07:21:10] 2025-12-04 14:21:10,484 | INFO | pilot has finished (exit code=0, shell exit code=0) [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 15: date: command not found [2025-12-04 07:21:10] ==== pilot stdout END ==== [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 15: date: command not found [2025-12-04 07:21:10] ==== wrapper stdout RESUME ==== [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 15: date: command not found [2025-12-04 07:21:10] pilotpid: 434891 [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 15: date: command not found [2025-12-04 07:21:10] Pilot exit status: 0 [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 1018: /usr/bin/cat: Transport endpoint is not connected [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 1018: xargs: command not found [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 1018: cut: command not found [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 15: date: command not found [2025-12-04 07:21:10] pandaids: [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 27: ps: command not found [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 15: date: command not found [2025-12-04 07:21:10] No supervise_pilot CHILD process found [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 15: date: command not found [2025-12-04 07:21:10] Test setup, not cleaning [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 15: date: command not found [2025-12-04 07:21:10] apfmon messages muted [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 15: date: command not found [2025-12-04 07:21:10] ==== wrapper stdout END ==== [2025-12-04 07:21:10] ./runpilot2-wrapper.sh: line 10: date: command not found [2025-12-04 07:21:10] ==== wrapper stderr END ==== [2025-12-04 07:21:10] *** Error codes and diagnostics *** [2025-12-04 07:21:10] *** Listing of results directory *** [2025-12-04 07:21:10] total 405048 [2025-12-04 07:21:10] -rw-r--r-- 1 boinc boinc 576529 Nov 25 09:48 pilot3.tar.gz [2025-12-04 07:21:10] -rw-r--r-- 1 boinc boinc 5112 Nov 25 09:55 queuedata.json [2025-12-04 07:21:10] -rwx------ 1 boinc boinc 36292 Nov 25 09:56 runpilot2-wrapper.sh [2025-12-04 07:21:10] -rw-r--r-- 1 boinc boinc 100 Dec 4 07:18 wrapper_26015_x86_64-pc-linux-gnu [2025-12-04 07:21:10] -rwxr-xr-x 1 boinc boinc 7986 Dec 4 07:18 run_atlas [2025-12-04 07:21:10] -rw-r--r-- 1 boinc boinc 105 Dec 4 07:18 job.xml [2025-12-04 07:21:10] -rw-r--r-- 1 boinc boinc 9699 Dec 4 07:18 init_data.xml [2025-12-04 07:21:10] -rw-r--r-- 2 boinc boinc 410790302 Dec 4 07:18 EVNT.47483658._002198.pool.root.1 [2025-12-04 07:21:10] -rw-r--r-- 2 boinc boinc 15847 Dec 4 07:18 start_atlas.sh [2025-12-04 07:21:10] drwxrwx--x 2 boinc boinc 4096 Dec 4 07:18 shared [2025-12-04 07:21:10] -rw-r--r-- 2 boinc boinc 590110 Dec 4 07:18 input.tar.gz [2025-12-04 07:21:10] -rw-r--r-- 1 boinc boinc 0 Dec 4 07:18 boinc_lockfile [2025-12-04 07:21:10] -rw-r--r-- 1 boinc boinc 2786 Dec 4 07:18 pandaJob.out [2025-12-04 07:21:10] -rw------- 1 boinc boinc 985572 Dec 4 07:19 agis_schedconf.cvmfs.json [2025-12-04 07:21:10] -rw------- 1 boinc boinc 1516240 Dec 4 07:19 agis_ddmendpoints.agis.ALL.json [2025-12-04 07:21:10] drwx------ 5 boinc boinc 4096 Dec 4 07:19 pilot3 [2025-12-04 07:21:10] -rw------- 1 boinc boinc 553 Dec 4 07:19 heartbeat.json [2025-12-04 07:21:10] -rw-r--r-- 1 boinc boinc 523 Dec 4 07:19 boinc_task_state.xml [2025-12-04 07:21:10] drwxrwx--- 2 boinc boinc 4096 Dec 4 07:19 PanDA_Pilot-6897139739 [2025-12-04 07:21:10] -rw------- 1 boinc boinc 95 Dec 4 07:20 pilot_heartbeat.json [2025-12-04 07:21:10] -rw-r--r-- 1 boinc boinc 23 Dec 4 07:21 wrapper_checkpoint.txt [2025-12-04 07:21:10] -rw-r--r-- 1 boinc boinc 8192 Dec 4 07:21 boinc_mmap_file [2025-12-04 07:21:10] -rw------- 1 boinc boinc 41899 Dec 4 07:21 pilotlog.txt [2025-12-04 07:21:10] -rw------- 1 boinc boinc 59532 Dec 4 07:21 log.47556161._001819.job.log.1 [2025-12-04 07:21:10] -rw-r--r-- 1 boinc boinc 428 Dec 4 07:21 runtime_log [2025-12-04 07:21:10] -rw------- 1 boinc boinc 612 Dec 4 07:21 5cMKDmcWBi8n9Rq4apOajLDm4fhM0noT9bVo0NGKDmXYJKDmQdT8cn.diag [2025-12-04 07:21:10] -rw-r--r-- 1 boinc boinc 18216 Dec 4 07:21 runtime_log.err [2025-12-04 07:21:10] -rw-r--r-- 1 boinc boinc 24290 Dec 4 07:21 stderr.txt [2025-12-04 07:21:10] No HITS result produced [2025-12-04 07:21:10] *** Contents of shared directory: *** [2025-12-04 07:21:10] total 401764 [2025-12-04 07:21:10] -rw-r--r-- 2 boinc boinc 410790302 Dec 4 07:18 ATLAS.root_0 [2025-12-04 07:21:10] -rw-r--r-- 2 boinc boinc 15847 Dec 4 07:18 start_atlas.sh [2025-12-04 07:21:10] -rw-r--r-- 2 boinc boinc 590110 Dec 4 07:18 input.tar.gz 07:21:11 (431045): run_atlas exited; CPU time 22.737811 07:21:11 (431045): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>5cMKDmcWBi8n9Rq4apOajLDm4fhM0noT9bVo0NGKDmXYJKDmQdT8cn_4_r2069662767_ATLAS_result</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>
©2025 CERN