| Name | RdFNDm5nN76n9Rq4apOajLDm4fhM0noT9bVoFjIUDmqkgKDmeEGQtn_0 |
| Workunit | 230565743 |
| Created | 26 Feb 2025, 4:02:37 UTC |
| Sent | 26 Feb 2025, 4:02:40 UTC |
| Report deadline | 6 Mar 2025, 4:02:40 UTC |
| Received | 26 Feb 2025, 9:10:58 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 10804959 |
| Run time | 4 hours 41 min 12 sec |
| CPU time | 16 hours 38 min 35 sec |
| Validate state | Valid |
| Credit | 503.95 |
| Device peak FLOPS | 43.02 GFLOPS |
| Application version | ATLAS Simulation v3.01 (native_mt) x86_64-pc-linux-gnu |
| Peak working set size | 2.35 GB |
| Peak swap size | 3.03 GB |
| Peak disk usage | 906.28 MB |
Stderr output
<core_client_version>7.7.0</core_client_version>
<![CDATA[
<stderr_txt>
23:02:56 (85082): wrapper (7.7.26015): starting
23:02:56 (85082): wrapper: running run_atlas (--nthreads 8)
[2025-02-25 23:02:57] Arguments: --nthreads 8
[2025-02-25 23:02:57] Threads: 8
[2025-02-25 23:02:57] Checking for CVMFS
[2025-02-25 23:02:57] Probing /cvmfs/atlas.cern.ch... OK
[2025-02-25 23:02:57] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-02-25 23:02:57] Running cvmfs_config stat atlas.cern.ch
[2025-02-25 23:02:57] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-02-25 23:02:57] 2.11.2.0 86076 459 138424 143061 0 251 16582013 18432000 17919 130560 0 1678803 97.603 11907353 46349 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2025-02-25 23:02:57] CVMFS is ok
[2025-02-25 23:02:57] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-02-25 23:02:57] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-02-25 23:02:57] Further information can be found at the LHC@home message board.
[2025-02-25 23:02:57] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-02-25 23:02:57] Checking for apptainer binary...
[2025-02-25 23:02:57] Using apptainer found in PATH at /usr/bin/apptainer
[2025-02-25 23:02:57] Running /usr/bin/apptainer --version
[2025-02-25 23:02:57] apptainer version 1.3.2-1.el7
[2025-02-25 23:02:57] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-02-25 23:02:58] c-212-13.aglt2.org
[2025-02-25 23:02:58] apptainer works
[2025-02-25 23:02:58] Set ATHENA_PROC_NUMBER=8
[2025-02-25 23:02:58] Set ATHENA_CORE_NUMBER=8
[2025-02-25 23:02:58] Starting ATLAS job with PandaID=6531427985
[2025-02-25 23:02:58] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
00:34:00 (85082): BOINC client no longer exists - exiting
00:34:00 (85082): timer handler: client dead, exiting
00:48:20 (60940): wrapper (7.7.26015): starting
00:48:20 (60940): wrapper: running run_atlas (--nthreads 8)
[2025-02-26 00:48:20] Arguments: --nthreads 8
[2025-02-26 00:48:20] Threads: 8
[2025-02-26 00:48:20] This job has been restarted, cleaning up previous attempt
[2025-02-26 00:48:20] Checking for CVMFS
[2025-02-26 00:48:21] Probing /cvmfs/atlas.cern.ch... OK
[2025-02-26 00:48:21] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-02-26 00:48:21] Running cvmfs_config stat atlas.cern.ch
[2025-02-26 00:48:21] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-02-26 00:48:21] 2.11.2.0 86076 565 85600 143064 3 75 16818742 18432001 21296 130560 0 1878689 97.857 11985715 46488 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2025-02-26 00:48:21] CVMFS is ok
[2025-02-26 00:48:21] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-02-26 00:48:21] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-02-26 00:48:21] Further information can be found at the LHC@home message board.
[2025-02-26 00:48:21] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-02-26 00:48:21] Checking for apptainer binary...
[2025-02-26 00:48:21] Using apptainer found in PATH at /usr/bin/apptainer
[2025-02-26 00:48:21] Running /usr/bin/apptainer --version
[2025-02-26 00:48:21] apptainer version 1.3.2-1.el7
[2025-02-26 00:48:21] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-02-26 00:48:23] c-212-13.aglt2.org
[2025-02-26 00:48:23] apptainer works
[2025-02-26 00:48:23] Set ATHENA_PROC_NUMBER=8
[2025-02-26 00:48:23] Set ATHENA_CORE_NUMBER=8
[2025-02-26 00:48:23] Starting ATLAS job with PandaID=6531427985
[2025-02-26 00:48:23] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
01:11:32 (56765): wrapper (7.7.26015): starting
01:11:32 (56765): wrapper: running run_atlas (--nthreads 8)
[2025-02-26 01:11:32] Arguments: --nthreads 8
[2025-02-26 01:11:32] Threads: 8
[2025-02-26 01:11:32] This job has been restarted, cleaning up previous attempt
[2025-02-26 01:11:32] Checking for CVMFS
[2025-02-26 01:11:33] Probing /cvmfs/atlas.cern.ch... OK
[2025-02-26 01:11:33] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-02-26 01:11:33] Running cvmfs_config stat atlas.cern.ch
[2025-02-26 01:11:34] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-02-26 01:11:34] 2.11.2.0 86076 588 88996 143064 0 220 16840663 18432000 21296 130560 0 2218744 98.178 11985808 46487 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2025-02-26 01:11:34] CVMFS is ok
[2025-02-26 01:11:34] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-02-26 01:11:34] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-02-26 01:11:34] Further information can be found at the LHC@home message board.
[2025-02-26 01:11:34] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-02-26 01:11:34] Checking for apptainer binary...
[2025-02-26 01:11:34] Using apptainer found in PATH at /usr/bin/apptainer
[2025-02-26 01:11:34] Running /usr/bin/apptainer --version
[2025-02-26 01:11:34] apptainer version 1.3.2-1.el7
[2025-02-26 01:11:34] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-02-26 01:11:36] c-212-13.aglt2.org
[2025-02-26 01:11:36] apptainer works
[2025-02-26 01:11:36] Set ATHENA_PROC_NUMBER=8
[2025-02-26 01:11:36] Set ATHENA_CORE_NUMBER=8
[2025-02-26 01:11:36] Starting ATLAS job with PandaID=6531427985
[2025-02-26 01:11:36] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2025-02-26 04:10:10] *** The last 200 lines of the pilot log: ***
[2025-02-26 04:10:10] 2025-02-26 09:09:54,366 | INFO | current chi2=5.918796332186231 (change=12.256098017760678 %)
[2025-02-26 04:10:10] 2025-02-26 09:09:54,366 | INFO | right removable region: 168
[2025-02-26 04:10:10] 2025-02-26 09:09:54,366 | INFO | model: linear, x: [1740550668.0, 1740550729.0, 1740550790.0, 1740550851.0, 1740550912.0, 1740550973.0, 1740551034.0, 1740551095.0, 1740551156.0, 1740551217.0, 1740
[2025-02-26 04:10:10] 2025-02-26 09:09:54,366 | INFO | sum of square deviations: 1496651229.9053235
[2025-02-26 04:10:10] 2025-02-26 09:09:54,367 | INFO | sum of deviations: 51357623997.51483
[2025-02-26 04:10:10] 2025-02-26 09:09:54,367 | INFO | mean x: 1740555792.0236685
[2025-02-26 04:10:10] 2025-02-26 09:09:54,367 | INFO | mean y: 2425981.6213017753
[2025-02-26 04:10:10] 2025-02-26 09:09:54,367 | INFO | -- intersect: -59724789101.817314
[2025-02-26 04:10:10] 2025-02-26 09:09:54,367 | INFO | intersect: -59724789101.817314
[2025-02-26 04:10:10] 2025-02-26 09:09:54,367 | INFO | chi2: 3.5487382646278163
[2025-02-26 04:10:10] 2025-02-26 09:09:54,367 | INFO | current chi2=3.5487382646278163 (change=47.39130644539167 %)
[2025-02-26 04:10:10] 2025-02-26 09:09:54,367 | INFO | model: linear, x: [1740550973.0, 1740551034.0, 1740551095.0, 1740551156.0, 1740551217.0, 1740551278.0, 1740551339.0, 1740551400.0, 1740551461.0, 1740551522.0, 1740
[2025-02-26 04:10:10] 2025-02-26 09:09:54,368 | INFO | sum of square deviations: 1367698754.9024348
[2025-02-26 04:10:10] 2025-02-26 09:09:54,368 | INFO | sum of deviations: 14056044984.097582
[2025-02-26 04:10:10] 2025-02-26 09:09:54,368 | INFO | mean x: 1740555944.5243902
[2025-02-26 04:10:10] 2025-02-26 09:09:54,369 | INFO | mean y: 2470104.475609756
[2025-02-26 04:10:10] 2025-02-26 09:09:54,369 | INFO | -- intersect: -17885484071.01717
[2025-02-26 04:10:10] 2025-02-26 09:09:54,369 | INFO | intersect: -17885484071.01717
[2025-02-26 04:10:10] 2025-02-26 09:09:54,369 | INFO | chi2: 1.7194619045941502
[2025-02-26 04:10:10] 2025-02-26 09:09:54,369 | INFO | current chi2=1.7194619045941502 (change=51.54723238586085 %)
[2025-02-26 04:10:10] 2025-02-26 09:09:54,369 | INFO | model: linear, x: [1740551278.0, 1740551339.0, 1740551400.0, 1740551461.0, 1740551522.0, 1740551583.0, 1740551644.0, 1740551705.0, 1740551766.0, 1740551827.0, 1740
[2025-02-26 04:10:10] 2025-02-26 09:09:54,369 | INFO | sum of square deviations: 1246374329.8993716
[2025-02-26 04:10:10] 2025-02-26 09:09:54,370 | INFO | sum of deviations: -7237668141.647799
[2025-02-26 04:10:10] 2025-02-26 09:09:54,370 | INFO | mean x: 1740556097.0251572
[2025-02-26 04:10:10] 2025-02-26 09:09:54,370 | INFO | mean y: 2496583.9119496853
[2025-02-26 04:10:10] 2025-02-26 09:09:54,370 | INFO | -- intersect: 10109867307.125498
[2025-02-26 04:10:10] 2025-02-26 09:09:54,370 | INFO | intersect: 10109867307.125498
[2025-02-26 04:10:10] 2025-02-26 09:09:54,371 | INFO | chi2: 0.8840455312776337
[2025-02-26 04:10:10] 2025-02-26 09:09:54,371 | INFO | current chi2=0.8840455312776337 (change=48.58591929745034 %)
[2025-02-26 04:10:10] 2025-02-26 09:09:54,371 | INFO | model: linear, x: [1740551583.0, 1740551644.0, 1740551705.0, 1740551766.0, 1740551827.0, 1740551888.0, 1740551949.0, 1740552010.0, 1740552071.0, 1740552132.0, 1740
[2025-02-26 04:10:10] 2025-02-26 09:09:54,371 | INFO | sum of square deviations: 1132445392.3961
[2025-02-26 04:10:10] 2025-02-26 09:09:54,372 | INFO | sum of deviations: -8394100157.38961
[2025-02-26 04:10:10] 2025-02-26 09:09:54,372 | INFO | mean x: 1740556249.525974
[2025-02-26 04:10:10] 2025-02-26 09:09:54,372 | INFO | mean y: 2498122.5974025973
[2025-02-26 04:10:10] 2025-02-26 09:09:54,372 | INFO | -- intersect: 12904138754.626312
[2025-02-26 04:10:10] 2025-02-26 09:09:54,372 | INFO | intersect: 12904138754.626312
[2025-02-26 04:10:10] 2025-02-26 09:09:54,372 | INFO | chi2: 0.8822467959022012
[2025-02-26 04:10:10] 2025-02-26 09:09:54,372 | INFO | current chi2=0.8822467959022012 (change=0.20346637269156928 %)
[2025-02-26 04:10:10] 2025-02-26 09:09:54,372 | INFO | left removable region: 40
[2025-02-26 04:10:10] 2025-02-26 09:09:54,372 | INFO | model: linear, x: [1740552803.0, 1740552864.0, 1740552925.0, 1740552986.0, 1740553047.0, 1740553108.0, 1740553169.0, 1740553230.0, 1740553291.0, 1740553352.0, 1740
[2025-02-26 04:10:10] 2025-02-26 09:09:54,373 | INFO | sum of square deviations: 650235725.875
[2025-02-26 04:10:10] 2025-02-26 09:09:54,373 | INFO | sum of deviations: 560195594.1875
[2025-02-26 04:10:10] 2025-02-26 09:09:54,373 | INFO | mean x: 1740556676.53125
[2025-02-26 04:10:10] 2025-02-26 09:09:54,373 | INFO | mean y: 2516016.453125
[2025-02-26 04:10:10] 2025-02-26 09:09:54,373 | INFO | -- intersect: -1497020448.2871804
[2025-02-26 04:10:10] 2025-02-26 09:09:54,373 | INFO | intersect: -1497020448.2871804
[2025-02-26 04:10:10] 2025-02-26 09:09:54,374 | INFO | chi2: 0.00016394030706003805
[2025-02-26 04:10:10] 2025-02-26 09:09:54,374 | INFO | -- intersect: -1497020448.2871804
[2025-02-26 04:10:10] 2025-02-26 09:09:54,374 | INFO | current memory leak: 0.86 B/s (using 128 data points, chi2=0.00)
[2025-02-26 04:10:10] 2025-02-26 09:09:54,374 | INFO | ..............................
[2025-02-26 04:10:10] 2025-02-26 09:09:54,374 | INFO | . Timing measurements:
[2025-02-26 04:10:10] 2025-02-26 09:09:54,374 | INFO | . get job = 0 s
[2025-02-26 04:10:10] 2025-02-26 09:09:54,374 | INFO | . initial setup = 1 s
[2025-02-26 04:10:10] 2025-02-26 09:09:54,375 | INFO | . payload setup = 12 s
[2025-02-26 04:10:10] 2025-02-26 09:09:54,375 | INFO | . stage-in = 0 s
[2025-02-26 04:10:10] 2025-02-26 09:09:54,375 | INFO | . payload execution = 10603 s
[2025-02-26 04:10:10] 2025-02-26 09:09:54,375 | INFO | . stage-out = 4 s
[2025-02-26 04:10:10] 2025-02-26 09:09:54,375 | INFO | . log creation = 0 s
[2025-02-26 04:10:10] 2025-02-26 09:09:54,375 | INFO | ..............................
[2025-02-26 04:10:10] 2025-02-26 09:09:54,465 | INFO |
[2025-02-26 04:10:10] 2025-02-26 09:09:54,465 | INFO | job summary report
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | --------------------------------------------------
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | PanDA job id: 6531427985
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | task id: 43401171
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | errors: (none)
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | status: LOG_TRANSFER = DONE
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | pilot state: finished
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | transexitcode: 0
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | exeerrorcode: 0
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | exeerrordiag:
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | exitcode: 0
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | exitmsg: OK
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | cpuconsumptiontime: 35758 s
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | nevents: 400
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | neventsw: 0
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | pid: 26591
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | pgrp: 26591
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | corecount: 8
[2025-02-26 04:10:10] 2025-02-26 09:09:54,466 | INFO | event service: False
[2025-02-26 04:10:10] 2025-02-26 09:09:54,467 | INFO | sizes: {0: 2370162, 1: 2370361, 8: 2370567, 11: 2370595, 10620: 2399380, 10626: 2409404, 10660: 2409518}
[2025-02-26 04:10:10] 2025-02-26 09:09:54,467 | INFO | --------------------------------------------------
[2025-02-26 04:10:10] 2025-02-26 09:09:54,467 | INFO |
[2025-02-26 04:10:10] 2025-02-26 09:09:54,467 | INFO | executing command: ls -lF /tmp/boinchome/slots/0
[2025-02-26 04:10:10] 2025-02-26 09:09:54,555 | INFO | queue jobs had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,555 | INFO | queue payloads had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,555 | INFO | queue data_in had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,555 | INFO | queue data_out had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,555 | INFO | queue current_data_in had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,555 | INFO | queue validated_jobs had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,555 | INFO | queue validated_payloads had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | queue monitored_payloads had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | queue finished_jobs had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | queue finished_payloads had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | queue finished_data_in had 1 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | queue finished_data_out had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | queue failed_jobs had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | queue failed_payloads had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | queue failed_data_in had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | queue failed_data_out had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | queue completed_jobs had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | queue completed_jobids has 1 job(s)
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | queue realtimelog_payloads had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | queue messages had 0 job(s) [purged]
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | job 6531427985 has completed (purged errors)
[2025-02-26 04:10:10] 2025-02-26 09:09:54,556 | INFO | overall cleanup function is called
[2025-02-26 04:10:10] 2025-02-26 09:09:54,681 | WARNING | process 26591 can no longer be monitored (due to stat problems) - aborting
[2025-02-26 04:10:10] 2025-02-26 09:09:54,906 | INFO | using path: /tmp/boinchome/slots/0/memory_monitor_summary.json (trf name=prmon)
[2025-02-26 04:10:10] 2025-02-26 09:09:54,908 | INFO | skipping file size check of payload stdout file (/tmp/boinchome/slots/0/PanDA_Pilot-6531427985/payload.stdout) since it has not been created yet
[2025-02-26 04:10:10] 2025-02-26 09:09:54,908 | INFO | executing command: df -mP /tmp/boinchome/slots/0
[2025-02-26 04:10:10] 2025-02-26 09:09:55,022 | INFO | sufficient remaining disk space (104547221504 B)
[2025-02-26 04:10:10] 2025-02-26 09:09:55,022 | WARNING | skipping size check of workdir since it has not been created yet
[2025-02-26 04:10:10] 2025-02-26 09:09:55,022 | INFO | output file size check: skipping output file /tmp/boinchome/slots/0/PanDA_Pilot-6531427985/HITS.43401171._002280.pool.root.1 since it does not exist
[2025-02-26 04:10:10] 2025-02-26 09:09:55,563 | INFO | --- collectZombieJob: --- 10, [26591]
[2025-02-26 04:10:10] 2025-02-26 09:09:55,564 | INFO | zombie collector waiting for pid 26591
[2025-02-26 04:10:10] 2025-02-26 09:09:55,564 | INFO | harmless exception when collecting zombies: [Errno 10] No child processes
[2025-02-26 04:10:10] 2025-02-26 09:09:55,564 | INFO | collected zombie processes
[2025-02-26 04:10:10] 2025-02-26 09:09:55,564 | INFO | will attempt to kill all subprocesses of pid=26591
[2025-02-26 04:10:10] 2025-02-26 09:09:55,755 | INFO | number of running child processes to parent process 26591: 1
[2025-02-26 04:10:10] 2025-02-26 09:09:55,756 | INFO | maximum number of monitored processes: 6
[2025-02-26 04:10:10] 2025-02-26 09:09:55,756 | INFO | aborting job monitoring since job object (job id=6531427985) has expired
[2025-02-26 04:10:10] 2025-02-26 09:09:55,920 | INFO | process IDs to be killed: [26591] (in reverse order)
[2025-02-26 04:10:10] 2025-02-26 09:09:56,112 | WARNING | found no corresponding commands to process id(s)
[2025-02-26 04:10:10] 2025-02-26 09:09:56,113 | INFO | Do not look for orphan processes in BOINC jobs
[2025-02-26 04:10:10] 2025-02-26 09:09:56,122 | INFO | did not find any defunct processes belonging to 26591
[2025-02-26 04:10:10] 2025-02-26 09:09:56,130 | INFO | did not find any defunct processes belonging to 26591
[2025-02-26 04:10:10] 2025-02-26 09:09:56,131 | INFO | ready for new job
[2025-02-26 04:10:10] 2025-02-26 09:09:56,131 | INFO | pilot has finished with previous job - re-establishing logging
[2025-02-26 04:10:10] 2025-02-26 09:09:56,132 | INFO | **************************************
[2025-02-26 04:10:10] 2025-02-26 09:09:56,132 | INFO | *** PanDA Pilot version 3.9.4.15 ***
[2025-02-26 04:10:10] 2025-02-26 09:09:56,132 | INFO | **************************************
[2025-02-26 04:10:10] 2025-02-26 09:09:56,132 | INFO |
[2025-02-26 04:10:10] 2025-02-26 09:09:56,137 | INFO | architecture information:
[2025-02-26 04:10:10] 2025-02-26 09:09:56,137 | INFO | executing command: cat /etc/os-release
[2025-02-26 04:10:10] 2025-02-26 09:09:56,230 | INFO | cat /etc/os-release:
[2025-02-26 04:10:10] NAME="CentOS Linux"
[2025-02-26 04:10:10] VERSION="7 (Core)"
[2025-02-26 04:10:10] ID="centos"
[2025-02-26 04:10:10] ID_LIKE="rhel fedora"
[2025-02-26 04:10:10] VERSION_ID="7"
[2025-02-26 04:10:10] PRETTY_NAME="CentOS Linux 7 (Core)"
[2025-02-26 04:10:10] ANSI_COLOR="0;31"
[2025-02-26 04:10:10] CPE_NAME="cpe:/o:centos:centos:7"
[2025-02-26 04:10:10] HOME_URL="https://www.centos.org/"
[2025-02-26 04:10:10] BUG_REPORT_URL="https://bugs.centos.org/"
[2025-02-26 04:10:10]
[2025-02-26 04:10:10] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2025-02-26 04:10:10] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2025-02-26 04:10:10] REDHAT_SUPPORT_PRODUCT="centos"
[2025-02-26 04:10:10] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2025-02-26 04:10:10]
[2025-02-26 04:10:10] 2025-02-26 09:09:56,230 | INFO | **************************************
[2025-02-26 04:10:10] 2025-02-26 09:09:56,733 | INFO | executing command: df -mP /tmp/boinchome/slots/0
[2025-02-26 04:10:10] 2025-02-26 09:09:56,847 | INFO | sufficient remaining disk space (104548270080 B)
[2025-02-26 04:10:10] 2025-02-26 09:09:56,847 | WARNING | since timefloor is set to 0, pilot was only allowed to run one job
[2025-02-26 04:10:10] 2025-02-26 09:09:56,847 | WARNING | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2025-02-26 04:10:10] 2025-02-26 09:09:56,848 | WARNING | data:copytool_out:received graceful stop - abort after this iteration
[2025-02-26 04:10:10] 2025-02-26 09:09:56,848 | WARNING | aborting monitor loop since graceful_stop has been set (timing out remaining threads)
[2025-02-26 04:10:10] 2025-02-26 09:09:56,848 | INFO | found 0 job(s) in 20 queues
[2025-02-26 04:10:10] 2025-02-26 09:09:56,848 | WARNING | pilot monitor received instruction that args.graceful_stop has been set
[2025-02-26 04:10:10] 2025-02-26 09:09:56,848 | WARNING | will wait for a maximum of 300 s for threads to finish
[2025-02-26 04:10:10] 2025-02-26 09:09:56,849 | WARNING | job:job_monitor:received graceful stop - abort after this iteration
[2025-02-26 04:10:10] 2025-02-26 09:09:56,849 | INFO | aborting loop
[2025-02-26 04:10:10] 2025-02-26 09:09:56,849 | INFO | all payload control threads have been joined
[2025-02-26 04:10:10] 2025-02-26 09:09:57,311 | INFO | all data control threads have been joined
[2025-02-26 04:10:10] 2025-02-26 09:09:57,853 | INFO | [job] retrieve thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:09:57,854 | INFO | [payload] control thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:09:57,857 | INFO | [job] job monitor thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:09:57,965 | INFO | [payload] failed_post thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:09:57,982 | WARNING | data:queue_monitoring:received graceful stop - abort after this iteration
[2025-02-26 04:10:10] 2025-02-26 09:09:58,024 | INFO | [payload] validate_post thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:09:58,317 | INFO | [data] control thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:09:58,436 | INFO | [payload] execute_payloads thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:09:58,499 | INFO | [payload] run_realtimelog thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:09:58,548 | INFO | all job control threads have been joined
[2025-02-26 04:10:10] 2025-02-26 09:09:58,572 | INFO | [job] validate thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:09:58,854 | INFO | [data] copytool_out thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:09:58,960 | INFO | [payload] validate_pre thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:09:58,964 | INFO | [data] copytool_in thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:09:59,026 | INFO | [job] create_data_payload thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:09:59,479 | WARNING | job:queue_monitor:received graceful stop - abort after this iteration
[2025-02-26 04:10:10] 2025-02-26 09:09:59,554 | INFO | [job] control thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:10:00,485 | INFO | [job] queue monitor thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:10:01,991 | INFO | [data] queue_monitor thread has finished
[2025-02-26 04:10:10] 2025-02-26 09:10:04,052 | INFO | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139852565550912)>', '<ExcThread(monitor, started 139852054001408)>']
[2025-02-26 04:10:10] 2025-02-26 09:10:04,900 | WARNING | job_aborted has been set - aborting pilot monitoring
[2025-02-26 04:10:10] 2025-02-26 09:10:04,901 | INFO | [monitor] control thread has ended
[2025-02-26 04:10:10] 2025-02-26 09:10:09,082 | INFO | all workflow threads have been joined
[2025-02-26 04:10:10] 2025-02-26 09:10:09,082 | INFO | end of generic workflow (traces error code: 0)
[2025-02-26 04:10:10] 2025-02-26 09:10:09,086 | INFO | traces error code: 0
[2025-02-26 04:10:10] 2025-02-26 09:10:09,086 | INFO | pilot has finished (exit code=0, shell exit code=0)
[2025-02-26 04:10:10] 2025-02-26 09:10:09,364 [wrapper] ==== pilot stdout END ====
[2025-02-26 04:10:10] 2025-02-26 09:10:09,400 [wrapper] ==== wrapper stdout RESUME ====
[2025-02-26 04:10:10] 2025-02-26 09:10:09,419 [wrapper] pilotpid: 80003
[2025-02-26 04:10:10] 2025-02-26 09:10:09,423 [wrapper] Pilot exit status: 0
[2025-02-26 04:10:10] 2025-02-26 09:10:09,571 [wrapper] pandaids: 6531427985 6531427985 6531427985
[2025-02-26 04:10:10] 2025-02-26 09:10:09,734 [wrapper] cleanup supervisor_pilot 87737 80004
[2025-02-26 04:10:10] 2025-02-26 09:10:09,760 [wrapper] Test setup, not cleaning
[2025-02-26 04:10:10] 2025-02-26 09:10:09,781 [wrapper] apfmon messages muted
[2025-02-26 04:10:10] 2025-02-26 09:10:09,826 [wrapper] ==== wrapper stdout END ====
[2025-02-26 04:10:10] 2025-02-26 09:10:09,838 [wrapper] ==== wrapper stderr END ====
[2025-02-26 04:10:10] *** Error codes and diagnostics ***
[2025-02-26 04:10:10] "exeErrorCode": 0,
[2025-02-26 04:10:10] "exeErrorDiag": "",
[2025-02-26 04:10:10] "pilotErrorCode": 0,
[2025-02-26 04:10:10] "pilotErrorDiag": "",
[2025-02-26 04:10:10] *** Listing of results directory ***
[2025-02-26 04:10:10] total 681724
[2025-02-26 04:10:10] drwx------ 4 boincer umatlas 4096 Dec 18 06:03 pilot3
[2025-02-26 04:10:10] -rw-r--r-- 1 boincer umatlas 491065 Feb 25 22:46 pilot3.tar.gz
[2025-02-26 04:10:10] -rw-r--r-- 1 boincer umatlas 5118 Feb 25 22:59 queuedata.json
[2025-02-26 04:10:10] -rwx------ 1 boincer umatlas 35865 Feb 25 23:02 runpilot2-wrapper.sh
[2025-02-26 04:10:10] -rw-r--r-- 1 boincer umatlas 100 Feb 25 23:02 wrapper_26015_x86_64-pc-linux-gnu
[2025-02-26 04:10:10] -rwxr-xr-x 1 boincer umatlas 7986 Feb 25 23:02 run_atlas
[2025-02-26 04:10:10] -rw-r--r-- 1 boincer umatlas 105 Feb 25 23:02 job.xml
[2025-02-26 04:10:10] -rw-r--r-- 3 boincer umatlas 251307494 Feb 25 23:02 EVNT.43401169._000087.pool.root.1
[2025-02-26 04:10:10] -rw-r--r-- 3 boincer umatlas 251307494 Feb 25 23:02 ATLAS.root_0
[2025-02-26 04:10:10] -rw-r--r-- 2 boincer umatlas 17569 Feb 25 23:02 start_atlas.sh
[2025-02-26 04:10:10] drwxrwx--x 2 boincer umatlas 4096 Feb 25 23:02 shared
[2025-02-26 04:10:10] -rw-r--r-- 2 boincer umatlas 503565 Feb 25 23:02 input.tar.gz
[2025-02-26 04:10:10] -rw-r--r-- 1 boincer umatlas 0 Feb 25 23:02 boinc_lockfile
[2025-02-26 04:10:10] -rw-r--r-- 1 boincer umatlas 2541 Feb 26 01:11 pandaJob.out
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 467 Feb 26 01:11 setup.sh.local
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 987490 Feb 26 01:11 agis_schedconf.cvmfs.json
[2025-02-26 04:10:10] -rw-r--r-- 1 boincer umatlas 6389 Feb 26 04:02 init_data.xml
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 188813359 Feb 26 04:08 HITS.43401171._002280.pool.root.1
[2025-02-26 04:10:10] -rw-r--r-- 1 boincer umatlas 530 Feb 26 04:08 boinc_task_state.xml
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 1090 Feb 26 04:09 memory_monitor_summary.json
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 1569202 Feb 26 04:09 agis_ddmendpoints.agis.ALL.json
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 380029 Feb 26 04:09 log.43401171._002280.job.log.tgz.1
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 96 Feb 26 04:09 pilot_heartbeat.json
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 7764 Feb 26 04:09 heartbeat.json
[2025-02-26 04:10:10] -rw-r--r-- 1 boincer umatlas 28 Feb 26 04:10 wrapper_checkpoint.txt
[2025-02-26 04:10:10] -rw-r--r-- 1 boincer umatlas 8192 Feb 26 04:10 boinc_mmap_file
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 4339 Feb 26 04:10 pilotlog.txt
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 1048615 Feb 26 04:10 log.43401171._002280.job.log.1
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 357 Feb 26 04:10 output.list
[2025-02-26 04:10:10] -rw-r--r-- 1 boincer umatlas 620 Feb 26 04:10 runtime_log
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 1443840 Feb 26 04:10 result.tar.gz
[2025-02-26 04:10:10] -rw-r--r-- 1 boincer umatlas 11504 Feb 26 04:10 runtime_log.err
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 914 Feb 26 04:10 RdFNDm5nN76n9Rq4apOajLDm4fhM0noT9bVoFjIUDmqkgKDmeEGQtn.diag
[2025-02-26 04:10:10] -rw-r--r-- 1 boincer umatlas 26361 Feb 26 04:10 stderr.txt
[2025-02-26 04:10:10] HITS file was successfully produced:
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 188813359 Feb 26 04:08 shared/HITS.pool.root.1
[2025-02-26 04:10:10] *** Contents of shared directory: ***
[2025-02-26 04:10:10] total 431740
[2025-02-26 04:10:10] -rw-r--r-- 3 boincer umatlas 251307494 Feb 25 23:02 ATLAS.root_0
[2025-02-26 04:10:10] -rw-r--r-- 2 boincer umatlas 17569 Feb 25 23:02 start_atlas.sh
[2025-02-26 04:10:10] -rw-r--r-- 2 boincer umatlas 503565 Feb 25 23:02 input.tar.gz
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 188813359 Feb 26 04:08 HITS.pool.root.1
[2025-02-26 04:10:10] -rw------- 1 boincer umatlas 1443840 Feb 26 04:10 result.tar.gz
04:10:12 (56765): run_atlas exited; CPU time 34959.495374
04:10:12 (56765): called boinc_finish(0)
</stderr_txt>
]]>
©2025 CERN