| Name | bmxNDmMWDK7nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmlaFLDmSqnnVn_2 |
| Workunit | 231323528 |
| Created | 3 Apr 2025, 4:06:13 UTC |
| Sent | 3 Apr 2025, 8:26:48 UTC |
| Report deadline | 11 Apr 2025, 8:26:48 UTC |
| Received | 3 Apr 2025, 15:02:32 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 10774636 |
| Run time | 6 hours 13 min 12 sec |
| CPU time | 21 hours 45 min 29 sec |
| Validate state | Valid |
| Credit | 922.12 |
| Device peak FLOPS | 20.67 GFLOPS |
| Application version | ATLAS Simulation v3.01 (native_mt) x86_64-pc-linux-gnu |
| Peak working set size | 2.49 GB |
| Peak swap size | 34.31 GB |
| Peak disk usage | 809.02 MB |
Stderr output
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
01:40:54 (1223236): wrapper (7.7.26015): starting
01:40:54 (1223236): wrapper: running run_atlas (--nthreads 4)
[2025-04-03 01:40:54] Arguments: --nthreads 4
[2025-04-03 01:40:54] Threads: 4
[2025-04-03 01:40:54] Checking for CVMFS
[2025-04-03 01:40:54] Probing /cvmfs/atlas.cern.ch... OK
[2025-04-03 01:40:54] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-04-03 01:40:54] Running cvmfs_config stat atlas.cern.ch
[2025-04-03 01:40:54] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-04-03 01:40:54] 2.11.0.0 5266 2201 72836 144438 0 187 3408454 4096000 1773 130560 31 4888764 99.983 504466 157 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1
[2025-04-03 01:40:54] CVMFS is ok
[2025-04-03 01:40:54] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-04-03 01:40:54] Small home clusters do not require a local http proxy but it is suggested if
[2025-04-03 01:40:54] more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
[2025-04-03 01:40:54] Further information can be found at the LHC@home message board.
[2025-04-03 01:40:54] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-04-03 01:40:54] Checking for apptainer binary...
[2025-04-03 01:40:54] Using apptainer found in PATH at /usr/bin/apptainer
[2025-04-03 01:40:54] Running /usr/bin/apptainer --version
[2025-04-03 01:40:54] apptainer version 1.4.0-1.fc40
[2025-04-03 01:40:54] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-04-03 01:40:54] skyx9980xe
[2025-04-03 01:40:54] apptainer works
[2025-04-03 01:40:55] Set ATHENA_PROC_NUMBER=4
[2025-04-03 01:40:55] Set ATHENA_CORE_NUMBER=4
[2025-04-03 01:40:55] Starting ATLAS job with PandaID=6584887330
[2025-04-03 01:40:55] Running command: /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/14 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
03:49:13 (1297700): wrapper (7.7.26015): starting
03:49:13 (1297700): wrapper: running run_atlas (--nthreads 4)
[2025-04-03 03:49:13] Arguments: --nthreads 4
[2025-04-03 03:49:13] Threads: 4
[2025-04-03 03:49:13] This job has been restarted, cleaning up previous attempt
[2025-04-03 03:49:13] Checking for CVMFS
[2025-04-03 03:49:13] Probing /cvmfs/atlas.cern.ch... OK
[2025-04-03 03:49:13] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-04-03 03:49:13] Running cvmfs_config stat atlas.cern.ch
[2025-04-03 03:49:14] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-04-03 03:49:14] 2.11.0.0 5266 2329 74820 144445 0 185 3609178 4096000 850 130560 31 5189392 99.984 574629 178 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1
[2025-04-03 03:49:14] CVMFS is ok
[2025-04-03 03:49:14] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-04-03 03:49:14] Small home clusters do not require a local http proxy but it is suggested if
[2025-04-03 03:49:14] more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
[2025-04-03 03:49:14] Further information can be found at the LHC@home message board.
[2025-04-03 03:49:14] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-04-03 03:49:14] Checking for apptainer binary...
[2025-04-03 03:49:14] Using apptainer found in PATH at /usr/bin/apptainer
[2025-04-03 03:49:14] Running /usr/bin/apptainer --version
[2025-04-03 03:49:14] apptainer version 1.4.0-1.fc40
[2025-04-03 03:49:14] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-04-03 03:49:14] skyx9980xe
[2025-04-03 03:49:14] apptainer works
[2025-04-03 03:49:14] Set ATHENA_PROC_NUMBER=4
[2025-04-03 03:49:14] Set ATHENA_CORE_NUMBER=4
[2025-04-03 03:49:14] Starting ATLAS job with PandaID=6584887330
[2025-04-03 03:49:14] Running command: /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/14 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
05:50:11 (1353192): wrapper (7.7.26015): starting
05:50:11 (1353192): wrapper: running run_atlas (--nthreads 4)
[2025-04-03 05:50:11] Arguments: --nthreads 4
[2025-04-03 05:50:11] Threads: 4
[2025-04-03 05:50:11] This job has been restarted, cleaning up previous attempt
[2025-04-03 05:50:11] Checking for CVMFS
[2025-04-03 05:50:11] Probing /cvmfs/atlas.cern.ch... OK
[2025-04-03 05:50:11] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-04-03 05:50:11] Running cvmfs_config stat atlas.cern.ch
[2025-04-03 05:50:12] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-04-03 05:50:12] 2.11.0.0 5266 2450 76396 144452 0 186 3646548 4096001 803 130560 31 5404588 99.984 581742 180 http://s1fnal-cvmfs.openhtc.io:8080/cvmfs/atlas.cern.ch DIRECT 1
[2025-04-03 05:50:12] CVMFS is ok
[2025-04-03 05:50:12] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-04-03 05:50:12] Small home clusters do not require a local http proxy but it is suggested if
[2025-04-03 05:50:12] more than 10 cores throughout the same LAN segment are regularly running ATLAS like tasks.
[2025-04-03 05:50:12] Further information can be found at the LHC@home message board.
[2025-04-03 05:50:12] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-04-03 05:50:12] Checking for apptainer binary...
[2025-04-03 05:50:12] Using apptainer found in PATH at /usr/bin/apptainer
[2025-04-03 05:50:12] Running /usr/bin/apptainer --version
[2025-04-03 05:50:12] apptainer version 1.4.0-1.fc40
[2025-04-03 05:50:12] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-04-03 05:50:12] skyx9980xe
[2025-04-03 05:50:12] apptainer works
[2025-04-03 05:50:12] Set ATHENA_PROC_NUMBER=4
[2025-04-03 05:50:12] Set ATHENA_CORE_NUMBER=4
[2025-04-03 05:50:12] Starting ATLAS job with PandaID=6584887330
[2025-04-03 05:50:12] Running command: /usr/bin/apptainer exec -B /cvmfs,/var/lib/boinc/slots/14 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2025-04-03 07:57:04] *** The last 200 lines of the pilot log: ***
[2025-04-03 07:57:04] 2025-04-03 14:56:46,556 | INFO | mean y: 2198050.3613445377
[2025-04-03 07:57:04] 2025-04-03 14:56:46,556 | INFO | -- intersect: -175408535355.57257
[2025-04-03 07:57:04] 2025-04-03 14:56:46,556 | INFO | intersect: -175408535355.57257
[2025-04-03 07:57:04] 2025-04-03 14:56:46,556 | INFO | chi2: 4.373142596568574
[2025-04-03 07:57:04] 2025-04-03 14:56:46,556 | INFO | current chi2=4.373142596568574 (change=0.2972603686728447 %)
[2025-04-03 07:57:04] 2025-04-03 14:56:46,556 | INFO | right removable region: 118
[2025-04-03 07:57:04] 2025-04-03 14:56:46,557 | INFO | model: linear, x: [1743684949.0, 1743685010.0, 1743685071.0, 1743685132.0, 1743685193.0, 1743685254.0, 1743685315.0, 1743685376.0, 1743685437.0, 1743685498.0, 1743
[2025-04-03 07:57:04] 2025-04-03 14:56:46,557 | INFO | sum of square deviations: 522502820.0
[2025-04-03 07:57:04] 2025-04-03 14:56:46,557 | INFO | sum of deviations: 27806251468.000008
[2025-04-03 07:57:04] 2025-04-03 14:56:46,557 | INFO | mean x: 1743688548.0
[2025-04-03 07:57:04] 2025-04-03 14:56:46,557 | INFO | mean y: 2263506.74789916
[2025-04-03 07:57:04] 2025-04-03 14:56:46,557 | INFO | -- intersect: -92792340448.8055
[2025-04-03 07:57:04] 2025-04-03 14:56:46,557 | INFO | intersect: -92792340448.8055
[2025-04-03 07:57:04] 2025-04-03 14:56:46,557 | INFO | chi2: 1.9415940350709897
[2025-04-03 07:57:04] 2025-04-03 14:56:46,557 | INFO | current chi2=1.9415940350709897 (change=55.73383664637031 %)
[2025-04-03 07:57:04] 2025-04-03 14:56:46,557 | INFO | model: linear, x: [1743685254.0, 1743685315.0, 1743685376.0, 1743685437.0, 1743685498.0, 1743685559.0, 1743685620.0, 1743685681.0, 1743685742.0, 1743685803.0, 1743
[2025-04-03 07:57:04] 2025-04-03 14:56:46,558 | INFO | sum of square deviations: 459366752.5
[2025-04-03 07:57:04] 2025-04-03 14:56:46,558 | INFO | sum of deviations: 7039702041.5
[2025-04-03 07:57:04] 2025-04-03 14:56:46,558 | INFO | mean x: 1743688700.5
[2025-04-03 07:57:04] 2025-04-03 14:56:46,558 | INFO | mean y: 2313687.745614035
[2025-04-03 07:57:04] 2025-04-03 14:56:46,558 | INFO | -- intersect: -26719360960.770298
[2025-04-03 07:57:04] 2025-04-03 14:56:46,558 | INFO | intersect: -26719360960.770298
[2025-04-03 07:57:04] 2025-04-03 14:56:46,558 | INFO | chi2: 0.6081514091039406
[2025-04-03 07:57:04] 2025-04-03 14:56:46,558 | INFO | current chi2=0.6081514091039406 (change=68.67772571820325 %)
[2025-04-03 07:57:04] 2025-04-03 14:56:46,558 | INFO | model: linear, x: [1743685559.0, 1743685620.0, 1743685681.0, 1743685742.0, 1743685803.0, 1743685864.0, 1743685925.0, 1743685986.0, 1743686047.0, 1743686108.0, 1743
[2025-04-03 07:57:04] 2025-04-03 14:56:46,558 | INFO | sum of square deviations: 401533110.0
[2025-04-03 07:57:04] 2025-04-03 14:56:46,559 | INFO | sum of deviations: -3402140434.0
[2025-04-03 07:57:04] 2025-04-03 14:56:46,559 | INFO | mean x: 1743688853.0
[2025-04-03 07:57:04] 2025-04-03 14:56:46,559 | INFO | mean y: 2340693.7339449544
[2025-04-03 07:57:04] 2025-04-03 14:56:46,559 | INFO | -- intersect: 14776400922.805424
[2025-04-03 07:57:04] 2025-04-03 14:56:46,559 | INFO | intersect: 14776400922.805424
[2025-04-03 07:57:04] 2025-04-03 14:56:46,559 | INFO | chi2: 0.01782949055490874
[2025-04-03 07:57:04] 2025-04-03 14:56:46,559 | INFO | current chi2=0.01782949055490874 (change=97.0682480895376 %)
[2025-04-03 07:57:04] 2025-04-03 14:56:46,559 | INFO | model: linear, x: [1743685864.0, 1743685925.0, 1743685986.0, 1743686047.0, 1743686108.0, 1743686169.0, 1743686230.0, 1743686291.0, 1743686352.0, 1743686413.0, 1743
[2025-04-03 07:57:04] 2025-04-03 14:56:46,559 | INFO | sum of square deviations: 348769330.0
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | sum of deviations: -2198322819.0000005
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | mean x: 1743689005.5
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | mean y: 2337192.0576923075
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | -- intersect: 10992957640.33526
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | intersect: 10992957640.33526
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | chi2: 0.015346253578150617
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | current chi2=0.015346253578150617 (change=13.927694507650692 %)
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | left removable region: 40
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | model: linear, x: [1743687084.0, 1743687145.0, 1743687206.0, 1743687267.0, 1743687328.0, 1743687389.0, 1743687450.0, 1743687511.0, 1743687572.0, 1743687633.0, 1743
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | sum of square deviations: 147126479.5
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | sum of deviations: 168135855.49999997
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | mean x: 1743689432.5
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | mean y: 2329436.730769231
[2025-04-03 07:57:04] 2025-04-03 14:56:46,560 | INFO | -- intersect: -1990355465.7833085
[2025-04-03 07:57:04] 2025-04-03 14:56:46,561 | INFO | intersect: -1990355465.7833085
[2025-04-03 07:57:04] 2025-04-03 14:56:46,561 | INFO | chi2: 8.519177558402413e-05
[2025-04-03 07:57:04] 2025-04-03 14:56:46,561 | INFO | -- intersect: -1990355465.7833085
[2025-04-03 07:57:04] 2025-04-03 14:56:46,561 | INFO | current memory leak: 1.14 B/s (using 78 data points, chi2=0.00)
[2025-04-03 07:57:04] 2025-04-03 14:56:46,561 | INFO | ..............................
[2025-04-03 07:57:04] 2025-04-03 14:56:46,561 | INFO | . Timing measurements:
[2025-04-03 07:57:04] 2025-04-03 14:56:46,561 | INFO | . get job = 0 s
[2025-04-03 07:57:04] 2025-04-03 14:56:46,561 | INFO | . initial setup = 3 s
[2025-04-03 07:57:04] 2025-04-03 14:56:46,561 | INFO | . payload setup = 3 s
[2025-04-03 07:57:04] 2025-04-03 14:56:46,561 | INFO | . stage-in = 0 s
[2025-04-03 07:57:04] 2025-04-03 14:56:46,562 | INFO | . payload execution = 7557 s
[2025-04-03 07:57:04] 2025-04-03 14:56:46,562 | INFO | . stage-out = 0 s
[2025-04-03 07:57:04] 2025-04-03 14:56:46,562 | INFO | . log creation = 0 s
[2025-04-03 07:57:04] 2025-04-03 14:56:46,562 | INFO | ..............................
[2025-04-03 07:57:04] 2025-04-03 14:56:46,633 | WARNING | process 1363687 can no longer be monitored (due to stat problems) - aborting
[2025-04-03 07:57:04] 2025-04-03 14:56:46,640 | INFO | using path: /var/lib/boinc/slots/14/PanDA_Pilot-6584887330/memory_monitor_summary.json (trf name=prmon)
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO |
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | job summary report
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | --------------------------------------------------
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | PanDA job id: 6584887330
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | task id: 44004367
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | errors: (none)
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | status: LOG_TRANSFER = DONE
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | pilot state: finished
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | transexitcode: 0
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | exeerrorcode: 0
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | exeerrordiag:
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | exitcode: 0
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | exitmsg: OK
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | cpuconsumptiontime: 26491 s
[2025-04-03 07:57:04] 2025-04-03 14:56:46,654 | INFO | nevents: 400
[2025-04-03 07:57:04] 2025-04-03 14:56:46,655 | INFO | neventsw: 0
[2025-04-03 07:57:04] 2025-04-03 14:56:46,655 | INFO | pid: 1363687
[2025-04-03 07:57:04] 2025-04-03 14:56:46,655 | INFO | pgrp: 1363687
[2025-04-03 07:57:04] 2025-04-03 14:56:46,655 | INFO | corecount: 4
[2025-04-03 07:57:04] 2025-04-03 14:56:46,655 | INFO | event service: False
[2025-04-03 07:57:04] 2025-04-03 14:56:46,655 | INFO | sizes: {0: 2417322, 1: 2417350, 4: 2417556, 11: 2417584, 7565: 2454010, 7567: 2454010, 7570: 2454308}
[2025-04-03 07:57:04] 2025-04-03 14:56:46,655 | INFO | --------------------------------------------------
[2025-04-03 07:57:04] 2025-04-03 14:56:46,655 | INFO |
[2025-04-03 07:57:04] 2025-04-03 14:56:46,655 | INFO | executing command: ls -lF /var/lib/boinc/slots/14
[2025-04-03 07:57:04] 2025-04-03 14:56:46,672 | INFO | queue jobs had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,672 | INFO | queue payloads had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,672 | INFO | queue data_in had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,672 | INFO | queue data_out had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,672 | INFO | queue current_data_in had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,672 | INFO | queue validated_jobs had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,672 | INFO | queue validated_payloads had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,672 | INFO | queue monitored_payloads had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,673 | INFO | queue finished_jobs had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,673 | INFO | queue finished_payloads had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,673 | INFO | queue finished_data_in had 1 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,673 | INFO | queue finished_data_out had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,673 | INFO | queue failed_jobs had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,673 | INFO | queue failed_payloads had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,673 | INFO | queue failed_data_in had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,673 | INFO | queue failed_data_out had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,673 | INFO | queue completed_jobs had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,673 | INFO | queue completed_jobids has 1 job(s)
[2025-04-03 07:57:04] 2025-04-03 14:56:46,673 | INFO | queue realtimelog_payloads had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,673 | INFO | queue messages had 0 job(s) [purged]
[2025-04-03 07:57:04] 2025-04-03 14:56:46,673 | INFO | job 6584887330 has completed (purged errors)
[2025-04-03 07:57:04] 2025-04-03 14:56:46,674 | INFO | overall cleanup function is called
[2025-04-03 07:57:04] 2025-04-03 14:56:46,735 | INFO | number of running child processes to parent process 1363687: 1
[2025-04-03 07:57:04] 2025-04-03 14:56:46,735 | INFO | maximum number of monitored processes: 6
[2025-04-03 07:57:04] 2025-04-03 14:56:46,735 | INFO | aborting job monitoring since job object (job id=6584887330) has expired
[2025-04-03 07:57:04] 2025-04-03 14:56:47,681 | INFO | --- collectZombieJob: --- 10, [1363687]
[2025-04-03 07:57:04] 2025-04-03 14:56:47,682 | INFO | zombie collector waiting for pid 1363687
[2025-04-03 07:57:04] 2025-04-03 14:56:47,682 | INFO | harmless exception when collecting zombies: [Errno 10] No child processes
[2025-04-03 07:57:04] 2025-04-03 14:56:47,682 | INFO | collected zombie processes
[2025-04-03 07:57:04] 2025-04-03 14:56:47,682 | INFO | will attempt to kill all subprocesses of pid=1363687
[2025-04-03 07:57:04] 2025-04-03 14:56:47,775 | INFO | process IDs to be killed: [1363687] (in reverse order)
[2025-04-03 07:57:04] 2025-04-03 14:56:47,828 | WARNING | found no corresponding commands to process id(s)
[2025-04-03 07:57:04] 2025-04-03 14:56:47,828 | INFO | Do not look for orphan processes in BOINC jobs
[2025-04-03 07:57:04] 2025-04-03 14:56:47,833 | INFO | did not find any defunct processes belonging to 1363687
[2025-04-03 07:57:04] 2025-04-03 14:56:47,837 | INFO | did not find any defunct processes belonging to 1363687
[2025-04-03 07:57:04] 2025-04-03 14:56:47,837 | INFO | ready for new job
[2025-04-03 07:57:04] 2025-04-03 14:56:47,837 | INFO | pilot has finished with previous job - re-establishing logging
[2025-04-03 07:57:04] 2025-04-03 14:56:47,838 | INFO | ***************************************
[2025-04-03 07:57:04] 2025-04-03 14:56:47,839 | INFO | *** PanDA Pilot version 3.10.0.24 ***
[2025-04-03 07:57:04] 2025-04-03 14:56:47,839 | INFO | ***************************************
[2025-04-03 07:57:04] 2025-04-03 14:56:47,839 | INFO |
[2025-04-03 07:57:04] 2025-04-03 14:56:47,840 | INFO | architecture information:
[2025-04-03 07:57:04] 2025-04-03 14:56:47,840 | INFO | executing command: cat /etc/os-release
[2025-04-03 07:57:04] 2025-04-03 14:56:47,851 | INFO | cat /etc/os-release:
[2025-04-03 07:57:04] NAME="CentOS Linux"
[2025-04-03 07:57:04] VERSION="7 (Core)"
[2025-04-03 07:57:04] ID="centos"
[2025-04-03 07:57:04] ID_LIKE="rhel fedora"
[2025-04-03 07:57:04] VERSION_ID="7"
[2025-04-03 07:57:04] PRETTY_NAME="CentOS Linux 7 (Core)"
[2025-04-03 07:57:04] ANSI_COLOR="0;31"
[2025-04-03 07:57:04] CPE_NAME="cpe:/o:centos:centos:7"
[2025-04-03 07:57:04] HOME_URL="https://www.centos.org/"
[2025-04-03 07:57:04] BUG_REPORT_URL="https://bugs.centos.org/"
[2025-04-03 07:57:04]
[2025-04-03 07:57:04] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2025-04-03 07:57:04] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2025-04-03 07:57:04] REDHAT_SUPPORT_PRODUCT="centos"
[2025-04-03 07:57:04] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2025-04-03 07:57:04]
[2025-04-03 07:57:04] 2025-04-03 14:56:47,851 | INFO | ***************************************
[2025-04-03 07:57:04] 2025-04-03 14:56:48,354 | INFO | executing command: df -mP /var/lib/boinc/slots/14
[2025-04-03 07:57:04] 2025-04-03 14:56:48,367 | INFO | sufficient remaining disk space (1934043906048 B)
[2025-04-03 07:57:04] 2025-04-03 14:56:48,367 | WARNING | since timefloor is set to 0, pilot was only allowed to run one job
[2025-04-03 07:57:04] 2025-04-03 14:56:48,367 | WARNING | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2025-04-03 07:57:04] 2025-04-03 14:56:48,368 | WARNING | job:queue_monitor:received graceful stop - abort after this iteration
[2025-04-03 07:57:04] 2025-04-03 14:56:48,368 | WARNING | job:job_monitor:received graceful stop - abort after this iteration
[2025-04-03 07:57:04] 2025-04-03 14:56:48,368 | WARNING | data:copytool_out:received graceful stop - abort after this iteration
[2025-04-03 07:57:04] 2025-04-03 14:56:48,368 | WARNING | aborting monitor loop since graceful_stop has been set (timing out remaining threads)
[2025-04-03 07:57:04] 2025-04-03 14:56:48,368 | INFO | aborting loop
[2025-04-03 07:57:04] 2025-04-03 14:56:48,369 | INFO | found 0 job(s) in 20 queues
[2025-04-03 07:57:04] 2025-04-03 14:56:48,369 | WARNING | pilot monitor received instruction that args.graceful_stop has been set
[2025-04-03 07:57:04] 2025-04-03 14:56:48,369 | WARNING | will wait for a maximum of 300 s for threads to finish
[2025-04-03 07:57:04] 2025-04-03 14:56:48,451 | INFO | all payload control threads have been joined
[2025-04-03 07:57:04] 2025-04-03 14:56:48,504 | INFO | all data control threads have been joined
[2025-04-03 07:57:04] 2025-04-03 14:56:49,373 | INFO | [job] queue monitor thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:49,373 | INFO | [job] retrieve thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:49,374 | INFO | [job] job monitor thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:49,446 | INFO | [payload] failed_post thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:49,456 | INFO | [payload] control thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:49,510 | INFO | [data] control thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:49,710 | WARNING | data:queue_monitoring:received graceful stop - abort after this iteration
[2025-04-03 07:57:04] 2025-04-03 14:56:49,783 | INFO | all job control threads have been joined
[2025-04-03 07:57:04] 2025-04-03 14:56:49,890 | INFO | [data] copytool_in thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:50,059 | INFO | [job] validate thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:50,138 | INFO | [payload] execute_payloads thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:50,374 | INFO | [data] copytool_out thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:50,375 | INFO | [job] create_data_payload thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:50,549 | INFO | [payload] validate_pre thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:50,676 | INFO | [payload] validate_post thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:50,788 | INFO | [job] control thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:53,712 | INFO | [data] queue_monitor thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:58,489 | INFO | job.realtimelogging is not enabled
[2025-04-03 07:57:04] 2025-04-03 14:56:59,490 | INFO | [payload] run_realtimelog thread has finished
[2025-04-03 07:57:04] 2025-04-03 14:56:59,635 | INFO | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140332325537600)>', '<ExcThread(monitor, started 140331597158144)>']
[2025-04-03 07:57:04] 2025-04-03 14:57:00,431 | WARNING | job_aborted has been set - aborting pilot monitoring
[2025-04-03 07:57:04] 2025-04-03 14:57:00,431 | INFO | [monitor] control thread has ended
[2025-04-03 07:57:04] 2025-04-03 14:57:04,661 | INFO | all workflow threads have been joined
[2025-04-03 07:57:04] 2025-04-03 14:57:04,661 | INFO | end of generic workflow (traces error code: 0)
[2025-04-03 07:57:04] 2025-04-03 14:57:04,661 | INFO | traces error code: 0
[2025-04-03 07:57:04] 2025-04-03 14:57:04,661 | INFO | pilot has finished (exit code=0, shell exit code=0)
[2025-04-03 07:57:04] 2025-04-03 14:57:04,759 [wrapper] ==== pilot stdout END ====
[2025-04-03 07:57:04] 2025-04-03 14:57:04,761 [wrapper] ==== wrapper stdout RESUME ====
[2025-04-03 07:57:04] 2025-04-03 14:57:04,763 [wrapper] pilotpid: 1356989
[2025-04-03 07:57:04] 2025-04-03 14:57:04,765 [wrapper] Pilot exit status: 0
[2025-04-03 07:57:04] 2025-04-03 14:57:04,772 [wrapper] pandaids: 6584887330 6584887330 6584887330
[2025-04-03 07:57:04] 2025-04-03 14:57:04,799 [wrapper] cleanup supervisor_pilot 1417207 1356990
[2025-04-03 07:57:04] 2025-04-03 14:57:04,801 [wrapper] Test setup, not cleaning
[2025-04-03 07:57:04] 2025-04-03 14:57:04,804 [wrapper] apfmon messages muted
[2025-04-03 07:57:04] 2025-04-03 14:57:04,806 [wrapper] ==== wrapper stdout END ====
[2025-04-03 07:57:04] 2025-04-03 14:57:04,807 [wrapper] ==== wrapper stderr END ====
[2025-04-03 07:57:04] *** Error codes and diagnostics ***
[2025-04-03 07:57:04] "exeErrorCode": 0,
[2025-04-03 07:57:04] "exeErrorDiag": "",
[2025-04-03 07:57:04] "pilotErrorCode": 0,
[2025-04-03 07:57:04] "pilotErrorDiag": "",
[2025-04-03 07:57:04] *** Listing of results directory ***
[2025-04-03 07:57:04] total 617248
[2025-04-03 07:57:04] drwx------ 1 boinc boinc 368 Mar 6 03:03 pilot3
[2025-04-03 07:57:04] -rw-r--r-- 1 boinc boinc 494584 Apr 2 06:28 pilot3.tar.gz
[2025-04-03 07:57:04] -rw-r--r-- 1 boinc boinc 5112 Apr 2 06:40 queuedata.json
[2025-04-03 07:57:04] -rwx------ 1 boinc boinc 37140 Apr 2 06:41 runpilot2-wrapper.sh
[2025-04-03 07:57:04] -rw-r--r-- 1 boinc boinc 100 Apr 3 01:40 wrapper_26015_x86_64-pc-linux-gnu
[2025-04-03 07:57:04] -rwxr-xr-x 1 boinc boinc 7986 Apr 3 01:40 run_atlas
[2025-04-03 07:57:04] -rw-r--r-- 1 boinc boinc 105 Apr 3 01:40 job.xml
[2025-04-03 07:57:04] -rw-r--r-- 3 boinc boinc 219600769 Apr 3 01:40 EVNT.44004365._000048.pool.root.1
[2025-04-03 07:57:04] -rw-r--r-- 3 boinc boinc 219600769 Apr 3 01:40 ATLAS.root_0
[2025-04-03 07:57:04] drwxrwx--x 1 boinc boinc 76 Apr 3 01:40 shared
[2025-04-03 07:57:04] -rw-r--r-- 2 boinc boinc 507236 Apr 3 01:40 input.tar.gz
[2025-04-03 07:57:04] -rw-r--r-- 2 boinc boinc 17571 Apr 3 01:40 start_atlas.sh
[2025-04-03 07:57:04] -rw-r--r-- 1 boinc boinc 0 Apr 3 01:40 boinc_lockfile
[2025-04-03 07:57:04] -rw-r--r-- 1 boinc boinc 9479 Apr 3 05:50 init_data.xml
[2025-04-03 07:57:04] -rw-r--r-- 1 boinc boinc 2548 Apr 3 05:50 pandaJob.out
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 424 Apr 3 05:50 setup.sh.local
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 992135 Apr 3 05:50 agis_schedconf.cvmfs.json
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 1603525 Apr 3 05:50 agis_ddmendpoints.agis.ALL.json
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 96 Apr 3 07:55 pilot_heartbeat.json
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 186910369 Apr 3 07:56 HITS.44004367._001200.pool.root.1
[2025-04-03 07:57:04] -rw-r--r-- 1 boinc boinc 531 Apr 3 07:56 boinc_task_state.xml
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 1024 Apr 3 07:56 memory_monitor_summary.json
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 289310 Apr 3 07:56 log.44004367._001200.job.log.tgz.1
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 7674 Apr 3 07:56 heartbeat.json
[2025-04-03 07:57:04] -rw-r--r-- 1 boinc boinc 8192 Apr 3 07:56 boinc_mmap_file
[2025-04-03 07:57:04] -rw-r--r-- 1 boinc boinc 28 Apr 3 07:56 wrapper_checkpoint.txt
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 4417 Apr 3 07:57 pilotlog.txt
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 767230 Apr 3 07:57 log.44004367._001200.job.log.1
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 357 Apr 3 07:57 output.list
[2025-04-03 07:57:04] -rw-r--r-- 1 boinc boinc 620 Apr 3 07:57 runtime_log
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 1075200 Apr 3 07:57 result.tar.gz
[2025-04-03 07:57:04] -rw-r--r-- 1 boinc boinc 11074 Apr 3 07:57 runtime_log.err
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 891 Apr 3 07:57 bmxNDmMWDK7nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmlaFLDmSqnnVn.diag
[2025-04-03 07:57:04] -rw-r--r-- 1 boinc boinc 26132 Apr 3 07:57 stderr.txt
[2025-04-03 07:57:04] HITS file was successfully produced:
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 186910369 Apr 3 07:56 shared/HITS.pool.root.1
[2025-04-03 07:57:04] *** Contents of shared directory: ***
[2025-04-03 07:57:04] total 398556
[2025-04-03 07:57:04] -rw-r--r-- 3 boinc boinc 219600769 Apr 3 01:40 ATLAS.root_0
[2025-04-03 07:57:04] -rw-r--r-- 2 boinc boinc 507236 Apr 3 01:40 input.tar.gz
[2025-04-03 07:57:04] -rw-r--r-- 2 boinc boinc 17571 Apr 3 01:40 start_atlas.sh
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 186910369 Apr 3 07:56 HITS.pool.root.1
[2025-04-03 07:57:04] -rw------- 1 boinc boinc 1075200 Apr 3 07:57 result.tar.gz
07:57:06 (1353192): run_atlas exited; CPU time 26486.020359
07:57:06 (1353192): called boinc_finish(0)
</stderr_txt>
]]>
©2025 CERN