| Name | dXGMDmxs1b5n7Olcko1bjSoqABFKDmABFKDmOtvXDmTXoKDms1ojMo_0 |
| Workunit | 223602012 |
| Created | 13 Jun 2024, 15:50:04 UTC |
| Sent | 13 Jun 2024, 20:29:49 UTC |
| Report deadline | 21 Jun 2024, 20:29:49 UTC |
| Received | 15 Jun 2024, 4:46:06 UTC |
| Server state | Over |
| Outcome | Success |
| Client state | Done |
| Exit status | 0 (0x00000000) |
| Computer ID | 10804956 |
| Run time | 1 days 3 hours 17 min 50 sec |
| CPU time | 3 days 17 hours 57 min 56 sec |
| Validate state | Valid |
| Credit | 6,104.20 |
| Device peak FLOPS | 40.69 GFLOPS |
| Application version | ATLAS Simulation v3.01 (native_mt) x86_64-pc-linux-gnu |
| Peak working set size | 2.34 GB |
| Peak swap size | 31.45 GB |
| Peak disk usage | 1.85 GB |
Stderr output
<core_client_version>7.7.0</core_client_version>
<![CDATA[
<stderr_txt>
16:31:56 (81464): wrapper (7.7.26015): starting
16:31:56 (81464): wrapper: running run_atlas (--nthreads 8)
[2024-06-13 16:31:56] Arguments: --nthreads 8
[2024-06-13 16:31:56] Threads: 8
[2024-06-13 16:31:56] Checking for CVMFS
[2024-06-13 16:31:56] Probing /cvmfs/atlas.cern.ch... OK
[2024-06-13 16:31:56] Probing /cvmfs/atlas-condb.cern.ch... OK
[2024-06-13 16:31:56] Running cvmfs_config stat atlas.cern.ch
[2024-06-13 16:31:56] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2024-06-13 16:31:56] 2.11.2.0 92756 3481 166808 133844 0 416 16167732 18432001 11601 130560 0 14914675 98.815 31614586 53650 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2024-06-13 16:31:56] CVMFS is ok
[2024-06-13 16:31:56] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-06-13 16:31:56] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-06-13 16:31:56] Further information can be found at the LHC@home message board.
[2024-06-13 16:31:56] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-06-13 16:31:56] Checking for apptainer binary...
[2024-06-13 16:31:56] Using apptainer found in PATH at /usr/bin/apptainer
[2024-06-13 16:31:56] Running /usr/bin/apptainer --version
[2024-06-13 16:31:56] apptainer version 1.3.1-1.el7
[2024-06-13 16:31:56] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-06-13 16:31:57] c-212-11.aglt2.org
[2024-06-13 16:31:57] apptainer works
[2024-06-13 16:31:57] Set ATHENA_PROC_NUMBER=8
[2024-06-13 16:31:57] Set ATHENA_CORE_NUMBER=8
[2024-06-13 16:31:57] Starting ATLAS job with PandaID=6229471930
[2024-06-13 16:31:57] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/3 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
03:00:12 (81464): BOINC client no longer exists - exiting
03:00:12 (81464): timer handler: client dead, exiting
03:09:15 (40037): wrapper (7.7.26015): starting
03:09:15 (40037): wrapper: running run_atlas (--nthreads 8)
[2024-06-14 03:09:15] Arguments: --nthreads 8
[2024-06-14 03:09:15] Threads: 8
[2024-06-14 03:09:15] This job has been restarted, cleaning up previous attempt
[2024-06-14 03:09:15] Checking for CVMFS
[2024-06-14 03:09:15] Probing /cvmfs/atlas.cern.ch... OK
[2024-06-14 03:09:15] Probing /cvmfs/atlas-condb.cern.ch... OK
[2024-06-14 03:09:15] Running cvmfs_config stat atlas.cern.ch
[2024-06-14 03:09:16] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2024-06-14 03:09:16] 2.11.2.0 92756 4119 197004 133859 0 365 13793597 18432001 10892 130560 0 23254273 99.160 35743234 54317 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2024-06-14 03:09:16] CVMFS is ok
[2024-06-14 03:09:16] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-06-14 03:09:16] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-06-14 03:09:16] Further information can be found at the LHC@home message board.
[2024-06-14 03:09:16] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-06-14 03:09:16] Checking for apptainer binary...
[2024-06-14 03:09:16] Using apptainer found in PATH at /usr/bin/apptainer
[2024-06-14 03:09:16] Running /usr/bin/apptainer --version
[2024-06-14 03:09:16] apptainer version 1.3.1-1.el7
[2024-06-14 03:09:16] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-06-14 03:09:16] c-212-11.aglt2.org
[2024-06-14 03:09:16] apptainer works
[2024-06-14 03:09:16] Set ATHENA_PROC_NUMBER=8
[2024-06-14 03:09:16] Set ATHENA_CORE_NUMBER=8
[2024-06-14 03:09:16] Starting ATLAS job with PandaID=6229471930
[2024-06-14 03:09:16] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/3 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
09:40:04 (40037): BOINC client no longer exists - exiting
09:40:04 (40037): timer handler: client dead, exiting
09:49:20 (826): wrapper (7.7.26015): starting
09:49:20 (826): wrapper: running run_atlas (--nthreads 8)
[2024-06-14 09:49:20] Arguments: --nthreads 8
[2024-06-14 09:49:20] Threads: 8
[2024-06-14 09:49:20] This job has been restarted, cleaning up previous attempt
[2024-06-14 09:49:20] Checking for CVMFS
[2024-06-14 09:49:20] Probing /cvmfs/atlas.cern.ch... OK
[2024-06-14 09:49:21] Probing /cvmfs/atlas-condb.cern.ch... OK
[2024-06-14 09:49:21] Running cvmfs_config stat atlas.cern.ch
[2024-06-14 09:49:21] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2024-06-14 09:49:21] 2.11.2.0 92756 4519 216016 133870 0 630 14883126 18432001 13536 130560 0 27772308 99.198 42177709 53763 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2024-06-14 09:49:21] CVMFS is ok
[2024-06-14 09:49:21] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-06-14 09:49:21] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-06-14 09:49:21] Further information can be found at the LHC@home message board.
[2024-06-14 09:49:21] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-06-14 09:49:21] Checking for apptainer binary...
[2024-06-14 09:49:21] Using apptainer found in PATH at /usr/bin/apptainer
[2024-06-14 09:49:21] Running /usr/bin/apptainer --version
[2024-06-14 09:49:21] apptainer version 1.3.1-1.el7
[2024-06-14 09:49:21] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-06-14 09:49:22] c-212-11.aglt2.org
[2024-06-14 09:49:22] apptainer works
[2024-06-14 09:49:22] Set ATHENA_PROC_NUMBER=8
[2024-06-14 09:49:22] Set ATHENA_CORE_NUMBER=8
[2024-06-14 09:49:23] Starting ATLAS job with PandaID=6229471930
[2024-06-14 09:49:23] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/3 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2024-06-15 00:29:54] *** The last 200 lines of the pilot log: ***
[2024-06-15 00:29:54] 2024-06-15 04:29:24,190 | INFO | monitor loop #3652: job 0:6229471930 is in state 'finished'
[2024-06-15 00:29:54] 2024-06-15 04:29:24,190 | INFO | will abort job monitoring soon since job state=finished (job is still in queue)
[2024-06-15 00:29:54] 2024-06-15 04:29:26,698 | INFO | monitor loop #3653: job 0:6229471930 is in state 'finished'
[2024-06-15 00:29:54] 2024-06-15 04:29:26,698 | INFO | will abort job monitoring soon since job state=finished (job is still in queue)
[2024-06-15 00:29:54] 2024-06-15 04:29:29,202 | INFO | monitor loop #3654: job 0:6229471930 is in state 'finished'
[2024-06-15 00:29:54] 2024-06-15 04:29:29,202 | INFO | will abort job monitoring soon since job state=finished (job is still in queue)
[2024-06-15 00:29:54] 2024-06-15 04:29:31,707 | INFO | monitor loop #3655: job 0:6229471930 is in state 'finished'
[2024-06-15 00:29:54] 2024-06-15 04:29:31,707 | INFO | will abort job monitoring soon since job state=finished (job is still in queue)
[2024-06-15 00:29:54] 2024-06-15 04:29:34,212 | INFO | monitor loop #3656: job 0:6229471930 is in state 'finished'
[2024-06-15 00:29:54] 2024-06-15 04:29:34,212 | INFO | will abort job monitoring soon since job state=finished (job is still in queue)
[2024-06-15 00:29:54] 2024-06-15 04:29:36,717 | INFO | monitor loop #3657: job 0:6229471930 is in state 'finished'
[2024-06-15 00:29:54] 2024-06-15 04:29:36,717 | INFO | will abort job monitoring soon since job state=finished (job is still in queue)
[2024-06-15 00:29:54] 2024-06-15 04:29:38,348 | INFO | CPU arch script returned: x86-64-v3
[2024-06-15 00:29:54] 2024-06-15 04:29:38,349 | INFO | using path: /tmp/boinchome/slots/3/PanDA_Pilot-6229471930/memory_monitor_summary.json (trf name=prmon)
[2024-06-15 00:29:54] 2024-06-15 04:29:38,350 | INFO | extracted standard info from prmon json
[2024-06-15 00:29:54] 2024-06-15 04:29:38,350 | INFO | extracted standard memory fields from prmon json
[2024-06-15 00:29:54] 2024-06-15 04:29:38,350 | WARNING | GPU info not found in prmon json
[2024-06-15 00:29:54] 2024-06-15 04:29:38,350 | WARNING | format EVNTtoHITS has no such key: dbData
[2024-06-15 00:29:54] 2024-06-15 04:29:38,350 | WARNING | format EVNTtoHITS has no such key: dbTime
[2024-06-15 00:29:54] 2024-06-15 04:29:38,363 | INFO | fitting pss+swap vs Time
[2024-06-15 00:29:54] 2024-06-15 04:29:38,364 | INFO | model: linear, x: [1718373029.0, 1718373090.0, 1718373151.0, 1718373212.0, 1718373273.0, 1718373334.0, 1718373395.0, 1718373456.0, 1718373517.0, 1718373578.0, 1718
[2024-06-15 00:29:54] 2024-06-15 04:29:38,364 | INFO | sum of square deviations: 200690233193.11
[2024-06-15 00:29:54] 2024-06-15 04:29:38,376 | INFO | sum of deviations: 1885482941665.9763
[2024-06-15 00:29:54] 2024-06-15 04:29:38,376 | INFO | mean x: 1718399381.0578034
[2024-06-15 00:29:54] 2024-06-15 04:29:38,376 | INFO | mean y: 2457847.040462428
[2024-06-15 00:29:54] 2024-06-15 04:29:38,376 | INFO | -- intersect: -16141888932.58695
[2024-06-15 00:29:54] 2024-06-15 04:29:38,376 | INFO | intersect: -16141888932.58695
[2024-06-15 00:29:54] 2024-06-15 04:29:38,377 | INFO | chi2: 17.850301968855895
[2024-06-15 00:29:54] 2024-06-15 04:29:38,378 | INFO | model: linear, x: [1718373029.0, 1718373090.0, 1718373151.0, 1718373212.0, 1718373273.0, 1718373334.0, 1718373395.0, 1718373456.0, 1718373517.0, 1718373578.0, 1718
[2024-06-15 00:29:54] 2024-06-15 04:29:38,378 | INFO | sum of square deviations: 197230146358.09302
[2024-06-15 00:29:54] 2024-06-15 04:29:38,389 | INFO | sum of deviations: 1932791770741.768
[2024-06-15 00:29:54] 2024-06-15 04:29:38,389 | INFO | mean x: 1718399228.5581396
[2024-06-15 00:29:54] 2024-06-15 04:29:38,390 | INFO | mean y: 2459919.8046511626
[2024-06-15 00:29:54] 2024-06-15 04:29:38,390 | INFO | -- intersect: -16837297841.039755
[2024-06-15 00:29:54] 2024-06-15 04:29:38,390 | INFO | intersect: -16837297841.039755
[2024-06-15 00:29:54] 2024-06-15 04:29:38,390 | INFO | chi2: 17.075864335622544
[2024-06-15 00:29:54] 2024-06-15 04:29:38,391 | INFO | current chi2=17.075864335622544 (change=4.338512785859544 %)
[2024-06-15 00:29:54] 2024-06-15 04:29:38,391 | INFO | right removable region: 859
[2024-06-15 00:29:54] 2024-06-15 04:29:38,391 | INFO | model: linear, x: [1718373334.0, 1718373395.0, 1718373456.0, 1718373517.0, 1718373578.0, 1718373639.0, 1718373700.0, 1718373761.0, 1718373822.0, 1718373883.0, 1718
[2024-06-15 00:29:54] 2024-06-15 04:29:38,391 | INFO | sum of square deviations: 197230115858.09308
[2024-06-15 00:29:54] 2024-06-15 04:29:38,403 | INFO | sum of deviations: 1620443024778.116
[2024-06-15 00:29:54] 2024-06-15 04:29:38,403 | INFO | mean x: 1718399533.5581396
[2024-06-15 00:29:54] 2024-06-15 04:29:38,403 | INFO | mean y: 2469522.7976744184
[2024-06-15 00:29:54] 2024-06-15 04:29:38,403 | INFO | -- intersect: -14115904468.016945
[2024-06-15 00:29:54] 2024-06-15 04:29:38,403 | INFO | intersect: -14115904468.016945
[2024-06-15 00:29:54] 2024-06-15 04:29:38,404 | INFO | chi2: 14.158442953876673
[2024-06-15 00:29:54] 2024-06-15 04:29:38,404 | INFO | current chi2=14.158442953876673 (change=20.68233367379751 %)
[2024-06-15 00:29:54] 2024-06-15 04:29:38,404 | INFO | left removable region: 10
[2024-06-15 00:29:54] 2024-06-15 04:29:38,405 | INFO | model: linear, x: [1718373639.0, 1718373700.0, 1718373761.0, 1718373822.0, 1718373883.0, 1718373944.0, 1718374005.0, 1718374066.0, 1718374127.0, 1718374188.0, 1718
[2024-06-15 00:29:54] 2024-06-15 04:29:38,405 | INFO | sum of square deviations: 189758369513.05508
[2024-06-15 00:29:54] 2024-06-15 04:29:38,416 | INFO | sum of deviations: 1452587642724.9485
[2024-06-15 00:29:54] 2024-06-15 04:29:38,416 | INFO | mean x: 1718399503.0588927
[2024-06-15 00:29:54] 2024-06-15 04:29:38,416 | INFO | mean y: 2481253.8810365135
[2024-06-15 00:29:54] 2024-06-15 04:29:38,416 | INFO | -- intersect: -13151752152.6002
[2024-06-15 00:29:54] 2024-06-15 04:29:38,417 | INFO | intersect: -13151752152.6002
[2024-06-15 00:29:54] 2024-06-15 04:29:38,417 | INFO | chi2: 11.086306317930081
[2024-06-15 00:29:54] 2024-06-15 04:29:38,417 | INFO | -- intersect: -13151752152.6002
[2024-06-15 00:29:54] 2024-06-15 04:29:38,417 | INFO | current memory leak: 7.65 B/s (using 849 data points, chi2=11.09)
[2024-06-15 00:29:54] 2024-06-15 04:29:38,418 | INFO | ..............................
[2024-06-15 00:29:54] 2024-06-15 04:29:38,419 | INFO | . Timing measurements:
[2024-06-15 00:29:54] 2024-06-15 04:29:38,419 | INFO | . get job = 0 s
[2024-06-15 00:29:54] 2024-06-15 04:29:38,419 | INFO | . initial setup = 2 s
[2024-06-15 00:29:54] 2024-06-15 04:29:38,419 | INFO | . payload setup = 11 s
[2024-06-15 00:29:54] 2024-06-15 04:29:38,419 | INFO | . stage-in = 0 s
[2024-06-15 00:29:54] 2024-06-15 04:29:38,419 | INFO | . payload execution = 52737 s
[2024-06-15 00:29:54] 2024-06-15 04:29:38,419 | INFO | . stage-out = 3 s
[2024-06-15 00:29:54] 2024-06-15 04:29:38,419 | INFO | . log creation = 0 s
[2024-06-15 00:29:54] 2024-06-15 04:29:38,419 | INFO | ..............................
[2024-06-15 00:29:54] 2024-06-15 04:29:38,495 | INFO |
[2024-06-15 00:29:54] 2024-06-15 04:29:38,496 | INFO | job summary report
[2024-06-15 00:29:54] 2024-06-15 04:29:38,496 | INFO | --------------------------------------------------
[2024-06-15 00:29:54] 2024-06-15 04:29:38,496 | INFO | PanDA job id: 6229471930
[2024-06-15 00:29:54] 2024-06-15 04:29:38,496 | INFO | task id: 38921013
[2024-06-15 00:29:54] 2024-06-15 04:29:38,496 | INFO | errors: (none)
[2024-06-15 00:29:54] 2024-06-15 04:29:38,496 | INFO | status: LOG_TRANSFER = DONE
[2024-06-15 00:29:54] 2024-06-15 04:29:38,496 | INFO | pilot state: finished
[2024-06-15 00:29:54] 2024-06-15 04:29:38,496 | INFO | transexitcode: 0
[2024-06-15 00:29:54] 2024-06-15 04:29:38,496 | INFO | exeerrorcode: 0
[2024-06-15 00:29:54] 2024-06-15 04:29:38,496 | INFO | exeerrordiag:
[2024-06-15 00:29:54] 2024-06-15 04:29:38,496 | INFO | exitcode: 0
[2024-06-15 00:29:54] 2024-06-15 04:29:38,496 | INFO | exitmsg: OK
[2024-06-15 00:29:54] 2024-06-15 04:29:38,497 | INFO | cpuconsumptiontime: 144332 s
[2024-06-15 00:29:54] 2024-06-15 04:29:38,497 | INFO | nevents: 400
[2024-06-15 00:29:54] 2024-06-15 04:29:38,497 | INFO | neventsw: 0
[2024-06-15 00:29:54] 2024-06-15 04:29:38,497 | INFO | pid: 70288
[2024-06-15 00:29:54] 2024-06-15 04:29:38,497 | INFO | pgrp: 70288
[2024-06-15 00:29:54] 2024-06-15 04:29:38,497 | INFO | corecount: 8
[2024-06-15 00:29:54] 2024-06-15 04:29:38,497 | INFO | event service: False
[2024-06-15 00:29:54] 2024-06-15 04:29:38,497 | INFO | sizes: {0: 2378897, 1: 2379096, 8: 2379302, 11: 2379330, 52752: 2426916, 52755: 2435876, 52759: 2436060, 52777: 2436230}
[2024-06-15 00:29:54] 2024-06-15 04:29:38,497 | INFO | --------------------------------------------------
[2024-06-15 00:29:54] 2024-06-15 04:29:38,497 | INFO |
[2024-06-15 00:29:54] 2024-06-15 04:29:38,497 | INFO | executing command: ls -lF /tmp/boinchome/slots/3
[2024-06-15 00:29:54] 2024-06-15 04:29:38,701 | INFO | queue jobs had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,701 | INFO | queue payloads had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,701 | INFO | queue data_in had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,701 | INFO | queue data_out had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,701 | INFO | queue current_data_in had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,701 | INFO | queue validated_jobs had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue validated_payloads had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue monitored_payloads had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue finished_jobs had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue finished_payloads had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue finished_data_in had 1 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue finished_data_out had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue failed_jobs had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue failed_payloads had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue failed_data_in had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue failed_data_out had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue completed_jobs had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue completed_jobids has 1 job(s)
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue realtimelog_payloads had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | queue messages had 0 job(s) [purged]
[2024-06-15 00:29:54] 2024-06-15 04:29:38,702 | INFO | job 6229471930 has completed (purged errors)
[2024-06-15 00:29:54] 2024-06-15 04:29:38,703 | INFO | overall cleanup function is called
[2024-06-15 00:29:54] 2024-06-15 04:29:39,715 | INFO | --- collectZombieJob: --- 10, [70288]
[2024-06-15 00:29:54] 2024-06-15 04:29:39,715 | INFO | zombie collector waiting for pid 70288
[2024-06-15 00:29:54] 2024-06-15 04:29:39,715 | INFO | harmless exception when collecting zombies: [Errno 10] No child processes
[2024-06-15 00:29:54] 2024-06-15 04:29:40,721 | INFO | collected zombie processes
[2024-06-15 00:29:54] 2024-06-15 04:29:40,721 | INFO | will now attempt to kill all subprocesses of pid=70288
[2024-06-15 00:29:54] 2024-06-15 04:29:40,861 | INFO | process IDs to be killed: [70288] (in reverse order)
[2024-06-15 00:29:54] 2024-06-15 04:29:40,967 | WARNING | found no corresponding commands to process id(s)
[2024-06-15 00:29:54] 2024-06-15 04:29:40,967 | INFO | Do not look for orphan processes in BOINC jobs
[2024-06-15 00:29:54] 2024-06-15 04:29:40,976 | INFO | did not find any defunct processes belonging to 70288
[2024-06-15 00:29:54] 2024-06-15 04:29:40,984 | INFO | did not find any defunct processes belonging to 70288
[2024-06-15 00:29:54] 2024-06-15 04:29:40,984 | INFO | ready for new job
[2024-06-15 00:29:54] 2024-06-15 04:29:40,984 | INFO | pilot has finished with previous job - re-establishing logging
[2024-06-15 00:29:54] 2024-06-15 04:29:40,988 | INFO | *************************************
[2024-06-15 00:29:54] 2024-06-15 04:29:40,988 | INFO | *** PanDA Pilot version 3.7.7.3 ***
[2024-06-15 00:29:54] 2024-06-15 04:29:40,988 | INFO | *************************************
[2024-06-15 00:29:54] 2024-06-15 04:29:40,988 | INFO |
[2024-06-15 00:29:54] 2024-06-15 04:29:40,992 | INFO | architecture information:
[2024-06-15 00:29:54] 2024-06-15 04:29:40,992 | INFO | executing command: cat /etc/os-release
[2024-06-15 00:29:54] 2024-06-15 04:29:41,005 | INFO | cat /etc/os-release:
[2024-06-15 00:29:54] NAME="CentOS Linux"
[2024-06-15 00:29:54] VERSION="7 (Core)"
[2024-06-15 00:29:54] ID="centos"
[2024-06-15 00:29:54] ID_LIKE="rhel fedora"
[2024-06-15 00:29:54] VERSION_ID="7"
[2024-06-15 00:29:54] PRETTY_NAME="CentOS Linux 7 (Core)"
[2024-06-15 00:29:54] ANSI_COLOR="0;31"
[2024-06-15 00:29:54] CPE_NAME="cpe:/o:centos:centos:7"
[2024-06-15 00:29:54] HOME_URL="https://www.centos.org/"
[2024-06-15 00:29:54] BUG_REPORT_URL="https://bugs.centos.org/"
[2024-06-15 00:29:54]
[2024-06-15 00:29:54] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2024-06-15 00:29:54] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2024-06-15 00:29:54] REDHAT_SUPPORT_PRODUCT="centos"
[2024-06-15 00:29:54] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2024-06-15 00:29:54]
[2024-06-15 00:29:54] 2024-06-15 04:29:41,006 | INFO | *************************************
[2024-06-15 00:29:54] 2024-06-15 04:29:41,508 | INFO | executing command: df -mP /tmp/boinchome/slots/3
[2024-06-15 00:29:54] 2024-06-15 04:29:41,714 | INFO | sufficient remaining disk space (100583604224 B)
[2024-06-15 00:29:54] 2024-06-15 04:29:41,714 | WARNING | since timefloor is set to 0, pilot was only allowed to run one job
[2024-06-15 00:29:54] 2024-06-15 04:29:41,715 | WARNING | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2024-06-15 00:29:54] 2024-06-15 04:29:41,731 | WARNING | job monitor detected an abort_job request (signal=args.signal)
[2024-06-15 00:29:54] 2024-06-15 04:29:41,732 | WARNING | cannot recover job monitoring - aborting pilot
[2024-06-15 00:29:54] 2024-06-15 04:29:41,732 | WARNING | job:job_monitor:received graceful stop - abort after this iteration
[2024-06-15 00:29:54] 2024-06-15 04:29:41,732 | INFO | will abort loop
[2024-06-15 00:29:54] 2024-06-15 04:29:42,107 | WARNING | data:copytool_out:received graceful stop - abort after this iteration
[2024-06-15 00:29:54] 2024-06-15 04:29:42,138 | INFO | found 0 job(s) in 20 queues
[2024-06-15 00:29:54] 2024-06-15 04:29:42,138 | WARNING | pilot monitor received instruction that args.graceful_stop has been set
[2024-06-15 00:29:54] 2024-06-15 04:29:42,138 | WARNING | will wait for a maximum of 300 s for threads to finish
[2024-06-15 00:29:54] 2024-06-15 04:29:42,260 | INFO | all payload control threads have been joined
[2024-06-15 00:29:54] 2024-06-15 04:29:42,281 | INFO | all job control threads have been joined
[2024-06-15 00:29:54] 2024-06-15 04:29:42,313 | INFO | all data control threads have been joined
[2024-06-15 00:29:54] 2024-06-15 04:29:42,721 | INFO | [job] retrieve thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:42,737 | INFO | [job] job monitor thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:42,893 | INFO | [payload] execute_payloads thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:42,906 | INFO | [payload] run_realtimelog thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:43,117 | INFO | [data] copytool_in thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:43,221 | INFO | [payload] validate_post thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:43,266 | INFO | [payload] control thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:43,287 | INFO | [job] control thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:43,319 | INFO | [data] control thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:43,455 | INFO | [job] validate thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:43,510 | WARNING | job:queue_monitor:received graceful stop - abort after this iteration
[2024-06-15 00:29:54] 2024-06-15 04:29:43,589 | INFO | [job] create_data_payload thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:43,692 | INFO | [payload] failed_post thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:43,903 | INFO | [payload] validate_pre thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:44,114 | INFO | [data] copytool_out thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:44,187 | WARNING | data:queue_monitoring:received graceful stop - abort after this iteration
[2024-06-15 00:29:54] 2024-06-15 04:29:44,516 | INFO | [job] queue monitor thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:48,195 | INFO | [data] queue_monitor thread has finished
[2024-06-15 00:29:54] 2024-06-15 04:29:49,223 | INFO | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140687051958080)>', '<ExcThread(monitor, started 140686460438272)>']
[2024-06-15 00:29:54] 2024-06-15 04:29:50,185 | WARNING | job_aborted has been set - aborting pilot monitoring
[2024-06-15 00:29:54] 2024-06-15 04:29:50,185 | INFO | [monitor] control thread has ended
[2024-06-15 00:29:54] 2024-06-15 04:29:54,248 | INFO | all workflow threads have been joined
[2024-06-15 00:29:54] 2024-06-15 04:29:54,249 | INFO | end of generic workflow (traces error code: 0)
[2024-06-15 00:29:54] 2024-06-15 04:29:54,249 | INFO | traces error code: 0
[2024-06-15 00:29:54] 2024-06-15 04:29:54,249 | INFO | pilot has finished (exit code=0, shell exit code=0)
[2024-06-15 00:29:54] 2024-06-15 04:29:54,375 [wrapper] ==== pilot stdout END ====
[2024-06-15 00:29:54] 2024-06-15 04:29:54,376 [wrapper] ==== wrapper stdout RESUME ====
[2024-06-15 00:29:54] 2024-06-15 04:29:54,378 [wrapper] pilotpid: 27317
[2024-06-15 00:29:54] 2024-06-15 04:29:54,380 [wrapper] Pilot exit status: 0
[2024-06-15 00:29:54] 2024-06-15 04:29:54,406 [wrapper] pandaids: 6229471930 6229471930 6229471930
[2024-06-15 00:29:54] 2024-06-15 04:29:54,477 [wrapper] cleanup supervisor_pilot 30480 27318
[2024-06-15 00:29:54] 2024-06-15 04:29:54,491 [wrapper] Test setup, not cleaning
[2024-06-15 00:29:54] 2024-06-15 04:29:54,496 [wrapper] ==== wrapper stdout END ====
[2024-06-15 00:29:54] 2024-06-15 04:29:54,528 [wrapper] ==== wrapper stderr END ====
[2024-06-15 00:29:54] 2024-06-15 04:29:54,538 [wrapper] apfmon messages muted
[2024-06-15 00:29:54] *** Error codes and diagnostics ***
[2024-06-15 00:29:54] "exeErrorCode": 0,
[2024-06-15 00:29:54] "exeErrorDiag": "",
[2024-06-15 00:29:54] "pilotErrorCode": 0,
[2024-06-15 00:29:54] "pilotErrorDiag": "",
[2024-06-15 00:29:54] *** Listing of results directory ***
[2024-06-15 00:29:54] total 1406912
[2024-06-15 00:29:54] drwx------ 4 boincer umatlas 4096 Jun 12 06:00 pilot3
[2024-06-15 00:29:54] -rw-r--r-- 1 boincer umatlas 469766 Jun 13 11:09 pilot3.tar.gz
[2024-06-15 00:29:54] -rw-r--r-- 1 boincer umatlas 5654 Jun 13 11:48 queuedata.json
[2024-06-15 00:29:54] -rwx------ 1 boincer umatlas 32308 Jun 13 11:49 runpilot2-wrapper.sh
[2024-06-15 00:29:54] -rw-r--r-- 1 boincer umatlas 100 Jun 13 16:31 wrapper_26015_x86_64-pc-linux-gnu
[2024-06-15 00:29:54] -rwxr-xr-x 1 boincer umatlas 7986 Jun 13 16:31 run_atlas
[2024-06-15 00:29:54] -rw-r--r-- 1 boincer umatlas 105 Jun 13 16:31 job.xml
[2024-06-15 00:29:54] -rw-r--r-- 2 boincer umatlas 17537 Jun 13 16:31 start_atlas.sh
[2024-06-15 00:29:54] drwxrwx--x 2 boincer umatlas 4096 Jun 13 16:31 shared
[2024-06-15 00:29:54] -rw-r--r-- 2 boincer umatlas 482516 Jun 13 16:31 input.tar.gz
[2024-06-15 00:29:54] -rw-r--r-- 3 boincer umatlas 543332740 Jun 13 16:31 EVNT.38776210._000742.pool.root.1
[2024-06-15 00:29:54] -rw-r--r-- 3 boincer umatlas 543332740 Jun 13 16:31 ATLAS.root_0
[2024-06-15 00:29:54] -rw-r--r-- 1 boincer umatlas 0 Jun 13 16:31 boinc_lockfile
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 1316790 Jun 13 16:32 cric_ddmendpoints.json
[2024-06-15 00:29:54] -rw-r--r-- 1 boincer umatlas 2648 Jun 14 09:49 pandaJob.out
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 467 Jun 14 09:49 setup.sh.local
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 1020540 Jun 14 09:49 agis_schedconf.cvmfs.json
[2024-06-15 00:29:54] -rw-r--r-- 1 boincer umatlas 6387 Jun 15 00:27 init_data.xml
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 338102541 Jun 15 00:28 HITS.38921013._030123.pool.root.1
[2024-06-15 00:29:54] -rw-r--r-- 1 boincer umatlas 533 Jun 15 00:28 boinc_task_state.xml
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 96 Jun 15 00:28 pilot_heartbeat.json
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 1084 Jun 15 00:29 memory_monitor_summary.json
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 0 Jun 15 00:29 agis_ddmendpoints.agis.ALL.json
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 806108 Jun 15 00:29 log.38921013._030123.job.log.tgz.1
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 7754 Jun 15 00:29 heartbeat.json
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 4398 Jun 15 00:29 pilotlog.txt
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 5380719 Jun 15 00:29 log.38921013._030123.job.log.1
[2024-06-15 00:29:54] -rw-r--r-- 1 boincer umatlas 8192 Jun 15 00:29 boinc_mmap_file
[2024-06-15 00:29:54] -rw-r--r-- 1 boincer umatlas 29 Jun 15 00:29 wrapper_checkpoint.txt
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 357 Jun 15 00:29 output.list
[2024-06-15 00:29:54] -rw-r--r-- 1 boincer umatlas 620 Jun 15 00:29 runtime_log
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 6205440 Jun 15 00:29 result.tar.gz
[2024-06-15 00:29:54] -rw-r--r-- 1 boincer umatlas 11490 Jun 15 00:29 runtime_log.err
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 880 Jun 15 00:29 dXGMDmxs1b5n7Olcko1bjSoqABFKDmABFKDmOtvXDmTXoKDms1ojMo.diag
[2024-06-15 00:29:54] -rw-r--r-- 1 boincer umatlas 26379 Jun 15 00:29 stderr.txt
[2024-06-15 00:29:54] HITS file was successfully produced:
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 338102541 Jun 15 00:28 shared/HITS.pool.root.1
[2024-06-15 00:29:54] *** Contents of shared directory: ***
[2024-06-15 00:29:54] total 867340
[2024-06-15 00:29:54] -rw-r--r-- 2 boincer umatlas 17537 Jun 13 16:31 start_atlas.sh
[2024-06-15 00:29:54] -rw-r--r-- 2 boincer umatlas 482516 Jun 13 16:31 input.tar.gz
[2024-06-15 00:29:54] -rw-r--r-- 3 boincer umatlas 543332740 Jun 13 16:31 ATLAS.root_0
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 338102541 Jun 15 00:28 HITS.pool.root.1
[2024-06-15 00:29:54] -rw------- 1 boincer umatlas 6205440 Jun 15 00:29 result.tar.gz
00:29:56 (826): run_atlas exited; CPU time 140938.777180
00:29:56 (826): called boinc_finish(0)
</stderr_txt>
]]>
©2024 CERN