Name 7q0NDmidfe5n9Rq4apOajLDm4fhM0noT9bVo2ijZDmtgXKDm4HBDBo_0
Workunit 223678422
Created 20 Jun 2024, 22:40:59 UTC
Sent 21 Jun 2024, 4:37:33 UTC
Report deadline 29 Jun 2024, 4:37:33 UTC
Received 22 Jun 2024, 2:08:44 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10603296
Run time 2 hours 38 min 9 sec
CPU time 11 hours 43 min 47 sec
Validate state Valid
Credit 1,088.80
Device peak FLOPS 49.35 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.53 GB
Peak swap size 31.65 GB
Peak disk usage 1.41 GB

Stderr output

<core_client_version>7.16.11</core_client_version>
<![CDATA[
<stderr_txt>
14:34:59 (73958): wrapper (7.7.26015): starting
14:34:59 (73958): wrapper: running run_atlas (--nthreads 12)
[2024-06-21 14:34:59] Arguments: --nthreads 12
[2024-06-21 14:34:59] Threads: 12
[2024-06-21 14:34:59] Checking for CVMFS
[2024-06-21 14:34:59] Probing /cvmfs/atlas.cern.ch... OK
[2024-06-21 14:34:59] Probing /cvmfs/atlas-condb.cern.ch... OK
[2024-06-21 14:34:59] Running cvmfs_config stat atlas.cern.ch
[2024-06-21 14:34:59] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2024-06-21 14:34:59] 2.9.2.0 77876 234421 85888 134144 0 112 36341398 45568001 14350 130560 0 1396550290 99.779 905116034 16939 http://cvmfs-s1bnl.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://206.12.9.162:3129 1
[2024-06-21 14:34:59] CVMFS is ok
[2024-06-21 14:34:59] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-06-21 14:34:59] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-06-21 14:34:59] Further information can be found at the LHC@home message board.
[2024-06-21 14:34:59] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-06-21 14:34:59] Checking for apptainer binary...
[2024-06-21 14:34:59] Using apptainer found in PATH at /usr/bin/apptainer
[2024-06-21 14:34:59] Running /usr/bin/apptainer --version
[2024-06-21 14:35:00] apptainer version 1.3.2-1.el7
[2024-06-21 14:35:00] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-06-21 14:35:02] INFO: /etc/singularity/ exists; cleanup by system administrator is not complete (see https://apptainer.org/docs/admin/latest/singularity_migration.html) WARNING: Environment variable TMPDIR already has value [/home/boinc/slots/0/.apptainertmp], will not forward new value [/home/boinc] from parent process environment wns0099.triumf.lcg
[2024-06-21 14:35:02] apptainer works
[2024-06-21 14:35:02] Set ATHENA_PROC_NUMBER=12
[2024-06-21 14:35:02] Set ATHENA_CORE_NUMBER=12
[2024-06-21 14:35:02] Starting ATLAS job with PandaID=6239102138
[2024-06-21 14:35:02] Running command: /usr/bin/apptainer exec -B /cvmfs,/home/boinc/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2024-06-21 17:22:11]  *** The last 200 lines of the pilot log: ***
[2024-06-21 17:22:11] 2024-06-22 00:21:55,052 | INFO     | right removable region: 157
[2024-06-21 17:22:11] 2024-06-22 00:21:55,052 | INFO     | model: linear, x: [1719006070.0, 1719006131.0, 1719006192.0, 1719006253.0, 1719006314.0, 1719006375.0, 1719006436.0, 1719006497.0, 1719006558.0, 1719006619.0, 1719
[2024-06-21 17:22:11] 2024-06-22 00:21:55,052 | INFO     | sum of square deviations: 1223017421.4683614
[2024-06-21 17:22:11] 2024-06-22 00:21:55,052 | INFO     | sum of deviations: 85128454453.99994
[2024-06-21 17:22:11] 2024-06-22 00:21:55,052 | INFO     | mean x: 1719010858.8734176
[2024-06-21 17:22:11] 2024-06-22 00:21:55,052 | INFO     | mean y: 2633495.0
[2024-06-21 17:22:11] 2024-06-22 00:21:55,052 | INFO     | -- intersect: -119649576716.23671
[2024-06-21 17:22:11] 2024-06-22 00:21:55,052 | INFO     | intersect: -119649576716.23671
[2024-06-21 17:22:11] 2024-06-22 00:21:55,053 | INFO     | chi2: 3.6738036160047147
[2024-06-21 17:22:11] 2024-06-22 00:21:55,053 | INFO     | current chi2=3.6738036160047147 (change=47.84210425086906 %)
[2024-06-21 17:22:11] 2024-06-22 00:21:55,053 | INFO     | model: linear, x: [1719006375.0, 1719006436.0, 1719006497.0, 1719006558.0, 1719006619.0, 1719006680.0, 1719006741.0, 1719006802.0, 1719006863.0, 1719006926.0, 1719
[2024-06-21 17:22:11] 2024-06-22 00:21:55,053 | INFO     | sum of square deviations: 1110522898.24837
[2024-06-21 17:22:11] 2024-06-22 00:21:55,053 | INFO     | sum of deviations: 46074974300.464035
[2024-06-21 17:22:11] 2024-06-22 00:21:55,053 | INFO     | mean x: 1719011011.3856208
[2024-06-21 17:22:11] 2024-06-22 00:21:55,053 | INFO     | mean y: 2686423.4836601308
[2024-06-21 17:22:11] 2024-06-22 00:21:55,053 | INFO     | -- intersect: -71318119565.05998
[2024-06-21 17:22:11] 2024-06-22 00:21:55,054 | INFO     | intersect: -71318119565.05998
[2024-06-21 17:22:11] 2024-06-22 00:21:55,054 | INFO     | chi2: 1.7273019984243159
[2024-06-21 17:22:11] 2024-06-22 00:21:55,054 | INFO     | current chi2=1.7273019984243159 (change=52.98327894013105 %)
[2024-06-21 17:22:11] 2024-06-22 00:21:55,054 | INFO     | model: linear, x: [1719006680.0, 1719006741.0, 1719006802.0, 1719006863.0, 1719006926.0, 1719006985.0, 1719007046.0, 1719007107.0, 1719007168.0, 1719007229.0, 1719
[2024-06-21 17:22:11] 2024-06-22 00:21:55,054 | INFO     | sum of square deviations: 1005144787.4797282
[2024-06-21 17:22:11] 2024-06-22 00:21:55,054 | INFO     | sum of deviations: 11809900935.229738
[2024-06-21 17:22:11] 2024-06-22 00:21:55,054 | INFO     | mean x: 1719011163.8986487
[2024-06-21 17:22:11] 2024-06-22 00:21:55,054 | INFO     | mean y: 2735909.1486486485
[2024-06-21 17:22:11] 2024-06-22 00:21:55,055 | INFO     | -- intersect: -20194704106.533123
[2024-06-21 17:22:11] 2024-06-22 00:21:55,055 | INFO     | intersect: -20194704106.533123
[2024-06-21 17:22:11] 2024-06-22 00:21:55,055 | INFO     | chi2: 0.1702261742495365
[2024-06-21 17:22:11] 2024-06-22 00:21:55,055 | INFO     | current chi2=0.1702261742495365 (change=90.14496744606208 %)
[2024-06-21 17:22:11] 2024-06-22 00:21:55,055 | INFO     | model: linear, x: [1719006985.0, 1719007046.0, 1719007107.0, 1719007168.0, 1719007229.0, 1719007290.0, 1719007355.0, 1719007412.0, 1719007474.0, 1719007534.0, 1719
[2024-06-21 17:22:11] 2024-06-22 00:21:55,055 | INFO     | sum of square deviations: 906668092.2797182
[2024-06-21 17:22:11] 2024-06-22 00:21:55,055 | INFO     | sum of deviations: 1138194648.0349648
[2024-06-21 17:22:11] 2024-06-22 00:21:55,055 | INFO     | mean x: 1719011316.3986013
[2024-06-21 17:22:11] 2024-06-22 00:21:55,055 | INFO     | mean y: 2752326.1748251747
[2024-06-21 17:22:11] 2024-06-22 00:21:55,056 | INFO     | -- intersect: -2155225325.0700164
[2024-06-21 17:22:11] 2024-06-22 00:21:55,056 | INFO     | intersect: -2155225325.0700164
[2024-06-21 17:22:11] 2024-06-22 00:21:55,056 | INFO     | chi2: 0.004570311598808253
[2024-06-21 17:22:11] 2024-06-22 00:21:55,056 | INFO     | current chi2=0.004570311598808253 (change=97.31515343104135 %)
[2024-06-21 17:22:11] 2024-06-22 00:21:55,056 | INFO     | model: linear, x: [1719007290.0, 1719007355.0, 1719007412.0, 1719007474.0, 1719007534.0, 1719007595.0, 1719007656.0, 1719007717.0, 1719007778.0, 1719007840.0, 1719
[2024-06-21 17:22:11] 2024-06-22 00:21:55,056 | INFO     | sum of square deviations: 814825728.9565233
[2024-06-21 17:22:11] 2024-06-22 00:21:55,056 | INFO     | sum of deviations: 1197365431.9565215
[2024-06-21 17:22:11] 2024-06-22 00:21:55,056 | INFO     | mean x: 1719011468.9130435
[2024-06-21 17:22:11] 2024-06-22 00:21:55,057 | INFO     | mean y: 2752208.079710145
[2024-06-21 17:22:11] 2024-06-22 00:21:55,057 | INFO     | -- intersect: -2523290891.527795
[2024-06-21 17:22:11] 2024-06-22 00:21:55,057 | INFO     | intersect: -2523290891.527795
[2024-06-21 17:22:11] 2024-06-22 00:21:55,057 | INFO     | chi2: 0.003936240734150636
[2024-06-21 17:22:11] 2024-06-22 00:21:55,057 | INFO     | current chi2=0.003936240734150636 (change=13.873690030740052 %)
[2024-06-21 17:22:11] 2024-06-22 00:21:55,057 | INFO     | left removable region: 50
[2024-06-21 17:22:11] 2024-06-22 00:21:55,057 | INFO     | model: linear, x: [1719008816.0, 1719008877.0, 1719008939.0, 1719008998.0, 1719009063.0, 1719009120.0, 1719009182.0, 1719009244.0, 1719009303.0, 1719009364.0, 1719
[2024-06-21 17:22:11] 2024-06-22 00:21:55,057 | INFO     | sum of square deviations: 379776668.22429985
[2024-06-21 17:22:11] 2024-06-22 00:21:55,057 | INFO     | sum of deviations: 927948982.4953271
[2024-06-21 17:22:11] 2024-06-22 00:21:55,057 | INFO     | mean x: 1719012048.4299066
[2024-06-21 17:22:11] 2024-06-22 00:21:55,057 | INFO     | mean y: 2752561.5327102803
[2024-06-21 17:22:11] 2024-06-22 00:21:55,058 | INFO     | -- intersect: -4197493569.1633058
[2024-06-21 17:22:11] 2024-06-22 00:21:55,058 | INFO     | intersect: -4197493569.1633058
[2024-06-21 17:22:11] 2024-06-22 00:21:55,058 | INFO     | chi2: 0.00019947069782135787
[2024-06-21 17:22:11] 2024-06-22 00:21:55,058 | INFO     | -- intersect: -4197493569.1633058
[2024-06-21 17:22:11] 2024-06-22 00:21:55,058 | INFO     | current memory leak: 2.44 B/s (using 107 data points, chi2=0.00)
[2024-06-21 17:22:11] 2024-06-22 00:21:55,058 | INFO     | ..............................
[2024-06-21 17:22:11] 2024-06-22 00:21:55,058 | INFO     | . Timing measurements:
[2024-06-21 17:22:11] 2024-06-22 00:21:55,058 | INFO     | . get job = 0 s
[2024-06-21 17:22:11] 2024-06-22 00:21:55,058 | INFO     | . initial setup = 2 s
[2024-06-21 17:22:11] 2024-06-22 00:21:55,058 | INFO     | . payload setup = 13 s
[2024-06-21 17:22:11] 2024-06-22 00:21:55,058 | INFO     | . stage-in = 0 s
[2024-06-21 17:22:11] 2024-06-22 00:21:55,059 | INFO     | . payload execution = 9937 s
[2024-06-21 17:22:11] 2024-06-22 00:21:55,059 | INFO     | . stage-out = 11 s
[2024-06-21 17:22:11] 2024-06-22 00:21:55,059 | INFO     | . log creation = 0 s
[2024-06-21 17:22:11] 2024-06-22 00:21:55,059 | INFO     | ..............................
[2024-06-21 17:22:11] 2024-06-22 00:21:55,116 | INFO     | 
[2024-06-21 17:22:11] 2024-06-22 00:21:55,117 | INFO     | job summary report
[2024-06-21 17:22:11] 2024-06-22 00:21:55,117 | INFO     | --------------------------------------------------
[2024-06-21 17:22:11] 2024-06-22 00:21:55,117 | INFO     | PanDA job id: 6239102138
[2024-06-21 17:22:11] 2024-06-22 00:21:55,117 | INFO     | task id: 40024049
[2024-06-21 17:22:11] 2024-06-22 00:21:55,117 | INFO     | errors: (none)
[2024-06-21 17:22:11] 2024-06-22 00:21:55,117 | INFO     | status: LOG_TRANSFER = DONE 
[2024-06-21 17:22:11] 2024-06-22 00:21:55,117 | INFO     | pilot state: finished 
[2024-06-21 17:22:11] 2024-06-22 00:21:55,118 | INFO     | transexitcode: 0
[2024-06-21 17:22:11] 2024-06-22 00:21:55,118 | INFO     | exeerrorcode: 0
[2024-06-21 17:22:11] 2024-06-22 00:21:55,118 | INFO     | exeerrordiag: 
[2024-06-21 17:22:11] 2024-06-22 00:21:55,118 | INFO     | exitcode: 0
[2024-06-21 17:22:11] 2024-06-22 00:21:55,118 | INFO     | exitmsg: OK
[2024-06-21 17:22:11] 2024-06-22 00:21:55,118 | INFO     | cpuconsumptiontime: 42385 s
[2024-06-21 17:22:11] 2024-06-22 00:21:55,118 | INFO     | nevents: 400
[2024-06-21 17:22:11] 2024-06-22 00:21:55,118 | INFO     | neventsw: 0
[2024-06-21 17:22:11] 2024-06-22 00:21:55,118 | INFO     | pid: 146334
[2024-06-21 17:22:11] 2024-06-22 00:21:55,119 | INFO     | pgrp: 146334
[2024-06-21 17:22:11] 2024-06-22 00:21:55,119 | INFO     | corecount: 12
[2024-06-21 17:22:11] 2024-06-22 00:21:55,119 | INFO     | event service: False
[2024-06-21 17:22:11] 2024-06-22 00:21:55,119 | INFO     | sizes: {0: 2386878, 7: 2387084, 11: 2387112, 9954: 2415023, 9966: 2423977, 9967: 2424033, 9974: 2424331}
[2024-06-21 17:22:11] 2024-06-22 00:21:55,119 | INFO     | --------------------------------------------------
[2024-06-21 17:22:11] 2024-06-22 00:21:55,119 | INFO     | 
[2024-06-21 17:22:11] 2024-06-22 00:21:55,119 | INFO     | executing command: ls -lF /home/boinc/slots/0
[2024-06-21 17:22:11] 2024-06-22 00:21:55,150 | INFO     | queue jobs had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,150 | INFO     | queue payloads had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,150 | INFO     | queue data_in had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,158 | INFO     | queue data_out had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue current_data_in had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue completed_jobids has 1 job(s)
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,159 | INFO     | queue messages had 0 job(s) [purged]
[2024-06-21 17:22:11] 2024-06-22 00:21:55,160 | INFO     | job 6239102138 has completed (purged errors)
[2024-06-21 17:22:11] 2024-06-22 00:21:55,160 | INFO     | overall cleanup function is called
[2024-06-21 17:22:11] 2024-06-22 00:21:56,168 | INFO     | --- collectZombieJob: --- 10, [146334]
[2024-06-21 17:22:11] 2024-06-22 00:21:56,168 | INFO     | zombie collector waiting for pid 146334
[2024-06-21 17:22:11] 2024-06-22 00:21:56,168 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2024-06-21 17:22:11] 2024-06-22 00:21:57,171 | INFO     | collected zombie processes
[2024-06-21 17:22:11] 2024-06-22 00:21:57,171 | INFO     | will now attempt to kill all subprocesses of pid=146334
[2024-06-21 17:22:11] 2024-06-22 00:21:57,424 | INFO     | process IDs to be killed: [146334] (in reverse order)
[2024-06-21 17:22:11] 2024-06-22 00:21:57,531 | WARNING  | found no corresponding commands to process id(s)
[2024-06-21 17:22:11] 2024-06-22 00:21:57,531 | INFO     | Do not look for orphan processes in BOINC jobs
[2024-06-21 17:22:11] 2024-06-22 00:21:57,538 | INFO     | did not find any defunct processes belonging to 146334
[2024-06-21 17:22:11] 2024-06-22 00:21:57,545 | INFO     | did not find any defunct processes belonging to 146334
[2024-06-21 17:22:11] 2024-06-22 00:21:57,545 | INFO     | ready for new job
[2024-06-21 17:22:11] 2024-06-22 00:21:57,545 | INFO     | pilot has finished with previous job - re-establishing logging
[2024-06-21 17:22:11] 2024-06-22 00:21:57,556 | INFO     | *************************************
[2024-06-21 17:22:11] 2024-06-22 00:21:57,556 | INFO     | ***  PanDA Pilot version 3.7.7.3  ***
[2024-06-21 17:22:11] 2024-06-22 00:21:57,556 | INFO     | *************************************
[2024-06-21 17:22:11] 2024-06-22 00:21:57,556 | INFO     | 
[2024-06-21 17:22:11] 2024-06-22 00:21:57,558 | INFO     | architecture information:
[2024-06-21 17:22:11] 2024-06-22 00:21:57,559 | INFO     | executing command: cat /etc/os-release
[2024-06-21 17:22:11] 2024-06-22 00:21:57,597 | INFO     | cat /etc/os-release:
[2024-06-21 17:22:11] NAME="CentOS Linux"
[2024-06-21 17:22:11] VERSION="7 (Core)"
[2024-06-21 17:22:11] ID="centos"
[2024-06-21 17:22:11] ID_LIKE="rhel fedora"
[2024-06-21 17:22:11] VERSION_ID="7"
[2024-06-21 17:22:11] PRETTY_NAME="CentOS Linux 7 (Core)"
[2024-06-21 17:22:11] ANSI_COLOR="0;31"
[2024-06-21 17:22:11] CPE_NAME="cpe:/o:centos:centos:7"
[2024-06-21 17:22:11] HOME_URL="https://www.centos.org/"
[2024-06-21 17:22:11] BUG_REPORT_URL="https://bugs.centos.org/"
[2024-06-21 17:22:11] 
[2024-06-21 17:22:11] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2024-06-21 17:22:11] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2024-06-21 17:22:11] REDHAT_SUPPORT_PRODUCT="centos"
[2024-06-21 17:22:11] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2024-06-21 17:22:11] 
[2024-06-21 17:22:11] 2024-06-22 00:21:57,597 | INFO     | *************************************
[2024-06-21 17:22:11] 2024-06-22 00:21:58,099 | INFO     | executing command: df -mP /home/boinc/slots/0
[2024-06-21 17:22:11] 2024-06-22 00:21:58,140 | INFO     | sufficient remaining disk space (1514286350336 B)
[2024-06-21 17:22:11] 2024-06-22 00:21:58,140 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2024-06-21 17:22:11] 2024-06-22 00:21:58,141 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2024-06-21 17:22:11] 2024-06-22 00:21:58,141 | WARNING  | aborting monitor loop since graceful_stop has been set (timing out remaining threads)
[2024-06-21 17:22:11] 2024-06-22 00:21:58,141 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2024-06-21 17:22:11] 2024-06-22 00:21:58,142 | INFO     | found 0 job(s) in 20 queues
[2024-06-21 17:22:11] 2024-06-22 00:21:58,142 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2024-06-21 17:22:11] 2024-06-22 00:21:58,142 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2024-06-21 17:22:11] 2024-06-22 00:21:58,329 | WARNING  | job monitor detected an abort_job request (signal=args.signal)
[2024-06-21 17:22:11] 2024-06-22 00:21:58,330 | WARNING  | cannot recover job monitoring - aborting pilot
[2024-06-21 17:22:11] 2024-06-22 00:21:58,330 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2024-06-21 17:22:11] 2024-06-22 00:21:58,330 | INFO     | will abort loop
[2024-06-21 17:22:11] 2024-06-22 00:21:58,356 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2024-06-21 17:22:11] 2024-06-22 00:21:58,491 | INFO     | all job control threads have been joined
[2024-06-21 17:22:11] 2024-06-22 00:21:58,898 | INFO     | all data control threads have been joined
[2024-06-21 17:22:11] 2024-06-22 00:21:59,146 | INFO     | [job] retrieve thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:21:59,335 | INFO     | [job] job monitor thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:21:59,391 | INFO     | all payload control threads have been joined
[2024-06-21 17:22:11] 2024-06-22 00:21:59,433 | INFO     | [job] create_data_payload thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:21:59,434 | INFO     | [data] copytool_in thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:21:59,496 | INFO     | [job] control thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:21:59,814 | INFO     | [payload] validate_pre thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:21:59,903 | INFO     | [data] control thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:22:00,126 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2024-06-21 17:22:11] 2024-06-22 00:22:00,143 | INFO     | [data] copytool_out thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:22:00,337 | INFO     | [payload] failed_post thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:22:00,363 | INFO     | [payload] run_realtimelog thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:22:00,396 | INFO     | [payload] control thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:22:00,508 | INFO     | [payload] execute_payloads thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:22:00,585 | INFO     | [payload] validate_post thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:22:00,597 | INFO     | [job] validate thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:22:01,127 | INFO     | [job] queue monitor thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:22:02,357 | INFO     | [data] queue_monitor thread has finished
[2024-06-21 17:22:11] 2024-06-22 00:22:03,991 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139853881071424)>', '<ExcThread(monitor, started 139853329069824)>']
[2024-06-21 17:22:11] 2024-06-22 00:22:04,158 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2024-06-21 17:22:11] 2024-06-22 00:22:04,158 | INFO     | [monitor] control thread has ended
[2024-06-21 17:22:11] 2024-06-22 00:22:09,016 | INFO     | all workflow threads have been joined
[2024-06-21 17:22:11] 2024-06-22 00:22:09,017 | INFO     | end of generic workflow (traces error code: 0)
[2024-06-21 17:22:11] 2024-06-22 00:22:09,018 | INFO     | traces error code: 0
[2024-06-21 17:22:11] 2024-06-22 00:22:09,018 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2024-06-21 17:22:11] 2024-06-22 00:22:09,721 [wrapper] ==== pilot stdout END ====
[2024-06-21 17:22:11] 2024-06-22 00:22:10,107 [wrapper] ==== wrapper stdout RESUME ====
[2024-06-21 17:22:11] 2024-06-22 00:22:10,116 [wrapper] pilotpid: 81505
[2024-06-21 17:22:11] 2024-06-22 00:22:10,123 [wrapper] Pilot exit status: 0
[2024-06-21 17:22:11] 2024-06-22 00:22:10,143 [wrapper] pandaids: 6239102138
[2024-06-21 17:22:11] 2024-06-22 00:22:10,216 [wrapper] cleanup supervisor_pilot  59533 81506
[2024-06-21 17:22:11] 2024-06-22 00:22:10,225 [wrapper] Test setup, not cleaning
[2024-06-21 17:22:11] 2024-06-22 00:22:10,230 [wrapper] ==== wrapper stdout END ====
[2024-06-21 17:22:11] 2024-06-22 00:22:10,236 [wrapper] ==== wrapper stderr END ====
[2024-06-21 17:22:11] 2024-06-22 00:22:10,246 [wrapper] apfmon messages muted
[2024-06-21 17:22:11]  *** Error codes and diagnostics ***
[2024-06-21 17:22:11]     "exeErrorCode": 0,
[2024-06-21 17:22:11]     "exeErrorDiag": "",
[2024-06-21 17:22:11]     "pilotErrorCode": 0,
[2024-06-21 17:22:11]     "pilotErrorDiag": "",
[2024-06-21 17:22:11]  *** Listing of results directory ***
[2024-06-21 17:22:11] total 870808
[2024-06-21 17:22:11] -rw-r--r-- 1 boinc boinc    469766 Jun 20 15:34 pilot3.tar.gz
[2024-06-21 17:22:11] -rw-r--r-- 1 boinc boinc      5654 Jun 20 15:40 queuedata.json
[2024-06-21 17:22:11] -rwx------ 1 boinc boinc     32308 Jun 20 15:40 runpilot2-wrapper.sh
[2024-06-21 17:22:11] -rw-r--r-- 1 boinc boinc       100 Jun 21 14:34 wrapper_26015_x86_64-pc-linux-gnu
[2024-06-21 17:22:11] -rwxr-xr-x 1 boinc boinc      7986 Jun 21 14:34 run_atlas
[2024-06-21 17:22:11] -rw-r--r-- 1 boinc boinc       105 Jun 21 14:34 job.xml
[2024-06-21 17:22:11] -rw-r--r-- 2 boinc boinc 615117132 Jun 21 14:34 EVNT.40024047._000058.pool.root.1
[2024-06-21 17:22:11] -rw-r--r-- 1 boinc boinc      6628 Jun 21 14:34 init_data.xml
[2024-06-21 17:22:11] drwxrwx--x 2 boinc boinc      4096 Jun 21 14:34 shared
[2024-06-21 17:22:11] -rw-r--r-- 2 boinc boinc    482487 Jun 21 14:34 input.tar.gz
[2024-06-21 17:22:11] -rw-r--r-- 2 boinc boinc     17537 Jun 21 14:34 start_atlas.sh
[2024-06-21 17:22:11] -rw-r--r-- 1 boinc boinc         0 Jun 21 14:34 boinc_lockfile
[2024-06-21 17:22:11] -rw-r--r-- 1 boinc boinc      2504 Jun 21 14:35 pandaJob.out
[2024-06-21 17:22:11] -rw------- 1 boinc boinc       424 Jun 21 14:35 setup.sh.local
[2024-06-21 17:22:11] -rw------- 1 boinc boinc   1025624 Jun 21 14:35 agis_schedconf.cvmfs.json
[2024-06-21 17:22:11] -rw------- 1 boinc boinc         0 Jun 21 14:35 agis_ddmendpoints.agis.ALL.json
[2024-06-21 17:22:11] -rw------- 1 boinc boinc   1321363 Jun 21 14:35 cric_ddmendpoints.json
[2024-06-21 17:22:11] drwx------ 4 boinc boinc      4096 Jun 21 14:35 pilot3
[2024-06-21 17:22:11] -rw------- 1 boinc boinc 270591029 Jun 21 17:20 HITS.40024049._001224.pool.root.1
[2024-06-21 17:22:11] -rw-r--r-- 1 boinc boinc       531 Jun 21 17:20 boinc_task_state.xml
[2024-06-21 17:22:11] -rw------- 1 boinc boinc        95 Jun 21 17:20 pilot_heartbeat.json
[2024-06-21 17:22:11] -rw------- 1 boinc boinc      1071 Jun 21 17:21 memory_monitor_summary.json
[2024-06-21 17:22:11] -rw------- 1 boinc boinc    424900 Jun 21 17:21 log.40024049._001224.job.log.tgz.1
[2024-06-21 17:22:11] -rw-r--r-- 1 boinc boinc        27 Jun 21 17:21 wrapper_checkpoint.txt
[2024-06-21 17:22:11] -rw-r--r-- 1 boinc boinc      8192 Jun 21 17:21 boinc_mmap_file
[2024-06-21 17:22:11] -rw------- 1 boinc boinc      7802 Jun 21 17:21 heartbeat.json
[2024-06-21 17:22:11] -rw------- 1 boinc boinc      4519 Jun 21 17:22 pilotlog.txt
[2024-06-21 17:22:11] -rw------- 1 boinc boinc    803110 Jun 21 17:22 log.40024049._001224.job.log.1
[2024-06-21 17:22:11] -rw------- 1 boinc boinc       357 Jun 21 17:22 output.list
[2024-06-21 17:22:11] -rw-r--r-- 1 boinc boinc       620 Jun 21 17:22 runtime_log
[2024-06-21 17:22:11] -rw------- 1 boinc boinc   1249280 Jun 21 17:22 result.tar.gz
[2024-06-21 17:22:11] -rw-r--r-- 1 boinc boinc     11287 Jun 21 17:22 runtime_log.err
[2024-06-21 17:22:11] -rw------- 1 boinc boinc       660 Jun 21 17:22 7q0NDmidfe5n9Rq4apOajLDm4fhM0noT9bVo2ijZDmtgXKDm4HBDBo.diag
[2024-06-21 17:22:11] -rw-r--r-- 1 boinc boinc     21998 Jun 21 17:22 stderr.txt
[2024-06-21 17:22:11] HITS file was successfully produced:
[2024-06-21 17:22:11] -rw------- 1 boinc boinc 270591029 Jun 21 17:20 shared/HITS.pool.root.1
[2024-06-21 17:22:11]  *** Contents of shared directory: ***
[2024-06-21 17:22:11] total 866676
[2024-06-21 17:22:11] -rw-r--r-- 2 boinc boinc 615117132 Jun 21 14:34 ATLAS.root_0
[2024-06-21 17:22:11] -rw-r--r-- 2 boinc boinc    482487 Jun 21 14:34 input.tar.gz
[2024-06-21 17:22:11] -rw-r--r-- 2 boinc boinc     17537 Jun 21 14:34 start_atlas.sh
[2024-06-21 17:22:11] -rw------- 1 boinc boinc 270591029 Jun 21 17:20 HITS.pool.root.1
[2024-06-21 17:22:11] -rw------- 1 boinc boinc   1249280 Jun 21 17:22 result.tar.gz
17:22:12 (73958): run_atlas exited; CPU time 41985.373663
17:22:12 (73958): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN