Name okzNDmgede5n9Rq4apOajLDm4fhM0noT9bVo2ijZDmbcXKDmxl8gpn_0
Workunit 223677017
Created 20 Jun 2024, 20:34:00 UTC
Sent 21 Jun 2024, 1:56:36 UTC
Report deadline 29 Jun 2024, 1:56:36 UTC
Received 21 Jun 2024, 7:09:28 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10829975
Run time 5 hours 1 min 48 sec
CPU time 14 hours 49 min 0 sec
Validate state Valid
Credit 762.83
Device peak FLOPS 41.21 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.36 GB
Peak swap size 31.65 GB
Peak disk usage 1.36 GB

Stderr output

<core_client_version>7.7.0</core_client_version>
<![CDATA[
<stderr_txt>
21:57:24 (60742): wrapper (7.7.26015): starting
21:57:24 (60742): wrapper: running run_atlas (--nthreads 8)
[2024-06-20 21:57:24] Arguments: --nthreads 8
[2024-06-20 21:57:24] Threads: 8
[2024-06-20 21:57:24] Checking for CVMFS
[2024-06-20 21:57:24] Probing /cvmfs/atlas.cern.ch... OK
[2024-06-20 21:57:25] Probing /cvmfs/atlas-condb.cern.ch... OK
[2024-06-20 21:57:25] Running cvmfs_config stat atlas.cern.ch
[2024-06-20 21:57:26] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2024-06-20 21:57:26] 2.11.2.0 56809 14621 133124 134108 1 214 16631707 18432001 18434 130560 0 2487735 99.219 3107695 55321 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2024-06-20 21:57:26] CVMFS is ok
[2024-06-20 21:57:26] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-06-20 21:57:26] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-06-20 21:57:26] Further information can be found at the LHC@home message board.
[2024-06-20 21:57:26] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-06-20 21:57:26] Checking for apptainer binary...
[2024-06-20 21:57:26] Using apptainer found in PATH at /usr/bin/apptainer
[2024-06-20 21:57:26] Running /usr/bin/apptainer --version
[2024-06-20 21:57:27] apptainer version 1.3.1-1.el7
[2024-06-20 21:57:27] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-06-20 21:57:33] c-212-19.aglt2.org
[2024-06-20 21:57:33] apptainer works
[2024-06-20 21:57:33] Set ATHENA_PROC_NUMBER=8
[2024-06-20 21:57:33] Set ATHENA_CORE_NUMBER=8
[2024-06-20 21:57:33] Starting ATLAS job with PandaID=6239051994
[2024-06-20 21:57:33] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/5 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2024-06-21 02:59:08]  *** The last 200 lines of the pilot log: ***
[2024-06-21 02:59:08] 2024-06-21 06:58:49,750 | INFO     | chi2: 9.742189562421878
[2024-06-21 02:59:08] 2024-06-21 06:58:49,750 | INFO     | current chi2=9.742189562421878 (change=13.867489937161878 %)
[2024-06-21 02:59:08] 2024-06-21 06:58:49,750 | INFO     | right removable region: 285
[2024-06-21 02:59:08] 2024-06-21 06:58:49,750 | INFO     | model: linear, x: [1718935677.0, 1718935738.0, 1718935799.0, 1718935860.0, 1718935921.0, 1718935982.0, 1718936043.0, 1718936104.0, 1718936165.0, 1718936226.0, 1718
[2024-06-21 02:59:08] 2024-06-21 06:58:49,750 | INFO     | sum of square deviations: 7253969923.150336
[2024-06-21 02:59:08] 2024-06-21 06:58:49,752 | INFO     | sum of deviations: 163909612599.21347
[2024-06-21 02:59:08] 2024-06-21 06:58:49,752 | INFO     | mean x: 1718944369.534965
[2024-06-21 02:59:08] 2024-06-21 06:58:49,752 | INFO     | mean y: 2443140.8286713287
[2024-06-21 02:59:08] 2024-06-21 06:58:49,771 | INFO     | -- intersect: -38838565117.407
[2024-06-21 02:59:08] 2024-06-21 06:58:49,771 | INFO     | intersect: -38838565117.407
[2024-06-21 02:59:08] 2024-06-21 06:58:49,772 | INFO     | chi2: 6.822722198076816
[2024-06-21 02:59:08] 2024-06-21 06:58:49,772 | INFO     | current chi2=6.822722198076816 (change=39.6790439544978 %)
[2024-06-21 02:59:08] 2024-06-21 06:58:49,772 | INFO     | model: linear, x: [1718935982.0, 1718936043.0, 1718936104.0, 1718936165.0, 1718936226.0, 1718936287.0, 1718936348.0, 1718936409.0, 1718936470.0, 1718936531.0, 1718
[2024-06-21 02:59:08] 2024-06-21 06:58:49,772 | INFO     | sum of square deviations: 6880127305.644126
[2024-06-21 02:59:08] 2024-06-21 06:58:49,774 | INFO     | sum of deviations: 96603842262.75452
[2024-06-21 02:59:08] 2024-06-21 06:58:49,774 | INFO     | mean x: 1718944522.035587
[2024-06-21 02:59:08] 2024-06-21 06:58:49,774 | INFO     | mean y: 2470595.1245551603
[2024-06-21 02:59:08] 2024-06-21 06:58:49,774 | INFO     | -- intersect: -24133223133.816612
[2024-06-21 02:59:08] 2024-06-21 06:58:49,774 | INFO     | intersect: -24133223133.816612
[2024-06-21 02:59:08] 2024-06-21 06:58:49,794 | INFO     | chi2: 4.756937381348632
[2024-06-21 02:59:08] 2024-06-21 06:58:49,794 | INFO     | current chi2=4.756937381348632 (change=30.278014504393653 %)
[2024-06-21 02:59:08] 2024-06-21 06:58:49,794 | INFO     | model: linear, x: [1718936287.0, 1718936348.0, 1718936409.0, 1718936470.0, 1718936531.0, 1718936592.0, 1718936653.0, 1718936714.0, 1718936775.0, 1718936836.0, 1718
[2024-06-21 02:59:08] 2024-06-21 06:58:49,794 | INFO     | sum of square deviations: 6519354700.637695
[2024-06-21 02:59:08] 2024-06-21 06:58:49,796 | INFO     | sum of deviations: 33317948157.449276
[2024-06-21 02:59:08] 2024-06-21 06:58:49,796 | INFO     | mean x: 1718944674.536232
[2024-06-21 02:59:08] 2024-06-21 06:58:49,796 | INFO     | mean y: 2497348.855072464
[2024-06-21 02:59:08] 2024-06-21 06:58:49,796 | INFO     | -- intersect: -8782376642.75634
[2024-06-21 02:59:08] 2024-06-21 06:58:49,796 | INFO     | intersect: -8782376642.75634
[2024-06-21 02:59:08] 2024-06-21 06:58:49,796 | INFO     | chi2: 2.945882423480618
[2024-06-21 02:59:08] 2024-06-21 06:58:49,797 | INFO     | current chi2=2.945882423480618 (change=38.071868781980164 %)
[2024-06-21 02:59:08] 2024-06-21 06:58:49,797 | INFO     | model: linear, x: [1718936592.0, 1718936653.0, 1718936714.0, 1718936775.0, 1718936836.0, 1718936897.0, 1718936958.0, 1718937019.0, 1718937080.0, 1718937141.0, 1718
[2024-06-21 02:59:08] 2024-06-21 06:58:49,797 | INFO     | sum of square deviations: 6171419545.631035
[2024-06-21 02:59:08] 2024-06-21 06:58:49,803 | INFO     | sum of deviations: -14976566519.631
[2024-06-21 02:59:08] 2024-06-21 06:58:49,804 | INFO     | mean x: 1718944827.0369003
[2024-06-21 02:59:08] 2024-06-21 06:58:49,804 | INFO     | mean y: 2518450.963099631
[2024-06-21 02:59:08] 2024-06-21 06:58:49,804 | INFO     | -- intersect: 4173988459.6613
[2024-06-21 02:59:08] 2024-06-21 06:58:49,804 | INFO     | intersect: 4173988459.6613
[2024-06-21 02:59:08] 2024-06-21 06:58:49,804 | INFO     | chi2: 1.7907256050724838
[2024-06-21 02:59:08] 2024-06-21 06:58:49,804 | INFO     | current chi2=1.7907256050724838 (change=39.21259074024053 %)
[2024-06-21 02:59:08] 2024-06-21 06:58:49,805 | INFO     | model: linear, x: [1718936897.0, 1718936958.0, 1718937019.0, 1718937080.0, 1718937141.0, 1718937202.0, 1718937263.0, 1718937324.0, 1718937385.0, 1718937446.0, 1718
[2024-06-21 02:59:08] 2024-06-21 06:58:49,805 | INFO     | sum of square deviations: 5836089278.124023
[2024-06-21 02:59:08] 2024-06-21 06:58:49,806 | INFO     | sum of deviations: -29546035457.924812
[2024-06-21 02:59:08] 2024-06-21 06:58:49,806 | INFO     | mean x: 1718944979.537594
[2024-06-21 02:59:08] 2024-06-21 06:58:49,806 | INFO     | mean y: 2525069.992481203
[2024-06-21 02:59:08] 2024-06-21 06:58:49,806 | INFO     | -- intersect: 8704929521.893723
[2024-06-21 02:59:08] 2024-06-21 06:58:49,807 | INFO     | intersect: 8704929521.893723
[2024-06-21 02:59:08] 2024-06-21 06:58:49,807 | INFO     | chi2: 1.6914121691868937
[2024-06-21 02:59:08] 2024-06-21 06:58:49,807 | INFO     | current chi2=1.6914121691868937 (change=5.545988486693365 %)
[2024-06-21 02:59:08] 2024-06-21 06:58:49,807 | INFO     | left removable region: 50
[2024-06-21 02:59:08] 2024-06-21 06:58:49,807 | INFO     | model: linear, x: [1718938422.0, 1718938483.0, 1718938544.0, 1718938605.0, 1718938666.0, 1718938727.0, 1718938788.0, 1718938849.0, 1718938910.0, 1718938971.0, 1718
[2024-06-21 02:59:08] 2024-06-21 06:58:49,807 | INFO     | sum of square deviations: 4024201855.574455
[2024-06-21 02:59:08] 2024-06-21 06:58:49,814 | INFO     | sum of deviations: 3984996083.425534
[2024-06-21 02:59:08] 2024-06-21 06:58:49,814 | INFO     | mean x: 1718945559.0425532
[2024-06-21 02:59:08] 2024-06-21 06:58:49,814 | INFO     | mean y: 2543927.1574468086
[2024-06-21 02:59:08] 2024-06-21 06:58:49,814 | INFO     | -- intersect: -1699654810.9395149
[2024-06-21 02:59:08] 2024-06-21 06:58:49,814 | INFO     | intersect: -1699654810.9395149
[2024-06-21 02:59:08] 2024-06-21 06:58:49,815 | INFO     | chi2: 0.0008842915545831431
[2024-06-21 02:59:08] 2024-06-21 06:58:49,815 | INFO     | -- intersect: -1699654810.9395149
[2024-06-21 02:59:08] 2024-06-21 06:58:49,815 | INFO     | current memory leak: 0.99 B/s (using 235 data points, chi2=0.00)
[2024-06-21 02:59:08] 2024-06-21 06:58:49,815 | INFO     | ..............................
[2024-06-21 02:59:08] 2024-06-21 06:58:49,816 | INFO     | . Timing measurements:
[2024-06-21 02:59:08] 2024-06-21 06:58:49,816 | INFO     | . get job = 0 s
[2024-06-21 02:59:08] 2024-06-21 06:58:49,816 | INFO     | . initial setup = 5 s
[2024-06-21 02:59:08] 2024-06-21 06:58:49,816 | INFO     | . payload setup = 72 s
[2024-06-21 02:59:08] 2024-06-21 06:58:49,816 | INFO     | . stage-in = 0 s
[2024-06-21 02:59:08] 2024-06-21 06:58:49,816 | INFO     | . payload execution = 17770 s
[2024-06-21 02:59:08] 2024-06-21 06:58:49,816 | INFO     | . stage-out = 4 s
[2024-06-21 02:59:08] 2024-06-21 06:58:49,816 | INFO     | . log creation = 0 s
[2024-06-21 02:59:08] 2024-06-21 06:58:49,816 | INFO     | ..............................
[2024-06-21 02:59:08] 2024-06-21 06:58:49,977 | INFO     | 
[2024-06-21 02:59:08] 2024-06-21 06:58:49,977 | INFO     | job summary report
[2024-06-21 02:59:08] 2024-06-21 06:58:49,977 | INFO     | --------------------------------------------------
[2024-06-21 02:59:08] 2024-06-21 06:58:49,977 | INFO     | PanDA job id: 6239051994
[2024-06-21 02:59:08] 2024-06-21 06:58:49,977 | INFO     | task id: 40024031
[2024-06-21 02:59:08] 2024-06-21 06:58:49,977 | INFO     | errors: (none)
[2024-06-21 02:59:08] 2024-06-21 06:58:49,977 | INFO     | status: LOG_TRANSFER = DONE 
[2024-06-21 02:59:08] 2024-06-21 06:58:49,977 | INFO     | pilot state: finished 
[2024-06-21 02:59:08] 2024-06-21 06:58:49,977 | INFO     | transexitcode: 0
[2024-06-21 02:59:08] 2024-06-21 06:58:49,977 | INFO     | exeerrorcode: 0
[2024-06-21 02:59:08] 2024-06-21 06:58:49,977 | INFO     | exeerrordiag: 
[2024-06-21 02:59:08] 2024-06-21 06:58:49,977 | INFO     | exitcode: 0
[2024-06-21 02:59:08] 2024-06-21 06:58:49,977 | INFO     | exitmsg: OK
[2024-06-21 02:59:08] 2024-06-21 06:58:49,978 | INFO     | cpuconsumptiontime: 53473 s
[2024-06-21 02:59:08] 2024-06-21 06:58:49,978 | INFO     | nevents: 400
[2024-06-21 02:59:08] 2024-06-21 06:58:49,978 | INFO     | neventsw: 0
[2024-06-21 02:59:08] 2024-06-21 06:58:49,978 | INFO     | pid: 8726
[2024-06-21 02:59:08] 2024-06-21 06:58:49,978 | INFO     | pgrp: 8726
[2024-06-21 02:59:08] 2024-06-21 06:58:49,978 | INFO     | corecount: 8
[2024-06-21 02:59:08] 2024-06-21 06:58:49,978 | INFO     | event service: False
[2024-06-21 02:59:08] 2024-06-21 06:58:49,978 | INFO     | sizes: {0: 2386726, 1: 2386925, 12: 2386925, 23: 2386953, 33: 2386981, 44: 2387009, 45: 2387371, 55: 2387399, 17846: 2419095, 17847: 2419094, 17852: 2428446, 17907
[2024-06-21 02:59:08] 2024-06-21 06:58:49,978 | INFO     | --------------------------------------------------
[2024-06-21 02:59:08] 2024-06-21 06:58:49,978 | INFO     | 
[2024-06-21 02:59:08] 2024-06-21 06:58:49,978 | INFO     | executing command: ls -lF /tmp/boinchome/slots/5
[2024-06-21 02:59:08] 2024-06-21 06:58:50,216 | INFO     | queue jobs had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,216 | INFO     | queue payloads had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,216 | INFO     | queue data_in had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,216 | INFO     | queue data_out had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,216 | INFO     | queue current_data_in had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,216 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,216 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | queue completed_jobids has 1 job(s)
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | queue messages had 0 job(s) [purged]
[2024-06-21 02:59:08] 2024-06-21 06:58:50,217 | INFO     | job 6239051994 has completed (purged errors)
[2024-06-21 02:59:08] 2024-06-21 06:58:50,218 | INFO     | overall cleanup function is called
[2024-06-21 02:59:08] 2024-06-21 06:58:51,238 | INFO     | --- collectZombieJob: --- 10, [8726]
[2024-06-21 02:59:08] 2024-06-21 06:58:51,239 | INFO     | zombie collector waiting for pid 8726
[2024-06-21 02:59:08] 2024-06-21 06:58:51,239 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2024-06-21 02:59:08] 2024-06-21 06:58:52,244 | INFO     | collected zombie processes
[2024-06-21 02:59:08] 2024-06-21 06:58:52,244 | INFO     | will now attempt to kill all subprocesses of pid=8726
[2024-06-21 02:59:08] 2024-06-21 06:58:52,706 | INFO     | process IDs to be killed: [8726] (in reverse order)
[2024-06-21 02:59:08] 2024-06-21 06:58:53,039 | WARNING  | found no corresponding commands to process id(s)
[2024-06-21 02:59:08] 2024-06-21 06:58:53,040 | INFO     | Do not look for orphan processes in BOINC jobs
[2024-06-21 02:59:08] 2024-06-21 06:58:53,051 | INFO     | did not find any defunct processes belonging to 8726
[2024-06-21 02:59:08] 2024-06-21 06:58:53,060 | INFO     | did not find any defunct processes belonging to 8726
[2024-06-21 02:59:08] 2024-06-21 06:58:53,061 | INFO     | ready for new job
[2024-06-21 02:59:08] 2024-06-21 06:58:53,061 | INFO     | pilot has finished with previous job - re-establishing logging
[2024-06-21 02:59:08] 2024-06-21 06:58:53,063 | INFO     | *************************************
[2024-06-21 02:59:08] 2024-06-21 06:58:53,063 | INFO     | ***  PanDA Pilot version 3.7.7.3  ***
[2024-06-21 02:59:08] 2024-06-21 06:58:53,063 | INFO     | *************************************
[2024-06-21 02:59:08] 2024-06-21 06:58:53,064 | INFO     | 
[2024-06-21 02:59:08] 2024-06-21 06:58:53,069 | INFO     | architecture information:
[2024-06-21 02:59:08] 2024-06-21 06:58:53,070 | INFO     | executing command: cat /etc/os-release
[2024-06-21 02:59:08] 2024-06-21 06:58:53,117 | INFO     | cat /etc/os-release:
[2024-06-21 02:59:08] NAME="CentOS Linux"
[2024-06-21 02:59:08] VERSION="7 (Core)"
[2024-06-21 02:59:08] ID="centos"
[2024-06-21 02:59:08] ID_LIKE="rhel fedora"
[2024-06-21 02:59:08] VERSION_ID="7"
[2024-06-21 02:59:08] PRETTY_NAME="CentOS Linux 7 (Core)"
[2024-06-21 02:59:08] ANSI_COLOR="0;31"
[2024-06-21 02:59:08] CPE_NAME="cpe:/o:centos:centos:7"
[2024-06-21 02:59:08] HOME_URL="https://www.centos.org/"
[2024-06-21 02:59:08] BUG_REPORT_URL="https://bugs.centos.org/"
[2024-06-21 02:59:08] 
[2024-06-21 02:59:08] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2024-06-21 02:59:08] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2024-06-21 02:59:08] REDHAT_SUPPORT_PRODUCT="centos"
[2024-06-21 02:59:08] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2024-06-21 02:59:08] 
[2024-06-21 02:59:08] 2024-06-21 06:58:53,117 | INFO     | *************************************
[2024-06-21 02:59:08] 2024-06-21 06:58:53,620 | INFO     | executing command: df -mP /tmp/boinchome/slots/5
[2024-06-21 02:59:08] 2024-06-21 06:58:53,763 | INFO     | sufficient remaining disk space (99673440256 B)
[2024-06-21 02:59:08] 2024-06-21 06:58:53,763 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2024-06-21 02:59:08] 2024-06-21 06:58:53,763 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2024-06-21 02:59:08] 2024-06-21 06:58:53,764 | WARNING  | aborting monitor loop since graceful_stop has been set (timing out remaining threads)
[2024-06-21 02:59:08] 2024-06-21 06:58:53,768 | INFO     | found 0 job(s) in 20 queues
[2024-06-21 02:59:08] 2024-06-21 06:58:53,768 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2024-06-21 02:59:08] 2024-06-21 06:58:53,768 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2024-06-21 02:59:08] 2024-06-21 06:58:53,768 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2024-06-21 02:59:08] 2024-06-21 06:58:54,098 | INFO     | all data control threads have been joined
[2024-06-21 02:59:08] 2024-06-21 06:58:54,128 | INFO     | all job control threads have been joined
[2024-06-21 02:59:08] 2024-06-21 06:58:54,578 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2024-06-21 02:59:08] 2024-06-21 06:58:54,578 | INFO     | aborting loop
[2024-06-21 02:59:08] 2024-06-21 06:58:54,772 | INFO     | [job] retrieve thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:54,809 | INFO     | [job] create_data_payload thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:54,878 | INFO     | [job] validate thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:54,912 | INFO     | all payload control threads have been joined
[2024-06-21 02:59:08] 2024-06-21 06:58:54,994 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2024-06-21 02:59:08] 2024-06-21 06:58:55,104 | INFO     | [data] control thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:55,134 | INFO     | [job] control thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:55,254 | INFO     | [payload] failed_post thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:55,343 | INFO     | [payload] run_realtimelog thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:55,584 | INFO     | [job] job monitor thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:55,654 | INFO     | [payload] execute_payloads thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:55,778 | INFO     | [data] copytool_out thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:55,838 | INFO     | [payload] validate_post thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:55,918 | INFO     | [payload] control thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:55,968 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2024-06-21 02:59:08] 2024-06-21 06:58:55,999 | INFO     | [job] queue monitor thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:56,184 | INFO     | [data] copytool_in thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:56,204 | INFO     | [payload] validate_pre thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:58:59,978 | INFO     | [data] queue_monitor thread has finished
[2024-06-21 02:59:08] 2024-06-21 06:59:00,924 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139755570296640)>', '<ExcThread(monitor, started 139755132016384)>']
[2024-06-21 02:59:08] 2024-06-21 06:59:01,824 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2024-06-21 02:59:08] 2024-06-21 06:59:01,824 | INFO     | [monitor] control thread has ended
[2024-06-21 02:59:08] 2024-06-21 06:59:05,955 | INFO     | all workflow threads have been joined
[2024-06-21 02:59:08] 2024-06-21 06:59:05,955 | INFO     | end of generic workflow (traces error code: 0)
[2024-06-21 02:59:08] 2024-06-21 06:59:05,955 | INFO     | traces error code: 0
[2024-06-21 02:59:08] 2024-06-21 06:59:05,955 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2024-06-21 02:59:08] 2024-06-21 06:59:06,183 [wrapper] ==== pilot stdout END ====
[2024-06-21 02:59:08] 2024-06-21 06:59:06,212 [wrapper] ==== wrapper stdout RESUME ====
[2024-06-21 02:59:08] 2024-06-21 06:59:06,244 [wrapper] pilotpid: 81250
[2024-06-21 02:59:08] 2024-06-21 06:59:06,274 [wrapper] Pilot exit status: 0
[2024-06-21 02:59:08] 2024-06-21 06:59:06,442 [wrapper] pandaids: 6239051994
[2024-06-21 02:59:08] 2024-06-21 06:59:07,012 [wrapper] cleanup supervisor_pilot 28113 81251
[2024-06-21 02:59:08] 2024-06-21 06:59:07,064 [wrapper] Test setup, not cleaning
[2024-06-21 02:59:08] 2024-06-21 06:59:07,093 [wrapper] ==== wrapper stdout END ====
[2024-06-21 02:59:08] 2024-06-21 06:59:07,234 [wrapper] ==== wrapper stderr END ====
[2024-06-21 02:59:08] 2024-06-21 06:59:07,312 [wrapper] apfmon messages muted
[2024-06-21 02:59:08]  *** Error codes and diagnostics ***
[2024-06-21 02:59:08]     "exeErrorCode": 0,
[2024-06-21 02:59:08]     "exeErrorDiag": "",
[2024-06-21 02:59:08]     "pilotErrorCode": 0,
[2024-06-21 02:59:08]     "pilotErrorDiag": "",
[2024-06-21 02:59:08]  *** Listing of results directory ***
[2024-06-21 02:59:08] total 841588
[2024-06-21 02:59:08] -rw-r--r-- 1 boincer umatlas    469766 Jun 20 16:28 pilot3.tar.gz
[2024-06-21 02:59:08] -rw-r--r-- 1 boincer umatlas      5654 Jun 20 16:32 queuedata.json
[2024-06-21 02:59:08] -rwx------ 1 boincer umatlas     32308 Jun 20 16:33 runpilot2-wrapper.sh
[2024-06-21 02:59:08] -rw-r--r-- 1 boincer umatlas       100 Jun 20 21:57 wrapper_26015_x86_64-pc-linux-gnu
[2024-06-21 02:59:08] -rwxr-xr-x 1 boincer umatlas      7986 Jun 20 21:57 run_atlas
[2024-06-21 02:59:08] -rw-r--r-- 1 boincer umatlas       105 Jun 20 21:57 job.xml
[2024-06-21 02:59:08] -rw-r--r-- 2 boincer umatlas 594268695 Jun 20 21:57 EVNT.40024029._000036.pool.root.1
[2024-06-21 02:59:08] -rw-r--r-- 2 boincer umatlas     17537 Jun 20 21:57 start_atlas.sh
[2024-06-21 02:59:08] drwxrwx--x 2 boincer umatlas      4096 Jun 20 21:57 shared
[2024-06-21 02:59:08] -rw-r--r-- 2 boincer umatlas    482522 Jun 20 21:57 input.tar.gz
[2024-06-21 02:59:08] -rw-r--r-- 1 boincer umatlas         0 Jun 20 21:57 boinc_lockfile
[2024-06-21 02:59:08] -rw-r--r-- 1 boincer umatlas      2570 Jun 20 21:57 pandaJob.out
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas       424 Jun 20 21:57 setup.sh.local
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas   1024126 Jun 20 21:58 agis_schedconf.cvmfs.json
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas   1321251 Jun 20 21:58 cric_ddmendpoints.json
[2024-06-21 02:59:08] drwx------ 4 boincer umatlas      4096 Jun 20 21:58 pilot3
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas 259483744 Jun 21 02:56 HITS.40024031._000641.pool.root.1
[2024-06-21 02:59:08] -rw-r--r-- 1 boincer umatlas       532 Jun 21 02:56 boinc_task_state.xml
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas      1103 Jun 21 02:57 memory_monitor_summary.json
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas         0 Jun 21 02:57 agis_ddmendpoints.agis.ALL.json
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas    446529 Jun 21 02:57 log.40024031._000641.job.log.tgz.1
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas        95 Jun 21 02:58 pilot_heartbeat.json
[2024-06-21 02:59:08] -rw-r--r-- 1 boincer umatlas      6301 Jun 21 02:58 init_data.xml
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas      7760 Jun 21 02:58 heartbeat.json
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas      4334 Jun 21 02:59 pilotlog.txt
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas   1801612 Jun 21 02:59 log.40024031._000641.job.log.1
[2024-06-21 02:59:08] -rw-r--r-- 1 boincer umatlas      8192 Jun 21 02:59 boinc_mmap_file
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas       357 Jun 21 02:59 output.list
[2024-06-21 02:59:08] -rw-r--r-- 1 boincer umatlas       620 Jun 21 02:59 runtime_log
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas   2263040 Jun 21 02:59 result.tar.gz
[2024-06-21 02:59:08] -rw-r--r-- 1 boincer umatlas     11000 Jun 21 02:59 runtime_log.err
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas       652 Jun 21 02:59 okzNDmgede5n9Rq4apOajLDm4fhM0noT9bVo2ijZDmbcXKDmxl8gpn.diag
[2024-06-21 02:59:08] -rw-r--r-- 1 boincer umatlas        28 Jun 21 02:59 wrapper_checkpoint.txt
[2024-06-21 02:59:08] -rw-r--r-- 1 boincer umatlas     21662 Jun 21 02:59 stderr.txt
[2024-06-21 02:59:08] HITS file was successfully produced:
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas 259483744 Jun 21 02:56 shared/HITS.pool.root.1
[2024-06-21 02:59:08]  *** Contents of shared directory: ***
[2024-06-21 02:59:08] total 836460
[2024-06-21 02:59:08] -rw-r--r-- 2 boincer umatlas 594268695 Jun 20 21:57 ATLAS.root_0
[2024-06-21 02:59:08] -rw-r--r-- 2 boincer umatlas     17537 Jun 20 21:57 start_atlas.sh
[2024-06-21 02:59:08] -rw-r--r-- 2 boincer umatlas    482522 Jun 20 21:57 input.tar.gz
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas 259483744 Jun 21 02:56 HITS.pool.root.1
[2024-06-21 02:59:08] -rw------- 1 boincer umatlas   2263040 Jun 21 02:59 result.tar.gz
02:59:10 (60742): run_atlas exited; CPU time 52085.816717
02:59:10 (60742): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN