Name Ij6MDmaB556nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmq6tKDmUNCPNo_2
Workunit 230511965
Created 23 Feb 2025, 2:33:19 UTC
Sent 23 Feb 2025, 8:20:23 UTC
Report deadline 3 Mar 2025, 8:20:23 UTC
Received 23 Feb 2025, 13:37:33 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10832892
Run time 5 hours 9 min 45 sec
CPU time 1 days 14 hours 4 min 36 sec
Validate state Valid
Credit 1,615.60
Device peak FLOPS 19.06 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.59 GB
Peak swap size 9.39 GB
Peak disk usage 1,007.19 MB

Stderr output

<core_client_version>7.7.0</core_client_version>
<![CDATA[
<stderr_txt>
03:20:51 (30031): wrapper (7.7.26015): starting
03:20:51 (30031): wrapper: running run_atlas (--nthreads 8)
[2025-02-23 03:20:51] Arguments: --nthreads 8
[2025-02-23 03:20:51] Threads: 8
[2025-02-23 03:20:51] Checking for CVMFS
[2025-02-23 03:20:51] Probing /cvmfs/atlas.cern.ch... OK
[2025-02-23 03:20:51] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-02-23 03:20:51] Running cvmfs_config stat atlas.cern.ch
[2025-02-23 03:20:51] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-02-23 03:20:51] 2.11.2.0 2837 69988 107168 142969 1 55 15232490 20275200 1 130560 0 18782107 99.922 8061172 34124 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.237.109:6081 1
[2025-02-23 03:20:51] CVMFS is ok
[2025-02-23 03:20:51] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-02-23 03:20:51] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-02-23 03:20:51] Further information can be found at the LHC@home message board.
[2025-02-23 03:20:51] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-02-23 03:20:51] Checking for apptainer binary...
[2025-02-23 03:20:51] Using apptainer found in PATH at /usr/bin/apptainer
[2025-02-23 03:20:51] Running /usr/bin/apptainer --version
[2025-02-23 03:20:51] apptainer version 1.3.2-1.el7
[2025-02-23 03:20:51] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-02-23 03:20:53] c-204-9.aglt2.org
[2025-02-23 03:20:53] apptainer works
[2025-02-23 03:20:53] Set ATHENA_PROC_NUMBER=8
[2025-02-23 03:20:53] Set ATHENA_CORE_NUMBER=8
[2025-02-23 03:20:53] Starting ATLAS job with PandaID=6523020836
[2025-02-23 03:20:53] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2025-02-23 08:30:33]  *** The last 200 lines of the pilot log: ***
[2025-02-23 08:30:33] 2025-02-23 13:30:14,064 | INFO     | intersect: -21450930924.57527
[2025-02-23 08:30:33] 2025-02-23 13:30:14,065 | INFO     | chi2: 5.831324126077569
[2025-02-23 08:30:33] 2025-02-23 13:30:14,065 | INFO     | model: linear, x: [1740298901.0, 1740298962.0, 1740299023.0, 1740299084.0, 1740299145.0, 1740299206.0, 1740299267.0, 1740299328.0, 1740299389.0, 1740299450.0, 1740
[2025-02-23 08:30:33] 2025-02-23 13:30:14,065 | INFO     | sum of square deviations: 8288713550.0
[2025-02-23 08:30:33] 2025-02-23 13:30:14,068 | INFO     | sum of deviations: 126219782908.99998
[2025-02-23 08:30:33] 2025-02-23 13:30:14,068 | INFO     | mean x: 1740307990.0
[2025-02-23 08:30:33] 2025-02-23 13:30:14,068 | INFO     | mean y: 2543577.852842809
[2025-02-23 08:30:33] 2025-02-23 13:30:14,068 | INFO     | -- intersect: -26498709646.490772
[2025-02-23 08:30:33] 2025-02-23 13:30:14,068 | INFO     | intersect: -26498709646.490772
[2025-02-23 08:30:33] 2025-02-23 13:30:14,069 | INFO     | chi2: 5.091349986214658
[2025-02-23 08:30:33] 2025-02-23 13:30:14,069 | INFO     | current chi2=5.091349986214658 (change=12.689641732548557 %)
[2025-02-23 08:30:33] 2025-02-23 13:30:14,069 | INFO     | right removable region: 298
[2025-02-23 08:30:33] 2025-02-23 13:30:14,069 | INFO     | model: linear, x: [1740299206.0, 1740299267.0, 1740299328.0, 1740299389.0, 1740299450.0, 1740299511.0, 1740299572.0, 1740299633.0, 1740299694.0, 1740299755.0, 1740
[2025-02-23 08:30:33] 2025-02-23 13:30:14,069 | INFO     | sum of square deviations: 8288713550.0
[2025-02-23 08:30:33] 2025-02-23 13:30:14,072 | INFO     | sum of deviations: 25765591811.000004
[2025-02-23 08:30:33] 2025-02-23 13:30:14,072 | INFO     | mean x: 1740308295.0
[2025-02-23 08:30:33] 2025-02-23 13:30:14,072 | INFO     | mean y: 2566272.37458194
[2025-02-23 08:30:33] 2025-02-23 13:30:14,072 | INFO     | -- intersect: -5407208463.328207
[2025-02-23 08:30:33] 2025-02-23 13:30:14,072 | INFO     | intersect: -5407208463.328207
[2025-02-23 08:30:33] 2025-02-23 13:30:14,073 | INFO     | chi2: 3.070799283308339
[2025-02-23 08:30:33] 2025-02-23 13:30:14,073 | INFO     | current chi2=3.070799283308339 (change=47.33958845511976 %)
[2025-02-23 08:30:33] 2025-02-23 13:30:14,073 | INFO     | model: linear, x: [1740299511.0, 1740299572.0, 1740299633.0, 1740299694.0, 1740299755.0, 1740299816.0, 1740299877.0, 1740299938.0, 1740299999.0, 1740300060.0, 1740
[2025-02-23 08:30:33] 2025-02-23 13:30:14,073 | INFO     | sum of square deviations: 7879803557.5
[2025-02-23 08:30:33] 2025-02-23 13:30:14,075 | INFO     | sum of deviations: -33770712914.5
[2025-02-23 08:30:33] 2025-02-23 13:30:14,076 | INFO     | mean x: 1740308447.5
[2025-02-23 08:30:33] 2025-02-23 13:30:14,076 | INFO     | mean y: 2588476.5476190476
[2025-02-23 08:30:33] 2025-02-23 13:30:14,076 | INFO     | -- intersect: 7461081132.403614
[2025-02-23 08:30:33] 2025-02-23 13:30:14,076 | INFO     | intersect: 7461081132.403614
[2025-02-23 08:30:33] 2025-02-23 13:30:14,076 | INFO     | chi2: 1.6836487563341889
[2025-02-23 08:30:33] 2025-02-23 13:30:14,077 | INFO     | current chi2=1.6836487563341889 (change=45.17229551648512 %)
[2025-02-23 08:30:33] 2025-02-23 13:30:14,077 | INFO     | model: linear, x: [1740299816.0, 1740299877.0, 1740299938.0, 1740299999.0, 1740300060.0, 1740300121.0, 1740300182.0, 1740300243.0, 1740300304.0, 1740300365.0, 1740
[2025-02-23 08:30:33] 2025-02-23 13:30:14,077 | INFO     | sum of square deviations: 7484568240.0
[2025-02-23 08:30:33] 2025-02-23 13:30:14,079 | INFO     | sum of deviations: -68077782237.0
[2025-02-23 08:30:33] 2025-02-23 13:30:14,079 | INFO     | mean x: 1740308600.0
[2025-02-23 08:30:33] 2025-02-23 13:30:14,079 | INFO     | mean y: 2601639.9965397925
[2025-02-23 08:30:33] 2025-02-23 13:30:14,080 | INFO     | -- intersect: 15832018394.165693
[2025-02-23 08:30:33] 2025-02-23 13:30:14,080 | INFO     | intersect: 15832018394.165693
[2025-02-23 08:30:33] 2025-02-23 13:30:14,080 | INFO     | chi2: 1.0387920811504674
[2025-02-23 08:30:33] 2025-02-23 13:30:14,080 | INFO     | current chi2=1.0387920811504674 (change=38.301140469926096 %)
[2025-02-23 08:30:33] 2025-02-23 13:30:14,081 | INFO     | model: linear, x: [1740300121.0, 1740300182.0, 1740300243.0, 1740300304.0, 1740300365.0, 1740300426.0, 1740300487.0, 1740300548.0, 1740300609.0, 1740300670.0, 1740
[2025-02-23 08:30:33] 2025-02-23 13:30:14,081 | INFO     | sum of square deviations: 7102775035.0
[2025-02-23 08:30:33] 2025-02-23 13:30:14,083 | INFO     | sum of deviations: -70276696481.5
[2025-02-23 08:30:33] 2025-02-23 13:30:14,083 | INFO     | mean x: 1740308752.5
[2025-02-23 08:30:33] 2025-02-23 13:30:14,083 | INFO     | mean y: 2602495.186619718
[2025-02-23 08:30:33] 2025-02-23 13:30:14,083 | INFO     | -- intersect: 17221668195.687214
[2025-02-23 08:30:33] 2025-02-23 13:30:14,083 | INFO     | intersect: 17221668195.687214
[2025-02-23 08:30:33] 2025-02-23 13:30:14,084 | INFO     | chi2: 1.0122319384205403
[2025-02-23 08:30:33] 2025-02-23 13:30:14,084 | INFO     | current chi2=1.0122319384205403 (change=2.5568295342135876 %)
[2025-02-23 08:30:33] 2025-02-23 13:30:14,084 | INFO     | left removable region: 40
[2025-02-23 08:30:33] 2025-02-23 13:30:14,084 | INFO     | model: linear, x: [1740301341.0, 1740301402.0, 1740301463.0, 1740301524.0, 1740301585.0, 1740301646.0, 1740301707.0, 1740301768.0, 1740301829.0, 1740301890.0, 1740
[2025-02-23 08:30:33] 2025-02-23 13:30:14,085 | INFO     | sum of square deviations: 5325139844.5
[2025-02-23 08:30:33] 2025-02-23 13:30:14,086 | INFO     | sum of deviations: -12716182640.499998
[2025-02-23 08:30:33] 2025-02-23 13:30:14,086 | INFO     | mean x: 1740309179.5
[2025-02-23 08:30:33] 2025-02-23 13:30:14,087 | INFO     | mean y: 2593920.2596899224
[2025-02-23 08:30:33] 2025-02-23 13:30:14,087 | INFO     | -- intersect: 4158370110.87325
[2025-02-23 08:30:33] 2025-02-23 13:30:14,087 | INFO     | intersect: 4158370110.87325
[2025-02-23 08:30:33] 2025-02-23 13:30:14,087 | INFO     | chi2: 0.131450721864844
[2025-02-23 08:30:33] 2025-02-23 13:30:14,087 | INFO     | -- intersect: 4158370110.87325
[2025-02-23 08:30:33] 2025-02-23 13:30:14,087 | INFO     | current memory leak: -2.39 B/s (using 258 data points, chi2=0.13)
[2025-02-23 08:30:33] 2025-02-23 13:30:14,088 | INFO     | ..............................
[2025-02-23 08:30:33] 2025-02-23 13:30:14,088 | INFO     | . Timing measurements:
[2025-02-23 08:30:33] 2025-02-23 13:30:14,088 | INFO     | . get job = 0 s
[2025-02-23 08:30:33] 2025-02-23 13:30:14,088 | INFO     | . initial setup = 2 s
[2025-02-23 08:30:33] 2025-02-23 13:30:14,088 | INFO     | . payload setup = 8 s
[2025-02-23 08:30:33] 2025-02-23 13:30:14,089 | INFO     | . stage-in = 0 s
[2025-02-23 08:30:33] 2025-02-23 13:30:14,089 | INFO     | . payload execution = 18501 s
[2025-02-23 08:30:33] 2025-02-23 13:30:14,089 | INFO     | . stage-out = 2 s
[2025-02-23 08:30:33] 2025-02-23 13:30:14,089 | INFO     | . log creation = 0 s
[2025-02-23 08:30:33] 2025-02-23 13:30:14,089 | INFO     | ..............................
[2025-02-23 08:30:33] 2025-02-23 13:30:14,182 | INFO     | 
[2025-02-23 08:30:33] 2025-02-23 13:30:14,182 | INFO     | job summary report
[2025-02-23 08:30:33] 2025-02-23 13:30:14,182 | INFO     | --------------------------------------------------
[2025-02-23 08:30:33] 2025-02-23 13:30:14,182 | INFO     | PanDA job id: 6523020836
[2025-02-23 08:30:33] 2025-02-23 13:30:14,182 | INFO     | task id: 43092775
[2025-02-23 08:30:33] 2025-02-23 13:30:14,183 | INFO     | errors: (none)
[2025-02-23 08:30:33] 2025-02-23 13:30:14,183 | INFO     | status: LOG_TRANSFER = DONE 
[2025-02-23 08:30:33] 2025-02-23 13:30:14,183 | INFO     | pilot state: finished 
[2025-02-23 08:30:33] 2025-02-23 13:30:14,183 | INFO     | transexitcode: 0
[2025-02-23 08:30:33] 2025-02-23 13:30:14,183 | INFO     | exeerrorcode: 0
[2025-02-23 08:30:33] 2025-02-23 13:30:14,183 | INFO     | exeerrordiag: 
[2025-02-23 08:30:33] 2025-02-23 13:30:14,184 | INFO     | exitcode: 0
[2025-02-23 08:30:33] 2025-02-23 13:30:14,184 | INFO     | exitmsg: OK
[2025-02-23 08:30:33] 2025-02-23 13:30:14,184 | INFO     | cpuconsumptiontime: 137028 s
[2025-02-23 08:30:33] 2025-02-23 13:30:14,184 | INFO     | nevents: 400
[2025-02-23 08:30:33] 2025-02-23 13:30:14,184 | INFO     | neventsw: 0
[2025-02-23 08:30:33] 2025-02-23 13:30:14,184 | INFO     | pid: 7732
[2025-02-23 08:30:33] 2025-02-23 13:30:14,185 | INFO     | pgrp: 7732
[2025-02-23 08:30:33] 2025-02-23 13:30:14,185 | INFO     | corecount: 8
[2025-02-23 08:30:33] 2025-02-23 13:30:14,185 | INFO     | event service: False
[2025-02-23 08:30:33] 2025-02-23 13:30:14,185 | INFO     | sizes: {0: 2383236, 6: 2383442, 11: 2383470, 18513: 2415465, 18514: 2415464, 18517: 2424461, 18520: 2424645, 18528: 2424815}
[2025-02-23 08:30:33] 2025-02-23 13:30:14,185 | INFO     | --------------------------------------------------
[2025-02-23 08:30:33] 2025-02-23 13:30:14,186 | INFO     | 
[2025-02-23 08:30:33] 2025-02-23 13:30:14,186 | INFO     | executing command: ls -lF /tmp/boinchome/slots/0
[2025-02-23 08:30:33] 2025-02-23 13:30:14,212 | INFO     | queue jobs had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,213 | INFO     | queue payloads had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,213 | INFO     | queue data_in had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,213 | INFO     | queue data_out had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,214 | INFO     | queue current_data_in had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,214 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,214 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,214 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,214 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,214 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,215 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,215 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,215 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,215 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,215 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,215 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,216 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,216 | INFO     | queue completed_jobids has 1 job(s)
[2025-02-23 08:30:33] 2025-02-23 13:30:14,216 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,216 | INFO     | queue messages had 0 job(s) [purged]
[2025-02-23 08:30:33] 2025-02-23 13:30:14,216 | INFO     | job 6523020836 has completed (purged errors)
[2025-02-23 08:30:33] 2025-02-23 13:30:14,217 | INFO     | overall cleanup function is called
[2025-02-23 08:30:33] 2025-02-23 13:30:15,225 | INFO     | --- collectZombieJob: --- 10, [7732]
[2025-02-23 08:30:33] 2025-02-23 13:30:15,225 | INFO     | zombie collector waiting for pid 7732
[2025-02-23 08:30:33] 2025-02-23 13:30:15,225 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2025-02-23 08:30:33] 2025-02-23 13:30:15,226 | INFO     | collected zombie processes
[2025-02-23 08:30:33] 2025-02-23 13:30:15,226 | INFO     | will attempt to kill all subprocesses of pid=7732
[2025-02-23 08:30:33] 2025-02-23 13:30:15,300 | INFO     | process IDs to be killed: [7732] (in reverse order)
[2025-02-23 08:30:33] 2025-02-23 13:30:15,355 | WARNING  | found no corresponding commands to process id(s)
[2025-02-23 08:30:33] 2025-02-23 13:30:15,355 | INFO     | Do not look for orphan processes in BOINC jobs
[2025-02-23 08:30:33] 2025-02-23 13:30:15,360 | INFO     | did not find any defunct processes belonging to 7732
[2025-02-23 08:30:33] 2025-02-23 13:30:15,364 | INFO     | did not find any defunct processes belonging to 7732
[2025-02-23 08:30:33] 2025-02-23 13:30:15,364 | INFO     | ready for new job
[2025-02-23 08:30:33] 2025-02-23 13:30:15,365 | INFO     | pilot has finished with previous job - re-establishing logging
[2025-02-23 08:30:33] 2025-02-23 13:30:15,367 | INFO     | **************************************
[2025-02-23 08:30:33] 2025-02-23 13:30:15,367 | INFO     | ***  PanDA Pilot version 3.9.4.15  ***
[2025-02-23 08:30:33] 2025-02-23 13:30:15,367 | INFO     | **************************************
[2025-02-23 08:30:33] 2025-02-23 13:30:15,367 | INFO     | 
[2025-02-23 08:30:33] 2025-02-23 13:30:15,368 | INFO     | architecture information:
[2025-02-23 08:30:33] 2025-02-23 13:30:15,368 | INFO     | executing command: cat /etc/os-release
[2025-02-23 08:30:33] 2025-02-23 13:30:15,385 | INFO     | cat /etc/os-release:
[2025-02-23 08:30:33] NAME="CentOS Linux"
[2025-02-23 08:30:33] VERSION="7 (Core)"
[2025-02-23 08:30:33] ID="centos"
[2025-02-23 08:30:33] ID_LIKE="rhel fedora"
[2025-02-23 08:30:33] VERSION_ID="7"
[2025-02-23 08:30:33] PRETTY_NAME="CentOS Linux 7 (Core)"
[2025-02-23 08:30:33] ANSI_COLOR="0;31"
[2025-02-23 08:30:33] CPE_NAME="cpe:/o:centos:centos:7"
[2025-02-23 08:30:33] HOME_URL="https://www.centos.org/"
[2025-02-23 08:30:33] BUG_REPORT_URL="https://bugs.centos.org/"
[2025-02-23 08:30:33] 
[2025-02-23 08:30:33] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2025-02-23 08:30:33] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2025-02-23 08:30:33] REDHAT_SUPPORT_PRODUCT="centos"
[2025-02-23 08:30:33] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2025-02-23 08:30:33] 
[2025-02-23 08:30:33] 2025-02-23 13:30:15,385 | INFO     | **************************************
[2025-02-23 08:30:33] 2025-02-23 13:30:15,887 | INFO     | executing command: df -mP /tmp/boinchome/slots/0
[2025-02-23 08:30:33] 2025-02-23 13:30:15,905 | INFO     | sufficient remaining disk space (18229493760 B)
[2025-02-23 08:30:33] 2025-02-23 13:30:15,906 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2025-02-23 08:30:33] 2025-02-23 13:30:15,906 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2025-02-23 08:30:33] 2025-02-23 13:30:15,906 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2025-02-23 08:30:33] 2025-02-23 13:30:16,050 | INFO     | found 0 job(s) in 20 queues
[2025-02-23 08:30:33] 2025-02-23 13:30:16,050 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2025-02-23 08:30:33] 2025-02-23 13:30:16,050 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2025-02-23 08:30:33] 2025-02-23 13:30:16,420 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2025-02-23 08:30:33] 2025-02-23 13:30:16,420 | INFO     | aborting loop
[2025-02-23 08:30:33] 2025-02-23 13:30:16,423 | INFO     | all payload control threads have been joined
[2025-02-23 08:30:33] 2025-02-23 13:30:16,446 | INFO     | all data control threads have been joined
[2025-02-23 08:30:33] 2025-02-23 13:30:16,513 | INFO     | all job control threads have been joined
[2025-02-23 08:30:33] 2025-02-23 13:30:16,656 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2025-02-23 08:30:33] 2025-02-23 13:30:16,855 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2025-02-23 08:30:33] 2025-02-23 13:30:16,909 | INFO     | [job] queue monitor thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:16,912 | INFO     | [job] retrieve thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:17,132 | INFO     | [payload] validate_pre thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:17,160 | INFO     | [payload] execute_payloads thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:17,421 | INFO     | [job] job monitor thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:17,425 | INFO     | [payload] control thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:17,451 | INFO     | [data] control thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:17,519 | INFO     | [job] control thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:17,973 | INFO     | [job] create_data_payload thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:18,257 | INFO     | [job] validate thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:18,305 | INFO     | [data] copytool_in thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:18,365 | INFO     | [payload] validate_post thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:18,373 | INFO     | [payload] failed_post thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:18,661 | INFO     | [data] copytool_out thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:20,861 | INFO     | [data] queue_monitor thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:26,580 | INFO     | job.realtimelogging is not enabled
[2025-02-23 08:30:33] 2025-02-23 13:30:27,585 | INFO     | [payload] run_realtimelog thread has finished
[2025-02-23 08:30:33] 2025-02-23 13:30:27,753 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140024047388480)>', '<ExcThread(monitor, started 140023248713472)>']
[2025-02-23 08:30:33] 2025-02-23 13:30:28,104 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2025-02-23 08:30:33] 2025-02-23 13:30:28,104 | INFO     | [monitor] control thread has ended
[2025-02-23 08:30:33] 2025-02-23 13:30:32,781 | INFO     | all workflow threads have been joined
[2025-02-23 08:30:33] 2025-02-23 13:30:32,781 | INFO     | end of generic workflow (traces error code: 0)
[2025-02-23 08:30:33] 2025-02-23 13:30:32,782 | INFO     | traces error code: 0
[2025-02-23 08:30:33] 2025-02-23 13:30:32,782 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2025-02-23 08:30:33] 2025-02-23 13:30:32,895 [wrapper] ==== pilot stdout END ====
[2025-02-23 08:30:33] 2025-02-23 13:30:32,900 [wrapper] ==== wrapper stdout RESUME ====
[2025-02-23 08:30:33] 2025-02-23 13:30:32,905 [wrapper] pilotpid: 1226
[2025-02-23 08:30:33] 2025-02-23 13:30:32,909 [wrapper] Pilot exit status: 0
[2025-02-23 08:30:33] 2025-02-23 13:30:32,929 [wrapper] pandaids: 6523020836
[2025-02-23 08:30:33] 2025-02-23 13:30:32,971 [wrapper] cleanup supervisor_pilot  6556 1227
[2025-02-23 08:30:33] 2025-02-23 13:30:32,976 [wrapper] Test setup, not cleaning
[2025-02-23 08:30:33] 2025-02-23 13:30:32,986 [wrapper] apfmon messages muted
[2025-02-23 08:30:33] 2025-02-23 13:30:32,991 [wrapper] ==== wrapper stdout END ====
[2025-02-23 08:30:33] 2025-02-23 13:30:32,995 [wrapper] ==== wrapper stderr END ====
[2025-02-23 08:30:33]  *** Error codes and diagnostics ***
[2025-02-23 08:30:33]     "exeErrorCode": 0,
[2025-02-23 08:30:33]     "exeErrorDiag": "",
[2025-02-23 08:30:33]     "pilotErrorCode": 0,
[2025-02-23 08:30:33]     "pilotErrorDiag": "",
[2025-02-23 08:30:33]  *** Listing of results directory ***
[2025-02-23 08:30:33] total 689344
[2025-02-23 08:30:33] -rw-r--r-- 1 boincer umatlas    491065 Feb 22 08:55 pilot3.tar.gz
[2025-02-23 08:30:33] -rwx------ 1 boincer umatlas     35865 Feb 22 08:57 runpilot2-wrapper.sh
[2025-02-23 08:30:33] -rw-r--r-- 1 boincer umatlas      5118 Feb 22 08:57 queuedata.json
[2025-02-23 08:30:33] -rw-r--r-- 1 boincer umatlas       100 Feb 23 03:20 wrapper_26015_x86_64-pc-linux-gnu
[2025-02-23 08:30:33] -rwxr-xr-x 1 boincer umatlas      7986 Feb 23 03:20 run_atlas
[2025-02-23 08:30:33] -rw-r--r-- 1 boincer umatlas       105 Feb 23 03:20 job.xml
[2025-02-23 08:30:33] -rw-r--r-- 2 boincer umatlas 348638836 Feb 23 03:20 EVNT.43092773._000118.pool.root.1
[2025-02-23 08:30:33] -rw-r--r-- 2 boincer umatlas     17569 Feb 23 03:20 start_atlas.sh
[2025-02-23 08:30:33] drwxrwx--x 2 boincer umatlas      4096 Feb 23 03:20 shared
[2025-02-23 08:30:33] -rw-r--r-- 2 boincer umatlas    503549 Feb 23 03:20 input.tar.gz
[2025-02-23 08:30:33] -rw-r--r-- 1 boincer umatlas         0 Feb 23 03:20 boinc_lockfile
[2025-02-23 08:30:33] -rw-r--r-- 1 boincer umatlas      2524 Feb 23 03:20 pandaJob.out
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas       424 Feb 23 03:20 setup.sh.local
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas    987736 Feb 23 03:21 agis_schedconf.cvmfs.json
[2025-02-23 08:30:33] drwx------ 4 boincer umatlas      4096 Feb 23 03:21 pilot3
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas 348745795 Feb 23 08:29 HITS.43092775._012712.pool.root.1
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas        95 Feb 23 08:29 pilot_heartbeat.json
[2025-02-23 08:30:33] -rw-r--r-- 1 boincer umatlas       533 Feb 23 08:29 boinc_task_state.xml
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas      1049 Feb 23 08:29 memory_monitor_summary.json
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas   1582569 Feb 23 08:30 agis_ddmendpoints.agis.ALL.json
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas    449004 Feb 23 08:30 log.43092775._012712.job.log.tgz.1
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas      7764 Feb 23 08:30 heartbeat.json
[2025-02-23 08:30:33] -rw-r--r-- 1 boincer umatlas      5825 Feb 23 08:30 init_data.xml
[2025-02-23 08:30:33] -rw-r--r-- 1 boincer umatlas      8192 Feb 23 08:30 boinc_mmap_file
[2025-02-23 08:30:33] -rw-r--r-- 1 boincer umatlas        29 Feb 23 08:30 wrapper_checkpoint.txt
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas      4287 Feb 23 08:30 pilotlog.txt
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas   1896455 Feb 23 08:30 log.43092775._012712.job.log.1
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas       357 Feb 23 08:30 output.list
[2025-02-23 08:30:33] -rw-r--r-- 1 boincer umatlas       620 Feb 23 08:30 runtime_log
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas   2365440 Feb 23 08:30 result.tar.gz
[2025-02-23 08:30:33] -rw-r--r-- 1 boincer umatlas     11009 Feb 23 08:30 runtime_log.err
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas       664 Feb 23 08:30 Ij6MDmaB556nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmq6tKDmUNCPNo.diag
[2025-02-23 08:30:33] -rw-r--r-- 1 boincer umatlas     21466 Feb 23 08:30 stderr.txt
[2025-02-23 08:30:33] HITS file was successfully produced:
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas 348745795 Feb 23 08:29 shared/HITS.pool.root.1
[2025-02-23 08:30:33]  *** Contents of shared directory: ***
[2025-02-23 08:30:33] total 683876
[2025-02-23 08:30:33] -rw-r--r-- 2 boincer umatlas 348638836 Feb 23 03:20 ATLAS.root_0
[2025-02-23 08:30:33] -rw-r--r-- 2 boincer umatlas     17569 Feb 23 03:20 start_atlas.sh
[2025-02-23 08:30:33] -rw-r--r-- 2 boincer umatlas    503549 Feb 23 03:20 input.tar.gz
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas 348745795 Feb 23 08:29 HITS.pool.root.1
[2025-02-23 08:30:33] -rw------- 1 boincer umatlas   2365440 Feb 23 08:30 result.tar.gz
08:30:35 (30031): run_atlas exited; CPU time 136724.779819
08:30:35 (30031): called boinc_finish(0)

</stderr_txt>
]]>


©2025 CERN