Name jGLNDmiDI66nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmRzuKDmc4FRnn_1
Workunit 230521671
Created 23 Feb 2025, 10:40:47 UTC
Sent 23 Feb 2025, 16:22:07 UTC
Report deadline 3 Mar 2025, 16:22:07 UTC
Received 24 Feb 2025, 4:00:23 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10856830
Run time 4 hours 21 min 14 sec
CPU time 1 days 0 hours 17 min 39 sec
Validate state Valid
Credit 868.38
Device peak FLOPS 28.87 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.44 GB
Peak swap size 31.58 GB
Peak disk usage 895.97 MB

Stderr output

<core_client_version>8.1.0</core_client_version>
<![CDATA[
<stderr_txt>
15:48:15 (2527070): wrapper (7.7.26015): starting
15:48:15 (2527070): wrapper: running run_atlas (--nthreads 9)
[2025-02-23 15:48:15] Arguments: --nthreads 9
[2025-02-23 15:48:15] Threads: 9
[2025-02-23 15:48:15] Checking for CVMFS
[2025-02-23 15:48:15] Probing /cvmfs/atlas.cern.ch... OK
[2025-02-23 15:48:16] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-02-23 15:48:16] Running cvmfs_config stat atlas.cern.ch
[2025-02-23 15:48:17] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-02-23 15:48:17] 2.11.5.0 2598068 20442 219632 142987 2 244 24284207 37641217 13688 130560 0 2863508 98.714 8050566 34260 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.237:6081 1
[2025-02-23 15:48:17] CVMFS is ok
[2025-02-23 15:48:17] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-02-23 15:48:17] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-02-23 15:48:17] Further information can be found at the LHC@home message board.
[2025-02-23 15:48:17] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-02-23 15:48:17] Checking for apptainer binary...
[2025-02-23 15:48:17] Using apptainer found in PATH at /usr/bin/apptainer
[2025-02-23 15:48:17] Running /usr/bin/apptainer --version
[2025-02-23 15:48:20] apptainer version 1.3.6-1.el9
[2025-02-23 15:48:20] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-02-23 15:48:21] c6-1-26-2.aglt2.org
[2025-02-23 15:48:21] apptainer works
[2025-02-23 15:48:21] Set ATHENA_PROC_NUMBER=9
[2025-02-23 15:48:21] Set ATHENA_CORE_NUMBER=9
[2025-02-23 15:48:21] Starting ATLAS job with PandaID=6523692791
[2025-02-23 15:48:21] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/1 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2025-02-23 22:57:51]  *** The last 200 lines of the pilot log: ***
[2025-02-23 22:57:51] 2025-02-24 03:21:06,730 | INFO     | chi2: 7.322180434075062
[2025-02-23 22:57:51] 2025-02-24 03:21:06,731 | INFO     | model: linear, x: [1740343815.0, 1740343876.0, 1740343937.0, 1740343998.0, 1740344059.0, 1740344120.0, 1740344181.0, 1740344242.0, 1740344304.0, 1740344364.0, 1740
[2025-02-23 22:57:51] 2025-02-24 03:21:06,731 | INFO     | sum of square deviations: 17015636603.326256
[2025-02-23 22:57:51] 2025-02-24 03:21:06,734 | INFO     | sum of deviations: 349455093188.01056
[2025-02-23 22:57:51] 2025-02-24 03:21:06,734 | INFO     | mean x: 1740355375.0421052
[2025-02-23 22:57:51] 2025-02-24 03:21:06,734 | INFO     | mean y: 2534163.1868421054
[2025-02-23 22:57:51] 2025-02-24 03:21:06,734 | INFO     | -- intersect: -35739651917.9796
[2025-02-23 22:57:51] 2025-02-24 03:21:06,734 | INFO     | intersect: -35739651917.9796
[2025-02-23 22:57:51] 2025-02-24 03:21:06,735 | INFO     | chi2: 5.775212488786782
[2025-02-23 22:57:51] 2025-02-24 03:21:06,735 | INFO     | current chi2=5.775212488786782 (change=21.127148657648345 %)
[2025-02-23 22:57:51] 2025-02-24 03:21:06,735 | INFO     | right removable region: 379
[2025-02-23 22:57:51] 2025-02-24 03:21:06,736 | INFO     | model: linear, x: [1740344120.0, 1740344181.0, 1740344242.0, 1740344304.0, 1740344364.0, 1740344425.0, 1740344486.0, 1740344547.0, 1740344608.0, 1740344669.0, 1740
[2025-02-23 22:57:51] 2025-02-24 03:21:06,736 | INFO     | sum of square deviations: 17015510943.326258
[2025-02-23 22:57:51] 2025-02-24 03:21:06,739 | INFO     | sum of deviations: 192879466660.95782
[2025-02-23 22:57:51] 2025-02-24 03:21:06,739 | INFO     | mean x: 1740355680.0421052
[2025-02-23 22:57:51] 2025-02-24 03:21:06,739 | INFO     | mean y: 2547337.002631579
[2025-02-23 22:57:51] 2025-02-24 03:21:06,739 | INFO     | -- intersect: -19725269035.067474
[2025-02-23 22:57:51] 2025-02-24 03:21:06,739 | INFO     | intersect: -19725269035.067474
[2025-02-23 22:57:51] 2025-02-24 03:21:06,740 | INFO     | chi2: 4.488204209908702
[2025-02-23 22:57:51] 2025-02-24 03:21:06,740 | INFO     | current chi2=4.488204209908702 (change=38.70399329382748 %)
[2025-02-23 22:57:51] 2025-02-24 03:21:06,740 | INFO     | model: linear, x: [1740344425.0, 1740344486.0, 1740344547.0, 1740344608.0, 1740344669.0, 1740344731.0, 1740344792.0, 1740344853.0, 1740344913.0, 1740344974.0, 1740
[2025-02-23 22:57:51] 2025-02-24 03:21:06,741 | INFO     | sum of square deviations: 16352630834.933367
[2025-02-23 22:57:51] 2025-02-24 03:21:06,744 | INFO     | sum of deviations: 115764680974.22656
[2025-02-23 22:57:51] 2025-02-24 03:21:06,744 | INFO     | mean x: 1740355832.5466666
[2025-02-23 22:57:51] 2025-02-24 03:21:06,744 | INFO     | mean y: 2565074.7013333333
[2025-02-23 22:57:51] 2025-02-24 03:21:06,744 | INFO     | -- intersect: -12317882917.434868
[2025-02-23 22:57:51] 2025-02-24 03:21:06,744 | INFO     | intersect: -12317882917.434868
[2025-02-23 22:57:51] 2025-02-24 03:21:06,745 | INFO     | chi2: 3.1645914450054957
[2025-02-23 22:57:51] 2025-02-24 03:21:06,745 | INFO     | current chi2=3.1645914450054957 (change=29.490921156863553 %)
[2025-02-23 22:57:51] 2025-02-24 03:21:06,745 | INFO     | model: linear, x: [1740344731.0, 1740344792.0, 1740344853.0, 1740344913.0, 1740344974.0, 1740345035.0, 1740345096.0, 1740345158.0, 1740345218.0, 1740345280.0, 1740
[2025-02-23 22:57:51] 2025-02-24 03:21:06,745 | INFO     | sum of square deviations: 15707170160.918919
[2025-02-23 22:57:51] 2025-02-24 03:21:06,748 | INFO     | sum of deviations: 47943465866.270325
[2025-02-23 22:57:51] 2025-02-24 03:21:06,748 | INFO     | mean x: 1740355985.054054
[2025-02-23 22:57:51] 2025-02-24 03:21:06,748 | INFO     | mean y: 2581082.5864864867
[2025-02-23 22:57:51] 2025-02-24 03:21:06,749 | INFO     | -- intersect: -5309559609.197862
[2025-02-23 22:57:51] 2025-02-24 03:21:06,749 | INFO     | intersect: -5309559609.197862
[2025-02-23 22:57:51] 2025-02-24 03:21:06,749 | INFO     | chi2: 2.0943523227898124
[2025-02-23 22:57:51] 2025-02-24 03:21:06,749 | INFO     | current chi2=2.0943523227898124 (change=33.81918774711927 %)
[2025-02-23 22:57:51] 2025-02-24 03:21:06,750 | INFO     | model: linear, x: [1740345035.0, 1740345096.0, 1740345158.0, 1740345218.0, 1740345280.0, 1740345341.0, 1740345402.0, 1740345463.0, 1740345524.0, 1740345585.0, 1740
[2025-02-23 22:57:51] 2025-02-24 03:21:06,750 | INFO     | sum of square deviations: 15078987188.208267
[2025-02-23 22:57:51] 2025-02-24 03:21:06,752 | INFO     | sum of deviations: 18556888741.202724
[2025-02-23 22:57:51] 2025-02-24 03:21:06,753 | INFO     | mean x: 1740356137.5534246
[2025-02-23 22:57:51] 2025-02-24 03:21:06,753 | INFO     | mean y: 2588204.117808219
[2025-02-23 22:57:51] 2025-02-24 03:21:06,753 | INFO     | -- intersect: -2139173361.9310896
[2025-02-23 22:57:51] 2025-02-24 03:21:06,753 | INFO     | intersect: -2139173361.9310896
[2025-02-23 22:57:51] 2025-02-24 03:21:06,753 | INFO     | chi2: 1.9003256432313147
[2025-02-23 22:57:51] 2025-02-24 03:21:06,753 | INFO     | current chi2=1.9003256432313147 (change=9.264280772971459 %)
[2025-02-23 22:57:51] 2025-02-24 03:21:06,754 | INFO     | left removable region: 40
[2025-02-23 22:57:51] 2025-02-24 03:21:06,754 | INFO     | model: linear, x: [1740346255.0, 1740346317.0, 1740346377.0, 1740346438.0, 1740346500.0, 1740346561.0, 1740346622.0, 1740346683.0, 1740346744.0, 1740346804.0, 1740
[2025-02-23 22:57:51] 2025-02-24 03:21:06,754 | INFO     | sum of square deviations: 12080855969.120968
[2025-02-23 22:57:51] 2025-02-24 03:21:06,757 | INFO     | sum of deviations: 7252588682.27434
[2025-02-23 22:57:51] 2025-02-24 03:21:06,757 | INFO     | mean x: 1740356564.5693216
[2025-02-23 22:57:51] 2025-02-24 03:21:06,757 | INFO     | mean y: 2616779.5840707966
[2025-02-23 22:57:51] 2025-02-24 03:21:06,757 | INFO     | -- intersect: -1042184214.2842244
[2025-02-23 22:57:51] 2025-02-24 03:21:06,757 | INFO     | intersect: -1042184214.2842244
[2025-02-23 22:57:51] 2025-02-24 03:21:06,758 | INFO     | chi2: 0.0065439505427227545
[2025-02-23 22:57:51] 2025-02-24 03:21:06,758 | INFO     | -- intersect: -1042184214.2842244
[2025-02-23 22:57:51] 2025-02-24 03:21:06,759 | INFO     | current memory leak: 0.60 B/s (using 339 data points, chi2=0.01)
[2025-02-23 22:57:51] 2025-02-24 03:21:06,760 | INFO     | ..............................
[2025-02-23 22:57:51] 2025-02-24 03:21:06,760 | INFO     | . Timing measurements:
[2025-02-23 22:57:51] 2025-02-24 03:21:06,760 | INFO     | . get job = 0 s
[2025-02-23 22:57:51] 2025-02-24 03:21:06,760 | INFO     | . initial setup = 5 s
[2025-02-23 22:57:51] 2025-02-24 03:21:06,760 | INFO     | . payload setup = 8 s
[2025-02-23 22:57:51] 2025-02-24 03:21:06,760 | INFO     | . stage-in = 0 s
[2025-02-23 22:57:51] 2025-02-24 03:21:06,760 | INFO     | . payload execution = 23434 s
[2025-02-23 22:57:51] 2025-02-24 03:21:06,760 | INFO     | . stage-out = 4 s
[2025-02-23 22:57:51] 2025-02-24 03:21:06,760 | INFO     | . log creation = 0 s
[2025-02-23 22:57:51] 2025-02-24 03:21:06,760 | INFO     | ..............................
[2025-02-23 22:57:51] 2025-02-24 03:21:07,866 | INFO     | 
[2025-02-23 22:57:51] 2025-02-24 03:21:07,866 | INFO     | job summary report
[2025-02-23 22:57:51] 2025-02-24 03:21:07,866 | INFO     | --------------------------------------------------
[2025-02-23 22:57:51] 2025-02-24 03:21:07,866 | INFO     | PanDA job id: 6523692791
[2025-02-23 22:57:51] 2025-02-24 03:21:07,866 | INFO     | task id: 43205094
[2025-02-23 22:57:51] 2025-02-24 03:21:07,866 | INFO     | errors: (none)
[2025-02-23 22:57:51] 2025-02-24 03:21:07,866 | INFO     | status: LOG_TRANSFER = DONE 
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | pilot state: finished 
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | transexitcode: 0
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | exeerrorcode: 0
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | exeerrordiag: 
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | exitcode: 0
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | exitmsg: OK
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | cpuconsumptiontime: 87269 s
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | nevents: 400
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | neventsw: 0
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | pid: 2546798
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | pgrp: 2546798
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | corecount: 9
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | event service: False
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | sizes: {0: 2383032, 1: 2383287, 2: 2383315, 12: 2383315, 23: 2383343, 26: 2383577, 34: 2383733, 23447: 2418389, 23452: 2427330, 23454: 2427386, 23468: 2427556}
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | --------------------------------------------------
[2025-02-23 22:57:51] 2025-02-24 03:21:07,867 | INFO     | 
[2025-02-23 22:57:51] 2025-02-24 03:21:07,868 | INFO     | executing command: ls -lF /tmp/boinchome/slots/1
[2025-02-23 22:57:51] 2025-02-24 03:21:07,935 | INFO     | queue jobs had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,936 | INFO     | queue payloads had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,936 | INFO     | queue data_in had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,936 | INFO     | queue data_out had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,936 | INFO     | queue current_data_in had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,936 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,936 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,936 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,936 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,936 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,936 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,936 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,936 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,937 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,937 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,937 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,937 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,937 | INFO     | queue completed_jobids has 1 job(s)
[2025-02-23 22:57:51] 2025-02-24 03:21:07,937 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,937 | INFO     | queue messages had 0 job(s) [purged]
[2025-02-23 22:57:51] 2025-02-24 03:21:07,937 | INFO     | job 6523692791 has completed (purged errors)
[2025-02-23 22:57:51] 2025-02-24 03:21:07,937 | INFO     | overall cleanup function is called
[2025-02-23 22:57:51] 2025-02-24 03:21:08,950 | INFO     | --- collectZombieJob: --- 10, [2546798]
[2025-02-23 22:57:51] 2025-02-24 03:21:08,950 | INFO     | zombie collector waiting for pid 2546798
[2025-02-23 22:57:51] 2025-02-24 03:21:08,950 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2025-02-23 22:57:51] 2025-02-24 03:21:08,950 | INFO     | collected zombie processes
[2025-02-23 22:57:51] 2025-02-24 03:21:08,950 | INFO     | will attempt to kill all subprocesses of pid=2546798
[2025-02-23 22:57:51] 2025-02-24 03:21:09,203 | INFO     | process IDs to be killed: [2546798] (in reverse order)
[2025-02-23 22:57:51] 2025-02-24 03:21:09,365 | WARNING  | found no corresponding commands to process id(s)
[2025-02-23 22:57:51] 2025-02-24 03:21:09,365 | INFO     | Do not look for orphan processes in BOINC jobs
[2025-02-23 22:57:51] 2025-02-24 03:21:09,381 | INFO     | did not find any defunct processes belonging to 2546798
[2025-02-23 22:57:51] 2025-02-24 03:21:09,417 | INFO     | did not find any defunct processes belonging to 2546798
[2025-02-23 22:57:51] 2025-02-24 03:21:09,417 | INFO     | ready for new job
[2025-02-23 22:57:51] 2025-02-24 03:21:09,417 | INFO     | pilot has finished with previous job - re-establishing logging
[2025-02-23 22:57:51] 2025-02-24 03:21:09,419 | INFO     | **************************************
[2025-02-23 22:57:51] 2025-02-24 03:21:09,457 | INFO     | ***  PanDA Pilot version 3.9.4.15  ***
[2025-02-23 22:57:51] 2025-02-24 03:21:09,457 | INFO     | **************************************
[2025-02-23 22:57:51] 2025-02-24 03:21:09,457 | INFO     | 
[2025-02-23 22:57:51] 2025-02-24 03:21:09,476 | INFO     | architecture information:
[2025-02-23 22:57:51] 2025-02-24 03:21:09,509 | INFO     | executing command: cat /etc/os-release
[2025-02-23 22:57:51] 2025-02-24 03:21:09,594 | INFO     | cat /etc/os-release:
[2025-02-23 22:57:51] NAME="CentOS Linux"
[2025-02-23 22:57:51] VERSION="7 (Core)"
[2025-02-23 22:57:51] ID="centos"
[2025-02-23 22:57:51] ID_LIKE="rhel fedora"
[2025-02-23 22:57:51] VERSION_ID="7"
[2025-02-23 22:57:51] PRETTY_NAME="CentOS Linux 7 (Core)"
[2025-02-23 22:57:51] ANSI_COLOR="0;31"
[2025-02-23 22:57:51] CPE_NAME="cpe:/o:centos:centos:7"
[2025-02-23 22:57:51] HOME_URL="https://www.centos.org/"
[2025-02-23 22:57:51] BUG_REPORT_URL="https://bugs.centos.org/"
[2025-02-23 22:57:51] 
[2025-02-23 22:57:51] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2025-02-23 22:57:51] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2025-02-23 22:57:51] REDHAT_SUPPORT_PRODUCT="centos"
[2025-02-23 22:57:51] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2025-02-23 22:57:51] 
[2025-02-23 22:57:51] 2025-02-24 03:21:09,594 | INFO     | **************************************
[2025-02-23 22:57:51] 2025-02-24 03:21:10,098 | INFO     | executing command: df -mP /tmp/boinchome/slots/1
[2025-02-23 22:57:51] 2025-02-24 03:21:10,145 | INFO     | sufficient remaining disk space (71057801216 B)
[2025-02-23 22:57:51] 2025-02-24 03:21:10,146 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2025-02-23 22:57:51] 2025-02-24 03:21:10,146 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2025-02-23 22:57:51] 2025-02-24 03:21:10,371 | INFO     | all data control threads have been joined
[2025-02-23 22:57:51] 2025-02-24 03:21:10,374 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2025-02-23 22:57:51] 2025-02-24 03:21:10,949 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2025-02-23 22:57:51] 2025-02-24 03:21:10,949 | INFO     | aborting loop
[2025-02-23 22:57:51] 2025-02-24 03:21:10,965 | INFO     | all payload control threads have been joined
[2025-02-23 22:57:51] 2025-02-24 03:21:10,965 | INFO     | all job control threads have been joined
[2025-02-23 22:57:51] 2025-02-24 03:21:11,152 | INFO     | [job] retrieve thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:11,414 | INFO     | [data] control thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:11,955 | INFO     | [job] create_data_payload thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:11,965 | INFO     | [job] job monitor thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:11,965 | INFO     | [data] copytool_in thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:11,972 | INFO     | [payload] control thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:11,978 | INFO     | [job] control thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:11,995 | INFO     | [payload] execute_payloads thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:11,995 | INFO     | [job] validate thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:12,159 | INFO     | [payload] validate_pre thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:12,289 | INFO     | [payload] validate_post thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:12,337 | INFO     | PID=2534496 has CPU usage=7.4% CMD=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/bin/python3 pilot3/pilot.py -q BOINC_MCORE -i P
[2025-02-23 22:57:51] 2025-02-24 03:21:12,338 | INFO     | .. there are 23 such processes running
[2025-02-23 22:57:51] 2025-02-24 03:21:12,338 | INFO     | found 0 job(s) in 20 queues
[2025-02-23 22:57:51] 2025-02-24 03:21:12,338 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2025-02-23 22:57:51] 2025-02-24 03:21:12,338 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2025-02-23 22:57:51] 2025-02-24 03:21:12,365 | INFO     | [payload] failed_post thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:12,420 | INFO     | [data] copytool_out thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:12,587 | INFO     | [payload] run_realtimelog thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:12,958 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2025-02-23 22:57:51] 2025-02-24 03:21:13,592 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2025-02-23 22:57:51] 2025-02-24 03:21:13,965 | INFO     | [job] queue monitor thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:17,601 | INFO     | [data] queue_monitor thread has finished
[2025-02-23 22:57:51] 2025-02-24 03:21:18,311 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140714940966720)>', '<ExcThread(monitor, started 140714436441856)>']
[2025-02-23 22:57:51] 2025-02-24 03:21:18,374 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2025-02-23 22:57:51] 2025-02-24 03:21:18,374 | INFO     | [monitor] control thread has ended
[2025-02-23 22:57:51] 2025-02-24 03:21:23,337 | INFO     | all workflow threads have been joined
[2025-02-23 22:57:51] 2025-02-24 03:21:23,337 | INFO     | end of generic workflow (traces error code: 0)
[2025-02-23 22:57:51] 2025-02-24 03:21:23,337 | INFO     | traces error code: 0
[2025-02-23 22:57:51] 2025-02-24 03:21:23,338 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2025-02-23 22:57:51] 2025-02-24 03:21:25,355 [wrapper] ==== pilot stdout END ====
[2025-02-23 22:57:51] 2025-02-24 03:21:25,389 [wrapper] ==== wrapper stdout RESUME ====
[2025-02-23 22:57:51] 2025-02-24 03:21:25,436 [wrapper] pilotpid: 2534496
[2025-02-23 22:57:51] 2025-02-24 03:21:25,440 [wrapper] Pilot exit status: 0
[2025-02-23 22:57:51] 2025-02-24 03:21:25,460 [wrapper] pandaids: 6523692791
[2025-02-23 22:57:51] 2025-02-24 03:21:25,535 [wrapper] cleanup supervisor_pilot 3846951 2534497
[2025-02-23 22:57:51] 2025-02-24 03:21:25,538 [wrapper] Test setup, not cleaning
[2025-02-23 22:57:51] 2025-02-24 03:21:25,543 [wrapper] apfmon messages muted
[2025-02-23 22:57:51] 2025-02-24 03:21:25,546 [wrapper] ==== wrapper stdout END ====
[2025-02-23 22:57:51] 2025-02-24 03:21:25,548 [wrapper] ==== wrapper stderr END ====
[2025-02-23 22:57:51]  *** Error codes and diagnostics ***
[2025-02-23 22:57:51]     "exeErrorCode": 0,
[2025-02-23 22:57:51]     "exeErrorDiag": "",
[2025-02-23 22:57:51]     "pilotErrorCode": 0,
[2025-02-23 22:57:51]     "pilotErrorDiag": "",
[2025-02-23 22:57:51]  *** Listing of results directory ***
[2025-02-23 22:57:51] total 671476
[2025-02-23 22:57:51] -rw-r--r--. 1 boincer umatlas    491065 Feb 22 22:38 pilot3.tar.gz
[2025-02-23 22:57:51] -rwx------. 1 boincer umatlas     35865 Feb 22 22:52 runpilot2-wrapper.sh
[2025-02-23 22:57:51] -rw-r--r--. 1 boincer umatlas      5118 Feb 22 22:52 queuedata.json
[2025-02-23 22:57:51] -rw-r--r--. 1 boincer umatlas       100 Feb 23 15:48 wrapper_26015_x86_64-pc-linux-gnu
[2025-02-23 22:57:51] -rwxr-xr-x. 1 boincer umatlas      7986 Feb 23 15:48 run_atlas
[2025-02-23 22:57:51] -rw-r--r--. 1 boincer umatlas       105 Feb 23 15:48 job.xml
[2025-02-23 22:57:51] -rw-r--r--. 2 boincer umatlas 343996389 Feb 23 15:48 EVNT.43092757._001915.pool.root.1
[2025-02-23 22:57:51] drwxrwx--x. 2 boincer umatlas      4096 Feb 23 15:48 shared
[2025-02-23 22:57:51] -rw-r--r--. 2 boincer umatlas    503553 Feb 23 15:48 input.tar.gz
[2025-02-23 22:57:51] -rw-r--r--. 2 boincer umatlas     17569 Feb 23 15:48 start_atlas.sh
[2025-02-23 22:57:51] -rw-r--r--. 1 boincer umatlas         0 Feb 23 15:48 boinc_lockfile
[2025-02-23 22:57:51] -rw-r--r--. 1 boincer umatlas      2547 Feb 23 15:48 pandaJob.out
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas       467 Feb 23 15:48 setup.sh.local
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas    987736 Feb 23 15:49 agis_schedconf.cvmfs.json
[2025-02-23 22:57:51] drwx------. 4 boincer umatlas      4096 Feb 23 15:49 pilot3
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas 333682445 Feb 23 22:18 HITS.43205094._037895.pool.root.1
[2025-02-23 22:57:51] -rw-r--r--. 1 boincer umatlas       531 Feb 23 22:19 boinc_task_state.xml
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas        95 Feb 23 22:20 pilot_heartbeat.json
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas      1055 Feb 23 22:20 memory_monitor_summary.json
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas   1582569 Feb 23 22:20 agis_ddmendpoints.agis.ALL.json
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas    536549 Feb 23 22:20 log.43205094._037895.job.log.tgz.1
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas      7761 Feb 23 22:21 heartbeat.json
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas      4610 Feb 23 22:21 pilotlog.txt
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas   2515703 Feb 23 22:21 log.43205094._037895.job.log.1
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas       357 Feb 23 22:21 output.list
[2025-02-23 22:57:51] -rw-r--r--. 1 boincer umatlas       620 Feb 23 22:21 runtime_log
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas   3072000 Feb 23 22:21 result.tar.gz
[2025-02-23 22:57:51] -rw-r--r--. 1 boincer umatlas     11424 Feb 23 22:21 runtime_log.err
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas       661 Feb 23 22:21 jGLNDmiDI66nsSi4ap6QjLDmwznN0nGgGQJmkKkKDmRzuKDmc4FRnn.diag
[2025-02-23 22:57:51] -rw-r--r--. 1 boincer umatlas      6843 Feb 23 22:57 init_data.xml
[2025-02-23 22:57:51] -rw-r--r--. 1 boincer umatlas      8192 Feb 23 22:57 boinc_mmap_file
[2025-02-23 22:57:51] -rw-r--r--. 1 boincer umatlas        28 Feb 23 22:57 wrapper_checkpoint.txt
[2025-02-23 22:57:51] -rw-r--r--. 1 boincer umatlas     21780 Feb 23 22:57 stderr.txt
[2025-02-23 22:57:51] HITS file was successfully produced:
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas 333682445 Feb 23 22:18 shared/HITS.pool.root.1
[2025-02-23 22:57:51]  *** Contents of shared directory: ***
[2025-02-23 22:57:51] total 665320
[2025-02-23 22:57:51] -rw-r--r--. 2 boincer umatlas 343996389 Feb 23 15:48 ATLAS.root_0
[2025-02-23 22:57:51] -rw-r--r--. 2 boincer umatlas    503553 Feb 23 15:48 input.tar.gz
[2025-02-23 22:57:51] -rw-r--r--. 2 boincer umatlas     17569 Feb 23 15:48 start_atlas.sh
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas 333682445 Feb 23 22:18 HITS.pool.root.1
[2025-02-23 22:57:51] -rw-------. 1 boincer umatlas   3072000 Feb 23 22:21 result.tar.gz
22:57:53 (2527070): run_atlas exited; CPU time 87201.208237
22:57:53 (2527070): called boinc_finish(0)

</stderr_txt>
]]>


©2025 CERN