Name KmxNDmfP746n9Rq4apOajLDm4fhM0noT9bVoFjIUDmF7aKDmk30G0m_0
Workunit 230464223
Created 19 Feb 2025, 22:08:07 UTC
Sent 20 Feb 2025, 1:42:37 UTC
Report deadline 28 Feb 2025, 1:42:37 UTC
Received 21 Feb 2025, 8:37:20 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10855297
Run time 6 hours 2 min 1 sec
CPU time 22 hours 54 min 25 sec
Validate state Valid
Credit 1,935.85
Device peak FLOPS 23.24 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.52 GB
Peak swap size 2.87 GB
Peak disk usage 985.77 MB

Stderr output

<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
02:33:53 (3704443): wrapper (7.7.26015): starting
02:33:53 (3704443): wrapper: running run_atlas (--nthreads 4)
[2025-02-21 02:33:53] Arguments: --nthreads 4
[2025-02-21 02:33:53] Threads: 4
[2025-02-21 02:33:53] Checking for CVMFS
[2025-02-21 02:33:53] No cvmfs_config command found, will try listing directly
[2025-02-21 02:33:53] CVMFS is ok
[2025-02-21 02:33:53] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-02-21 02:33:53] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-02-21 02:33:53] Further information can be found at the LHC@home message board.
[2025-02-21 02:33:53] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-02-21 02:33:53] Checking for apptainer binary...
[2025-02-21 02:33:53] which: no apptainer in ((null))
[2025-02-21 02:33:53] apptainer is not installed, using version from CVMFS
[2025-02-21 02:33:53] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-02-21 02:33:53] WARNING: Environment variable TMPDIR already has value [/scratch/boinc/var/slot32/slots/0/.apptainertmp], will not forward new value [/tmp] from parent process environment skurut17.grid.cesnet.cz
[2025-02-21 02:33:53] apptainer works
[2025-02-21 02:33:53] Set ATHENA_PROC_NUMBER=4
[2025-02-21 02:33:53] Set ATHENA_CORE_NUMBER=4
[2025-02-21 02:33:53] Starting ATLAS job with PandaID=6519429179
[2025-02-21 02:33:53] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/scratch/boinc/var/slot32/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2025-02-21 08:35:51]  *** The last 200 lines of the pilot log: ***
[2025-02-21 08:35:51] 2025-02-21 07:35:31,509 | INFO     | intersect: -9394459905.010592
[2025-02-21 08:35:51] 2025-02-21 07:35:31,509 | INFO     | chi2: 1.5385623390517875
[2025-02-21 08:35:51] 2025-02-21 07:35:31,509 | INFO     | current chi2=1.5385623390517875 (change=61.0849888469874 %)
[2025-02-21 08:35:51] 2025-02-21 07:35:31,510 | INFO     | model: linear, x: [1740102289.0, 1740102350.0, 1740102411.0, 1740102472.0, 1740102533.0, 1740102594.0, 1740102655.0, 1740102716.0, 1740102777.0, 1740102838.0, 1740
[2025-02-21 08:35:51] 2025-02-21 07:35:31,510 | INFO     | sum of square deviations: 12733038740.0
[2025-02-21 08:35:51] 2025-02-21 07:35:31,513 | INFO     | sum of deviations: 5000588093.999998
[2025-02-21 08:35:51] 2025-02-21 07:35:31,514 | INFO     | mean x: 1740112781.0
[2025-02-21 08:35:51] 2025-02-21 07:35:31,514 | INFO     | mean y: 2386830.2463768115
[2025-02-21 08:35:51] 2025-02-21 07:35:31,514 | INFO     | -- intersect: -680999707.136123
[2025-02-21 08:35:51] 2025-02-21 07:35:31,514 | INFO     | intersect: -680999707.136123
[2025-02-21 08:35:51] 2025-02-21 07:35:31,514 | INFO     | chi2: 0.11954369869403943
[2025-02-21 08:35:51] 2025-02-21 07:35:31,514 | INFO     | current chi2=0.11954369869403943 (change=92.23016866721736 %)
[2025-02-21 08:35:51] 2025-02-21 07:35:31,515 | INFO     | model: linear, x: [1740102594.0, 1740102655.0, 1740102716.0, 1740102777.0, 1740102838.0, 1740102899.0, 1740102960.0, 1740103021.0, 1740103082.0, 1740103143.0, 1740
[2025-02-21 08:35:51] 2025-02-21 07:35:31,515 | INFO     | sum of square deviations: 12187409905.0
[2025-02-21 08:35:51] 2025-02-21 07:35:31,518 | INFO     | sum of deviations: -8586193927.499998
[2025-02-21 08:35:51] 2025-02-21 07:35:31,518 | INFO     | mean x: 1740112933.5
[2025-02-21 08:35:51] 2025-02-21 07:35:31,519 | INFO     | mean y: 2390609.5205882355
[2025-02-21 08:35:51] 2025-02-21 07:35:31,519 | INFO     | -- intersect: 1228323536.9633784
[2025-02-21 08:35:51] 2025-02-21 07:35:31,519 | INFO     | intersect: 1228323536.9633784
[2025-02-21 08:35:51] 2025-02-21 07:35:31,519 | INFO     | chi2: 0.03298671436014907
[2025-02-21 08:35:51] 2025-02-21 07:35:31,519 | INFO     | current chi2=0.03298671436014907 (change=72.40614543425214 %)
[2025-02-21 08:35:51] 2025-02-21 07:35:31,520 | INFO     | model: linear, x: [1740102899.0, 1740102960.0, 1740103021.0, 1740103082.0, 1740103143.0, 1740103204.0, 1740103265.0, 1740103326.0, 1740103387.0, 1740103448.0, 1740
[2025-02-21 08:35:51] 2025-02-21 07:35:31,522 | INFO     | sum of square deviations: 11657595320.0
[2025-02-21 08:35:51] 2025-02-21 07:35:31,525 | INFO     | sum of deviations: -7697441709.000003
[2025-02-21 08:35:51] 2025-02-21 07:35:31,525 | INFO     | mean x: 1740113086.0
[2025-02-21 08:35:51] 2025-02-21 07:35:31,526 | INFO     | mean y: 2390351.6686567166
[2025-02-21 08:35:51] 2025-02-21 07:35:31,526 | INFO     | -- intersect: 1151376800.3210113
[2025-02-21 08:35:51] 2025-02-21 07:35:31,526 | INFO     | intersect: 1151376800.3210113
[2025-02-21 08:35:51] 2025-02-21 07:35:31,526 | INFO     | chi2: 0.032673065742641255
[2025-02-21 08:35:51] 2025-02-21 07:35:31,526 | INFO     | current chi2=0.032673065742641255 (change=0.9508331568988613 %)
[2025-02-21 08:35:51] 2025-02-21 07:35:31,527 | INFO     | left removable region: 40
[2025-02-21 08:35:51] 2025-02-21 07:35:31,527 | INFO     | model: linear, x: [1740104119.0, 1740104180.0, 1740104241.0, 1740104302.0, 1740104363.0, 1740104424.0, 1740104485.0, 1740104546.0, 1740104607.0, 1740104668.0, 1740
[2025-02-21 08:35:51] 2025-02-21 07:35:31,527 | INFO     | sum of square deviations: 9148487810.0
[2025-02-21 08:35:51] 2025-02-21 07:35:31,530 | INFO     | sum of deviations: 5264837227.0
[2025-02-21 08:35:51] 2025-02-21 07:35:31,530 | INFO     | mean x: 1740113513.0
[2025-02-21 08:35:51] 2025-02-21 07:35:31,530 | INFO     | mean y: 2386071.854368932
[2025-02-21 08:35:51] 2025-02-21 07:35:31,530 | INFO     | -- intersect: -999026904.0075018
[2025-02-21 08:35:51] 2025-02-21 07:35:31,530 | INFO     | intersect: -999026904.0075018
[2025-02-21 08:35:51] 2025-02-21 07:35:31,531 | INFO     | chi2: 0.016336135736750492
[2025-02-21 08:35:51] 2025-02-21 07:35:31,531 | INFO     | -- intersect: -999026904.0075018
[2025-02-21 08:35:51] 2025-02-21 07:35:31,531 | INFO     | current memory leak: 0.58 B/s (using 309 data points, chi2=0.02)
[2025-02-21 08:35:51] 2025-02-21 07:35:31,532 | INFO     | ..............................
[2025-02-21 08:35:51] 2025-02-21 07:35:31,532 | INFO     | . Timing measurements:
[2025-02-21 08:35:51] 2025-02-21 07:35:31,532 | INFO     | . get job = 0 s
[2025-02-21 08:35:51] 2025-02-21 07:35:31,533 | INFO     | . initial setup = 1 s
[2025-02-21 08:35:51] 2025-02-21 07:35:31,533 | INFO     | . payload setup = 8 s
[2025-02-21 08:35:51] 2025-02-21 07:35:31,533 | INFO     | . stage-in = 0 s
[2025-02-21 08:35:51] 2025-02-21 07:35:31,533 | INFO     | . payload execution = 21648 s
[2025-02-21 08:35:51] 2025-02-21 07:35:31,533 | INFO     | . stage-out = 1 s
[2025-02-21 08:35:51] 2025-02-21 07:35:31,533 | INFO     | . log creation = 0 s
[2025-02-21 08:35:51] 2025-02-21 07:35:31,533 | INFO     | ..............................
[2025-02-21 08:35:51] 2025-02-21 07:35:31,784 | WARNING  | process 3718231 can no longer be monitored (due to stat problems) - aborting
[2025-02-21 08:35:51] 2025-02-21 07:35:31,784 | INFO     | using path: /scratch/boinc/var/slot32/slots/0/PanDA_Pilot-6519429179/memory_monitor_summary.json (trf name=prmon)
[2025-02-21 08:35:51] 2025-02-21 07:35:31,785 | INFO     | using path: /scratch/boinc/var/slot32/slots/0/PanDA_Pilot-6519429179/memory_monitor_summary.json (trf name=prmon)
[2025-02-21 08:35:51] 2025-02-21 07:35:31,786 | INFO     | payload log (log.EVNTtoHITS) within allowed size limit (2147483648 B): 2562803 B
[2025-02-21 08:35:51] 2025-02-21 07:35:31,786 | INFO     | payload log (payload.stdout) within allowed size limit (2147483648 B): 16765 B
[2025-02-21 08:35:51] 2025-02-21 07:35:31,787 | INFO     | executing command: df -mP /scratch/boinc/var/slot32/slots/0
[2025-02-21 08:35:51] 2025-02-21 07:35:31,811 | INFO     | sufficient remaining disk space (3271584382976 B)
[2025-02-21 08:35:51] 2025-02-21 07:35:31,812 | INFO     | work directory size check will use 2537553920 B as a max limit (10% grace limit added)
[2025-02-21 08:35:51] 2025-02-21 07:35:31,813 | INFO     | size of work directory /scratch/boinc/var/slot32/slots/0/PanDA_Pilot-6519429179: 2971380 B (within 2537553920 B limit)
[2025-02-21 08:35:51] 2025-02-21 07:35:31,813 | INFO     | pfn file=/scratch/boinc/var/slot32/slots/0/PanDA_Pilot-6519429179/HITS.43205094._022560.pool.root.1 does not exist (skip from workdir size calculation)
[2025-02-21 08:35:51] 2025-02-21 07:35:31,813 | INFO     | total size of present files: 0 B (workdir size: 2971380 B)
[2025-02-21 08:35:51] 2025-02-21 07:35:31,813 | INFO     | output file size check: skipping output file /scratch/boinc/var/slot32/slots/0/PanDA_Pilot-6519429179/HITS.43205094._022560.pool.root.1 since it does not exist
[2025-02-21 08:35:51] 2025-02-21 07:35:32,034 | INFO     | 
[2025-02-21 08:35:51] 2025-02-21 07:35:32,035 | INFO     | job summary report
[2025-02-21 08:35:51] 2025-02-21 07:35:32,035 | INFO     | --------------------------------------------------
[2025-02-21 08:35:51] 2025-02-21 07:35:32,035 | INFO     | PanDA job id: 6519429179
[2025-02-21 08:35:51] 2025-02-21 07:35:32,035 | INFO     | task id: 43205094
[2025-02-21 08:35:51] 2025-02-21 07:35:32,035 | INFO     | errors: (none)
[2025-02-21 08:35:51] 2025-02-21 07:35:32,035 | INFO     | status: LOG_TRANSFER = DONE 
[2025-02-21 08:35:51] 2025-02-21 07:35:32,035 | INFO     | pilot state: finished 
[2025-02-21 08:35:51] 2025-02-21 07:35:32,035 | INFO     | transexitcode: 0
[2025-02-21 08:35:51] 2025-02-21 07:35:32,035 | INFO     | exeerrorcode: 0
[2025-02-21 08:35:51] 2025-02-21 07:35:32,036 | INFO     | exeerrordiag: 
[2025-02-21 08:35:51] 2025-02-21 07:35:32,036 | INFO     | exitcode: 0
[2025-02-21 08:35:51] 2025-02-21 07:35:32,036 | INFO     | exitmsg: OK
[2025-02-21 08:35:51] 2025-02-21 07:35:32,036 | INFO     | cpuconsumptiontime: 82258 s
[2025-02-21 08:35:51] 2025-02-21 07:35:32,036 | INFO     | nevents: 400
[2025-02-21 08:35:51] 2025-02-21 07:35:32,038 | INFO     | neventsw: 0
[2025-02-21 08:35:51] 2025-02-21 07:35:32,038 | INFO     | pid: 3718231
[2025-02-21 08:35:51] 2025-02-21 07:35:32,038 | INFO     | pgrp: 3718231
[2025-02-21 08:35:51] 2025-02-21 07:35:32,038 | INFO     | corecount: 4
[2025-02-21 08:35:51] 2025-02-21 07:35:32,038 | INFO     | event service: False
[2025-02-21 08:35:51] 2025-02-21 07:35:32,038 | INFO     | sizes: {0: 2389210, 1: 2389409, 7: 2389615, 11: 2389643, 21660: 2422991, 21662: 2432138, 21669: 2432252}
[2025-02-21 08:35:51] 2025-02-21 07:35:32,038 | INFO     | --------------------------------------------------
[2025-02-21 08:35:51] 2025-02-21 07:35:32,038 | INFO     | 
[2025-02-21 08:35:51] 2025-02-21 07:35:32,039 | INFO     | executing command: ls -lF /scratch/boinc/var/slot32/slots/0
[2025-02-21 08:35:51] 2025-02-21 07:35:32,070 | INFO     | queue jobs had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,071 | INFO     | queue payloads had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,071 | INFO     | queue data_in had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,071 | INFO     | queue data_out had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,071 | INFO     | queue current_data_in had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,071 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,071 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,071 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,072 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,072 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,072 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,072 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,072 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,072 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,072 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,072 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,072 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,072 | INFO     | queue completed_jobids has 1 job(s)
[2025-02-21 08:35:51] 2025-02-21 07:35:32,073 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,073 | INFO     | queue messages had 0 job(s) [purged]
[2025-02-21 08:35:51] 2025-02-21 07:35:32,073 | INFO     | job 6519429179 has completed (purged errors)
[2025-02-21 08:35:51] 2025-02-21 07:35:32,073 | INFO     | overall cleanup function is called
[2025-02-21 08:35:51] 2025-02-21 07:35:32,129 | INFO     | number of running child processes to parent process 3718231: 1
[2025-02-21 08:35:51] 2025-02-21 07:35:32,130 | INFO     | maximum number of monitored processes: 6
[2025-02-21 08:35:51] 2025-02-21 07:35:32,130 | INFO     | aborting job monitoring since job object (job id=6519429179) has expired
[2025-02-21 08:35:51] 2025-02-21 07:35:33,082 | INFO     | --- collectZombieJob: --- 10, [3718231]
[2025-02-21 08:35:51] 2025-02-21 07:35:33,083 | INFO     | zombie collector waiting for pid 3718231
[2025-02-21 08:35:51] 2025-02-21 07:35:33,083 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2025-02-21 08:35:51] 2025-02-21 07:35:33,083 | INFO     | collected zombie processes
[2025-02-21 08:35:51] 2025-02-21 07:35:33,083 | INFO     | will attempt to kill all subprocesses of pid=3718231
[2025-02-21 08:35:51] 2025-02-21 07:35:33,404 | INFO     | process IDs to be killed: [3718231] (in reverse order)
[2025-02-21 08:35:51] 2025-02-21 07:35:33,671 | WARNING  | found no corresponding commands to process id(s)
[2025-02-21 08:35:51] 2025-02-21 07:35:33,672 | INFO     | Do not look for orphan processes in BOINC jobs
[2025-02-21 08:35:51] 2025-02-21 07:35:33,697 | INFO     | did not find any defunct processes belonging to 3718231
[2025-02-21 08:35:51] 2025-02-21 07:35:33,717 | INFO     | did not find any defunct processes belonging to 3718231
[2025-02-21 08:35:51] 2025-02-21 07:35:33,717 | INFO     | ready for new job
[2025-02-21 08:35:51] 2025-02-21 07:35:33,717 | INFO     | pilot has finished with previous job - re-establishing logging
[2025-02-21 08:35:51] 2025-02-21 07:35:33,721 | INFO     | **************************************
[2025-02-21 08:35:51] 2025-02-21 07:35:33,721 | INFO     | ***  PanDA Pilot version 3.9.4.15  ***
[2025-02-21 08:35:51] 2025-02-21 07:35:33,721 | INFO     | **************************************
[2025-02-21 08:35:51] 2025-02-21 07:35:33,721 | INFO     | 
[2025-02-21 08:35:51] 2025-02-21 07:35:33,730 | INFO     | architecture information:
[2025-02-21 08:35:51] 2025-02-21 07:35:33,730 | INFO     | executing command: cat /etc/os-release
[2025-02-21 08:35:51] 2025-02-21 07:35:33,755 | INFO     | cat /etc/os-release:
[2025-02-21 08:35:51] NAME="CentOS Linux"
[2025-02-21 08:35:51] VERSION="7 (Core)"
[2025-02-21 08:35:51] ID="centos"
[2025-02-21 08:35:51] ID_LIKE="rhel fedora"
[2025-02-21 08:35:51] VERSION_ID="7"
[2025-02-21 08:35:51] PRETTY_NAME="CentOS Linux 7 (Core)"
[2025-02-21 08:35:51] ANSI_COLOR="0;31"
[2025-02-21 08:35:51] CPE_NAME="cpe:/o:centos:centos:7"
[2025-02-21 08:35:51] HOME_URL="https://www.centos.org/"
[2025-02-21 08:35:51] BUG_REPORT_URL="https://bugs.centos.org/"
[2025-02-21 08:35:51] 
[2025-02-21 08:35:51] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2025-02-21 08:35:51] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2025-02-21 08:35:51] REDHAT_SUPPORT_PRODUCT="centos"
[2025-02-21 08:35:51] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2025-02-21 08:35:51] 
[2025-02-21 08:35:51] 2025-02-21 07:35:33,755 | INFO     | **************************************
[2025-02-21 08:35:51] 2025-02-21 07:35:34,258 | INFO     | executing command: df -mP /scratch/boinc/var/slot32/slots/0
[2025-02-21 08:35:51] 2025-02-21 07:35:34,280 | INFO     | sufficient remaining disk space (3271584382976 B)
[2025-02-21 08:35:51] 2025-02-21 07:35:34,281 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2025-02-21 08:35:51] 2025-02-21 07:35:34,281 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2025-02-21 08:35:51] 2025-02-21 07:35:34,281 | WARNING  | aborting monitor loop since graceful_stop has been set (timing out remaining threads)
[2025-02-21 08:35:51] 2025-02-21 07:35:34,281 | INFO     | found 0 job(s) in 20 queues
[2025-02-21 08:35:51] 2025-02-21 07:35:34,282 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2025-02-21 08:35:51] 2025-02-21 07:35:34,282 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2025-02-21 08:35:51] 2025-02-21 07:35:34,427 | INFO     | all data control threads have been joined
[2025-02-21 08:35:51] 2025-02-21 07:35:34,633 | WARNING  | job monitor detected an abort_job request (signal=args.signal)
[2025-02-21 08:35:51] 2025-02-21 07:35:34,634 | WARNING  | cannot recover job monitoring - aborting pilot
[2025-02-21 08:35:51] 2025-02-21 07:35:34,634 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2025-02-21 08:35:51] 2025-02-21 07:35:34,634 | INFO     | will abort loop
[2025-02-21 08:35:51] 2025-02-21 07:35:34,877 | INFO     | all payload control threads have been joined
[2025-02-21 08:35:51] 2025-02-21 07:35:35,119 | INFO     | all job control threads have been joined
[2025-02-21 08:35:51] 2025-02-21 07:35:35,179 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2025-02-21 08:35:51] 2025-02-21 07:35:35,284 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2025-02-21 08:35:51] 2025-02-21 07:35:35,286 | INFO     | [job] retrieve thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:35,366 | INFO     | [data] copytool_in thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:35,433 | INFO     | [data] control thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:35,551 | INFO     | [payload] validate_post thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:35,638 | INFO     | [job] validate thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:35,639 | INFO     | [job] job monitor thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:35,882 | INFO     | [payload] control thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:35,929 | INFO     | [payload] failed_post thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:36,125 | INFO     | [job] control thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:36,256 | INFO     | [payload] execute_payloads thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:36,487 | INFO     | [payload] validate_pre thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:36,514 | INFO     | [job] create_data_payload thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:36,648 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2025-02-21 08:35:51] 2025-02-21 07:35:37,181 | INFO     | [data] copytool_out thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:37,653 | INFO     | [job] queue monitor thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:39,290 | INFO     | [data] queue_monitor thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:44,506 | INFO     | job.realtimelogging is not enabled
[2025-02-21 08:35:51] 2025-02-21 07:35:45,512 | INFO     | [payload] run_realtimelog thread has finished
[2025-02-21 08:35:51] 2025-02-21 07:35:45,827 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 23312618329920)>', '<ExcThread(monitor, started 23312379893504)>']
[2025-02-21 08:35:51] 2025-02-21 07:35:46,339 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2025-02-21 08:35:51] 2025-02-21 07:35:46,340 | INFO     | [monitor] control thread has ended
[2025-02-21 08:35:51] 2025-02-21 07:35:50,834 | INFO     | all workflow threads have been joined
[2025-02-21 08:35:51] 2025-02-21 07:35:50,834 | INFO     | end of generic workflow (traces error code: 0)
[2025-02-21 08:35:51] 2025-02-21 07:35:50,834 | INFO     | traces error code: 0
[2025-02-21 08:35:51] 2025-02-21 07:35:50,834 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2025-02-21 08:35:51] 2025-02-21 07:35:50,979 [wrapper] ==== pilot stdout END ====
[2025-02-21 08:35:51] 2025-02-21 07:35:50,983 [wrapper] ==== wrapper stdout RESUME ====
[2025-02-21 08:35:51] 2025-02-21 07:35:50,987 [wrapper] pilotpid: 3710726
[2025-02-21 08:35:51] 2025-02-21 07:35:50,990 [wrapper] Pilot exit status: 0
[2025-02-21 08:35:51] 2025-02-21 07:35:51,005 [wrapper] pandaids: 6519429179
[2025-02-21 08:35:51] 2025-02-21 07:35:51,151 [wrapper] cleanup supervisor_pilot 1047682 3710727
[2025-02-21 08:35:51] 2025-02-21 07:35:51,155 [wrapper] Test setup, not cleaning
[2025-02-21 08:35:51] 2025-02-21 07:35:51,163 [wrapper] apfmon messages muted
[2025-02-21 08:35:51] 2025-02-21 07:35:51,167 [wrapper] ==== wrapper stdout END ====
[2025-02-21 08:35:51] 2025-02-21 07:35:51,171 [wrapper] ==== wrapper stderr END ====
[2025-02-21 08:35:51]  *** Error codes and diagnostics ***
[2025-02-21 08:35:51]     "exeErrorCode": 0,
[2025-02-21 08:35:51]     "exeErrorDiag": "",
[2025-02-21 08:35:51]     "pilotErrorCode": 0,
[2025-02-21 08:35:51]     "pilotErrorDiag": "",
[2025-02-21 08:35:51]  *** Listing of results directory ***
[2025-02-21 08:35:51] total 672224
[2025-02-21 08:35:51] -rw-r--r-- 1 boinc boinc    491065 Feb 19 23:02 pilot3.tar.gz
[2025-02-21 08:35:51] -rw-r--r-- 1 boinc boinc      5118 Feb 19 23:07 queuedata.json
[2025-02-21 08:35:51] -rwx------ 1 boinc boinc     35865 Feb 19 23:07 runpilot2-wrapper.sh
[2025-02-21 08:35:51] -rw-r--r-- 1 boinc boinc       100 Feb 21 02:33 wrapper_26015_x86_64-pc-linux-gnu
[2025-02-21 08:35:51] -rwxr-xr-x 1 boinc boinc      7986 Feb 21 02:33 run_atlas
[2025-02-21 08:35:51] -rw-r--r-- 1 boinc boinc       105 Feb 21 02:33 job.xml
[2025-02-21 08:35:51] -rw-r--r-- 1 boinc boinc      6677 Feb 21 02:33 init_data.xml
[2025-02-21 08:35:51] -rw-r--r-- 2 boinc boinc 345041494 Feb 21 02:33 EVNT.43092757._001673.pool.root.1
[2025-02-21 08:35:51] -rw-r--r-- 2 boinc boinc     17569 Feb 21 02:33 start_atlas.sh
[2025-02-21 08:35:51] drwxrwx--x 2 boinc boinc      4096 Feb 21 02:33 shared
[2025-02-21 08:35:51] -rw-r--r-- 2 boinc boinc    503549 Feb 21 02:33 input.tar.gz
[2025-02-21 08:35:51] -rw-r--r-- 1 boinc boinc         0 Feb 21 02:33 boinc_lockfile
[2025-02-21 08:35:51] -rw-r--r-- 1 boinc boinc      2550 Feb 21 02:33 pandaJob.out
[2025-02-21 08:35:51] -rw------- 1 boinc boinc       424 Feb 21 02:33 setup.sh.local
[2025-02-21 08:35:51] -rw------- 1 boinc boinc    994744 Feb 21 02:34 agis_schedconf.cvmfs.json
[2025-02-21 08:35:51] drwx------ 4 boinc boinc      4096 Feb 21 02:34 pilot3
[2025-02-21 08:35:51] -rw------- 1 boinc boinc 333969757 Feb 21 08:34 HITS.43205094._022560.pool.root.1
[2025-02-21 08:35:51] -rw-r--r-- 1 boinc boinc       531 Feb 21 08:34 boinc_task_state.xml
[2025-02-21 08:35:51] -rw------- 1 boinc boinc        95 Feb 21 08:35 pilot_heartbeat.json
[2025-02-21 08:35:51] -rw------- 1 boinc boinc      1029 Feb 21 08:35 memory_monitor_summary.json
[2025-02-21 08:35:51] -rw------- 1 boinc boinc   1586690 Feb 21 08:35 agis_ddmendpoints.agis.ALL.json
[2025-02-21 08:35:51] -rw------- 1 boinc boinc    439288 Feb 21 08:35 log.43205094._022560.job.log.tgz.1
[2025-02-21 08:35:51] -rw-r--r-- 1 boinc boinc      8192 Feb 21 08:35 boinc_mmap_file
[2025-02-21 08:35:51] -rw-r--r-- 1 boinc boinc        28 Feb 21 08:35 wrapper_checkpoint.txt
[2025-02-21 08:35:51] -rw------- 1 boinc boinc      7701 Feb 21 08:35 heartbeat.json
[2025-02-21 08:35:51] -rw------- 1 boinc boinc      4607 Feb 21 08:35 pilotlog.txt
[2025-02-21 08:35:51] -rw------- 1 boinc boinc   2324993 Feb 21 08:35 log.43205094._022560.job.log.1
[2025-02-21 08:35:51] -rw------- 1 boinc boinc       357 Feb 21 08:35 output.list
[2025-02-21 08:35:51] -rw-r--r-- 1 boinc boinc       620 Feb 21 08:35 runtime_log
[2025-02-21 08:35:51] -rw------- 1 boinc boinc   2785280 Feb 21 08:35 result.tar.gz
[2025-02-21 08:35:51] -rw-r--r-- 1 boinc boinc     11424 Feb 21 08:35 runtime_log.err
[2025-02-21 08:35:51] -rw------- 1 boinc boinc       666 Feb 21 08:35 KmxNDmfP746n9Rq4apOajLDm4fhM0noT9bVoFjIUDmF7aKDmk30G0m.diag
[2025-02-21 08:35:51] -rw-r--r-- 1 boinc boinc     21974 Feb 21 08:35 stderr.txt
[2025-02-21 08:35:51] HITS file was successfully produced:
[2025-02-21 08:35:51] -rw------- 1 boinc boinc 333969757 Feb 21 08:34 shared/HITS.pool.root.1
[2025-02-21 08:35:51]  *** Contents of shared directory: ***
[2025-02-21 08:35:51] total 666340
[2025-02-21 08:35:51] -rw-r--r-- 2 boinc boinc 345041494 Feb 21 02:33 ATLAS.root_0
[2025-02-21 08:35:51] -rw-r--r-- 2 boinc boinc     17569 Feb 21 02:33 start_atlas.sh
[2025-02-21 08:35:51] -rw-r--r-- 2 boinc boinc    503549 Feb 21 02:33 input.tar.gz
[2025-02-21 08:35:51] -rw------- 1 boinc boinc 333969757 Feb 21 08:34 HITS.pool.root.1
[2025-02-21 08:35:51] -rw------- 1 boinc boinc   2785280 Feb 21 08:35 result.tar.gz
08:35:52 (3704443): run_atlas exited; CPU time 81910.304136
08:35:52 (3704443): called boinc_finish(0)

</stderr_txt>
]]>


©2025 CERN