Name A4JNDmlNIP7nsSi4ap6QjLDmwznN0nGgGQJmkKkKDm2QaLDmXiSGNn_0
Workunit 231657766
Created 16 Apr 2025, 13:53:32 UTC
Sent 16 Apr 2025, 17:11:39 UTC
Report deadline 24 Apr 2025, 17:11:39 UTC
Received 17 Apr 2025, 8:55:34 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10856839
Run time 14 hours 6 min 30 sec
CPU time 1 days 9 hours 24 min 22 sec
Validate state Valid
Credit 670.96
Device peak FLOPS 9.44 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.31 GB
Peak swap size 31.77 GB
Peak disk usage 631.74 MB

Stderr output

<core_client_version>8.1.0</core_client_version>
<![CDATA[
<stderr_txt>
14:35:44 (1443371): wrapper (7.7.26015): starting
14:35:44 (1443371): wrapper: running run_atlas (--nthreads 8)
[2025-04-16 14:35:44] Arguments: --nthreads 8
[2025-04-16 14:35:44] Threads: 8
[2025-04-16 14:35:44] Checking for CVMFS
[2025-04-16 14:35:45] Probing /cvmfs/atlas.cern.ch... OK
[2025-04-16 14:35:46] Probing /cvmfs/atlas-condb.cern.ch... OK
[2025-04-16 14:36:06] Running cvmfs_config stat atlas.cern.ch
[2025-04-16 14:36:07] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2025-04-16 14:36:07] 2.12.6.0 4030568 69330 206812 144935 1 104 28067207 32935937 24812 130560 0 56316171 99.605 64580157 9658 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.237:6081 1
[2025-04-16 14:36:07] CVMFS is ok
[2025-04-16 14:36:07] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2025-04-16 14:36:07] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2025-04-16 14:36:07] Further information can be found at the LHC@home message board.
[2025-04-16 14:36:07] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2025-04-16 14:36:07] Checking for apptainer binary...
[2025-04-16 14:36:07] Using apptainer found in PATH at /usr/bin/apptainer
[2025-04-16 14:36:07] Running /usr/bin/apptainer --version
[2025-04-16 14:36:07] apptainer version 1.4.0-1.el9
[2025-04-16 14:36:07] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2025-04-16 14:36:08] c6-12-25-4.aglt2.org
[2025-04-16 14:36:08] apptainer works
[2025-04-16 14:36:08] Set ATHENA_PROC_NUMBER=8
[2025-04-16 14:36:08] Set ATHENA_CORE_NUMBER=8
[2025-04-16 14:36:09] Starting ATLAS job with PandaID=6604035657
[2025-04-16 14:36:09] Running command: /usr/bin/apptainer exec -B /cvmfs,/tmp/boinchome/slots/3 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2025-04-17 04:46:56]  *** The last 200 lines of the pilot log: ***
[2025-04-17 04:46:56] 2025-04-17 08:46:28,623 | INFO     | monitor loop #2262: job 0:6604035657 is in state 'finished'
[2025-04-17 04:46:56] 2025-04-17 08:46:28,624 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2025-04-17 04:46:56] 2025-04-17 08:46:31,203 | INFO     | monitor loop #2263: job 0:6604035657 is in state 'finished'
[2025-04-17 04:46:56] 2025-04-17 08:46:31,204 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2025-04-17 04:46:56] 2025-04-17 08:46:33,778 | INFO     | monitor loop #2264: job 0:6604035657 is in state 'finished'
[2025-04-17 04:46:56] 2025-04-17 08:46:33,779 | INFO     | will abort job monitoring soon since job state=finished (job is still in queue)
[2025-04-17 04:46:56] 2025-04-17 08:46:35,003 | INFO     | CPU arch script returned: x86-64-v4
[2025-04-17 04:46:56] 2025-04-17 08:46:35,009 | INFO     | using path: /tmp/boinchome/slots/3/PanDA_Pilot-6604035657/memory_monitor_summary.json (trf name=prmon)
[2025-04-17 04:46:56] 2025-04-17 08:46:35,011 | INFO     | extracted standard info from prmon json
[2025-04-17 04:46:56] 2025-04-17 08:46:35,012 | INFO     | extracted standard memory fields from prmon json
[2025-04-17 04:46:56] 2025-04-17 08:46:35,012 | WARNING  | GPU info not found in prmon json: 'gpu'
[2025-04-17 04:46:56] 2025-04-17 08:46:35,013 | WARNING  | format EVNTtoHITS has no such key: dbData
[2025-04-17 04:46:56] 2025-04-17 08:46:35,013 | WARNING  | format EVNTtoHITS has no such key: dbTime
[2025-04-17 04:46:56] 2025-04-17 08:46:35,053 | INFO     | fitting pss+swap vs Time
[2025-04-17 04:46:56] 2025-04-17 08:46:35,058 | INFO     | sum of square deviations: 178584753642.07712
[2025-04-17 04:46:56] 2025-04-17 08:46:35,234 | INFO     | sum of deviations: 1158727110237.296
[2025-04-17 04:46:56] 2025-04-17 08:46:35,235 | INFO     | mean x: 1744854171.2019231
[2025-04-17 04:46:56] 2025-04-17 08:46:35,235 | INFO     | mean y: 2340249.688701923
[2025-04-17 04:46:56] 2025-04-17 08:46:35,236 | INFO     | -- intersect: -11318950008.014065
[2025-04-17 04:46:56] 2025-04-17 08:46:35,236 | INFO     | intersect: -11318950008.014065
[2025-04-17 04:46:56] 2025-04-17 08:46:35,239 | INFO     | chi2: 10.498586949842474
[2025-04-17 04:46:56] 2025-04-17 08:46:35,242 | INFO     | sum of square deviations: 175384486118.00952
[2025-04-17 04:46:56] 2025-04-17 08:46:35,310 | INFO     | sum of deviations: 1258091246055.1042
[2025-04-17 04:46:56] 2025-04-17 08:46:35,315 | INFO     | mean x: 1744854018.7049577
[2025-04-17 04:46:56] 2025-04-17 08:46:35,315 | INFO     | mean y: 2344965.8282950423
[2025-04-17 04:46:56] 2025-04-17 08:46:35,315 | INFO     | -- intersect: -12514073191.589117
[2025-04-17 04:46:56] 2025-04-17 08:46:35,316 | INFO     | intersect: -12514073191.589117
[2025-04-17 04:46:56] 2025-04-17 08:46:35,319 | INFO     | chi2: 8.938041313339882
[2025-04-17 04:46:56] 2025-04-17 08:46:35,319 | INFO     | current chi2=8.938041313339882 (change=14.86433978170755 %)
[2025-04-17 04:46:56] 2025-04-17 08:46:35,321 | INFO     | right removable region: 826
[2025-04-17 04:46:56] 2025-04-17 08:46:35,324 | INFO     | sum of square deviations: 175384332520.82504
[2025-04-17 04:46:56] 2025-04-17 08:46:35,340 | INFO     | PID=1451587 has CPU usage=11.0% CMD=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.20-x86_64-centos7/bin/python3 pilot3/pilot.py -q BOINC_MCORE -i 
[2025-04-17 04:46:56] 2025-04-17 08:46:35,340 | INFO     | .. there are 31 such processes running
[2025-04-17 04:46:56] 2025-04-17 08:46:35,373 | INFO     | sum of deviations: 931426882246.931
[2025-04-17 04:46:56] 2025-04-17 08:46:35,374 | INFO     | mean x: 1744854323.7025392
[2025-04-17 04:46:56] 2025-04-17 08:46:35,374 | INFO     | mean y: 2351075.889963724
[2025-04-17 04:46:56] 2025-04-17 08:46:35,375 | INFO     | -- intersect: -9264179174.230057
[2025-04-17 04:46:56] 2025-04-17 08:46:35,375 | INFO     | intersect: -9264179174.230057
[2025-04-17 04:46:56] 2025-04-17 08:46:35,378 | INFO     | chi2: 7.428848853800802
[2025-04-17 04:46:56] 2025-04-17 08:46:35,378 | INFO     | current chi2=7.428848853800802 (change=29.239535860468653 %)
[2025-04-17 04:46:56] 2025-04-17 08:46:35,381 | INFO     | sum of square deviations: 172222226260.84183
[2025-04-17 04:46:56] 2025-04-17 08:46:35,420 | INFO     | sum of deviations: 759373378131.872
[2025-04-17 04:46:56] 2025-04-17 08:46:35,421 | INFO     | mean x: 1744854476.2068126
[2025-04-17 04:46:56] 2025-04-17 08:46:35,421 | INFO     | mean y: 2359372.1301703164
[2025-04-17 04:46:56] 2025-04-17 08:46:35,421 | INFO     | -- intersect: -7691165829.076393
[2025-04-17 04:46:56] 2025-04-17 08:46:35,422 | INFO     | intersect: -7691165829.076393
[2025-04-17 04:46:56] 2025-04-17 08:46:35,425 | INFO     | chi2: 5.7805054139685605
[2025-04-17 04:46:56] 2025-04-17 08:46:35,425 | INFO     | current chi2=5.7805054139685605 (change=22.188409971336327 %)
[2025-04-17 04:46:56] 2025-04-17 08:46:35,425 | INFO     | left removable region: 20
[2025-04-17 04:46:56] 2025-04-17 08:46:35,436 | INFO     | sum of square deviations: 162359743021.00345
[2025-04-17 04:46:56] 2025-04-17 08:46:35,559 | INFO     | sum of deviations: 584766262168.5634
[2025-04-17 04:46:56] 2025-04-17 08:46:35,559 | INFO     | mean x: 1744854598.2171216
[2025-04-17 04:46:56] 2025-04-17 08:46:35,560 | INFO     | mean y: 2377814.5967741935
[2025-04-17 04:46:56] 2025-04-17 08:46:35,560 | INFO     | -- intersect: -6282013146.129634
[2025-04-17 04:46:56] 2025-04-17 08:46:35,560 | INFO     | intersect: -6282013146.129634
[2025-04-17 04:46:56] 2025-04-17 08:46:35,586 | INFO     | chi2: 2.132213966916825
[2025-04-17 04:46:56] 2025-04-17 08:46:35,587 | INFO     | -- intersect: -6282013146.129634
[2025-04-17 04:46:56] 2025-04-17 08:46:35,587 | INFO     | current memory leak: 3.60 B/s (using 806 data points, chi2=2.13)
[2025-04-17 04:46:56] 2025-04-17 08:46:35,600 | INFO     | ..............................
[2025-04-17 04:46:56] 2025-04-17 08:46:35,601 | INFO     | . Timing measurements:
[2025-04-17 04:46:56] 2025-04-17 08:46:35,601 | INFO     | . get job = 0 s
[2025-04-17 04:46:56] 2025-04-17 08:46:35,601 | INFO     | . initial setup = 10 s
[2025-04-17 04:46:56] 2025-04-17 08:46:35,601 | INFO     | . payload setup = 47 s
[2025-04-17 04:46:56] 2025-04-17 08:46:35,602 | INFO     | . stage-in = 1 s
[2025-04-17 04:46:56] 2025-04-17 08:46:35,602 | INFO     | . payload execution = 50766 s
[2025-04-17 04:46:56] 2025-04-17 08:46:35,602 | INFO     | . stage-out = 10 s
[2025-04-17 04:46:56] 2025-04-17 08:46:35,624 | INFO     | . log creation = 3 s
[2025-04-17 04:46:56] 2025-04-17 08:46:35,625 | INFO     | ..............................
[2025-04-17 04:46:56] 2025-04-17 08:46:36,530 | INFO     | 
[2025-04-17 04:46:56] 2025-04-17 08:46:36,531 | INFO     | job summary report
[2025-04-17 04:46:56] 2025-04-17 08:46:36,531 | INFO     | --------------------------------------------------
[2025-04-17 04:46:56] 2025-04-17 08:46:36,531 | INFO     | PanDA job id: 6604035657
[2025-04-17 04:46:56] 2025-04-17 08:46:36,531 | INFO     | task id: 44075483
[2025-04-17 04:46:56] 2025-04-17 08:46:36,531 | INFO     | errors: (none)
[2025-04-17 04:46:56] 2025-04-17 08:46:36,532 | INFO     | status: LOG_TRANSFER = DONE 
[2025-04-17 04:46:56] 2025-04-17 08:46:36,532 | INFO     | pilot state: finished 
[2025-04-17 04:46:56] 2025-04-17 08:46:36,532 | INFO     | transexitcode: 0
[2025-04-17 04:46:56] 2025-04-17 08:46:36,532 | INFO     | exeerrorcode: 0
[2025-04-17 04:46:56] 2025-04-17 08:46:36,532 | INFO     | exeerrordiag: 
[2025-04-17 04:46:56] 2025-04-17 08:46:36,532 | INFO     | exitcode: 0
[2025-04-17 04:46:56] 2025-04-17 08:46:36,533 | INFO     | exitmsg: OK
[2025-04-17 04:46:56] 2025-04-17 08:46:36,533 | INFO     | cpuconsumptiontime: 112247 s
[2025-04-17 04:46:56] 2025-04-17 08:46:36,533 | INFO     | nevents: 400
[2025-04-17 04:46:56] 2025-04-17 08:46:36,533 | INFO     | neventsw: 0
[2025-04-17 04:46:56] 2025-04-17 08:46:36,534 | INFO     | pid: 1462911
[2025-04-17 04:46:56] 2025-04-17 08:46:36,534 | INFO     | pgrp: 1462911
[2025-04-17 04:46:56] 2025-04-17 08:46:36,534 | INFO     | corecount: 8
[2025-04-17 04:46:56] 2025-04-17 08:46:36,538 | INFO     | event service: False
[2025-04-17 04:46:56] 2025-04-17 08:46:36,539 | INFO     | sizes: {0: 2416537, 1: 2417138, 2: 2417222, 4: 2417250, 5: 2417449, 6: 2417505, 18: 2417661, 30: 2417689, 37: 2417923, 42: 2417951, 50821: 2462383, 50822: 2462662,
[2025-04-17 04:46:56] 2025-04-17 08:46:36,539 | INFO     | --------------------------------------------------
[2025-04-17 04:46:56] 2025-04-17 08:46:36,539 | INFO     | 
[2025-04-17 04:46:56] 2025-04-17 08:46:36,539 | INFO     | executing command: ls -lF /tmp/boinchome/slots/3
[2025-04-17 04:46:56] 2025-04-17 08:46:36,700 | INFO     | queue jobs had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,701 | INFO     | queue payloads had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,701 | INFO     | queue data_in had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,701 | INFO     | queue data_out had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,702 | INFO     | queue current_data_in had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,702 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,702 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,702 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,702 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,703 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,703 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,725 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,726 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,726 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,726 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,726 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,727 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,727 | INFO     | queue completed_jobids has 1 job(s)
[2025-04-17 04:46:56] 2025-04-17 08:46:36,727 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,727 | INFO     | queue messages had 0 job(s) [purged]
[2025-04-17 04:46:56] 2025-04-17 08:46:36,728 | INFO     | job 6604035657 has completed (purged errors)
[2025-04-17 04:46:56] 2025-04-17 08:46:36,728 | INFO     | overall cleanup function is called
[2025-04-17 04:46:56] 2025-04-17 08:46:37,761 | INFO     | --- collectZombieJob: --- 10, [1462911]
[2025-04-17 04:46:56] 2025-04-17 08:46:37,762 | INFO     | zombie collector waiting for pid 1462911
[2025-04-17 04:46:56] 2025-04-17 08:46:37,762 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2025-04-17 04:46:56] 2025-04-17 08:46:37,762 | INFO     | collected zombie processes
[2025-04-17 04:46:56] 2025-04-17 08:46:37,762 | INFO     | will attempt to kill all subprocesses of pid=1462911
[2025-04-17 04:46:56] 2025-04-17 08:46:41,168 | INFO     | process IDs to be killed: [1462911] (in reverse order)
[2025-04-17 04:46:56] 2025-04-17 08:46:41,583 | WARNING  | found no corresponding commands to process id(s)
[2025-04-17 04:46:56] 2025-04-17 08:46:41,588 | INFO     | Do not look for orphan processes in BOINC jobs
[2025-04-17 04:46:56] 2025-04-17 08:46:41,674 | INFO     | did not find any defunct processes belonging to 1462911
[2025-04-17 04:46:56] 2025-04-17 08:46:41,765 | INFO     | did not find any defunct processes belonging to 1462911
[2025-04-17 04:46:56] 2025-04-17 08:46:41,766 | INFO     | ready for new job
[2025-04-17 04:46:56] 2025-04-17 08:46:41,766 | INFO     | pilot has finished with previous job - re-establishing logging
[2025-04-17 04:46:56] 2025-04-17 08:46:41,780 | INFO     | **************************************
[2025-04-17 04:46:56] 2025-04-17 08:46:41,786 | INFO     | ***  PanDA Pilot version 3.10.2.2  ***
[2025-04-17 04:46:56] 2025-04-17 08:46:41,787 | INFO     | **************************************
[2025-04-17 04:46:56] 2025-04-17 08:46:41,787 | INFO     | 
[2025-04-17 04:46:56] 2025-04-17 08:46:41,828 | INFO     | architecture information:
[2025-04-17 04:46:56] 2025-04-17 08:46:41,836 | INFO     | executing command: cat /etc/os-release
[2025-04-17 04:46:56] 2025-04-17 08:46:41,953 | INFO     | cat /etc/os-release:
[2025-04-17 04:46:56] NAME="CentOS Linux"
[2025-04-17 04:46:56] VERSION="7 (Core)"
[2025-04-17 04:46:56] ID="centos"
[2025-04-17 04:46:56] ID_LIKE="rhel fedora"
[2025-04-17 04:46:56] VERSION_ID="7"
[2025-04-17 04:46:56] PRETTY_NAME="CentOS Linux 7 (Core)"
[2025-04-17 04:46:56] ANSI_COLOR="0;31"
[2025-04-17 04:46:56] CPE_NAME="cpe:/o:centos:centos:7"
[2025-04-17 04:46:56] HOME_URL="https://www.centos.org/"
[2025-04-17 04:46:56] BUG_REPORT_URL="https://bugs.centos.org/"
[2025-04-17 04:46:56] 
[2025-04-17 04:46:56] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2025-04-17 04:46:56] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2025-04-17 04:46:56] REDHAT_SUPPORT_PRODUCT="centos"
[2025-04-17 04:46:56] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2025-04-17 04:46:56] 
[2025-04-17 04:46:56] 2025-04-17 08:46:41,954 | INFO     | **************************************
[2025-04-17 04:46:56] 2025-04-17 08:46:42,458 | INFO     | executing command: df -mP /tmp/boinchome/slots/3
[2025-04-17 04:46:56] 2025-04-17 08:46:42,647 | INFO     | sufficient remaining disk space (93610573824 B)
[2025-04-17 04:46:56] 2025-04-17 08:46:42,648 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2025-04-17 04:46:56] 2025-04-17 08:46:42,648 | INFO     | current server update state: UPDATING_FINAL
[2025-04-17 04:46:56] 2025-04-17 08:46:42,648 | INFO     | update_server=False
[2025-04-17 04:46:56] 2025-04-17 08:46:42,649 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2025-04-17 04:46:56] 2025-04-17 08:46:42,649 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2025-04-17 04:46:56] 2025-04-17 08:46:42,650 | INFO     | aborting loop
[2025-04-17 04:46:56] 2025-04-17 08:46:42,950 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2025-04-17 04:46:56] 2025-04-17 08:46:43,214 | INFO     | all job control threads have been joined
[2025-04-17 04:46:56] 2025-04-17 08:46:43,363 | INFO     | all payload control threads have been joined
[2025-04-17 04:46:56] 2025-04-17 08:46:43,438 | INFO     | found 0 job(s) in 20 queues
[2025-04-17 04:46:56] 2025-04-17 08:46:43,438 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2025-04-17 04:46:56] 2025-04-17 08:46:43,438 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2025-04-17 04:46:56] 2025-04-17 08:46:43,443 | INFO     | all data control threads have been joined
[2025-04-17 04:46:56] 2025-04-17 08:46:43,655 | INFO     | [job] retrieve thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:43,667 | INFO     | [job] job monitor thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:43,888 | INFO     | [data] copytool_in thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:43,917 | INFO     | [job] validate thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:44,024 | INFO     | [payload] failed_post thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:44,219 | INFO     | [job] control thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:44,369 | INFO     | [payload] control thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:44,449 | INFO     | [data] control thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:44,515 | INFO     | [payload] validate_pre thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:44,592 | INFO     | [job] create_data_payload thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:44,746 | INFO     | [payload] execute_payloads thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:44,757 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2025-04-17 04:46:56] 2025-04-17 08:46:44,822 | INFO     | [payload] run_realtimelog thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:44,958 | INFO     | [data] copytool_out thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:45,027 | INFO     | [payload] validate_post thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:45,609 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2025-04-17 04:46:56] 2025-04-17 08:46:46,615 | INFO     | [job] queue monitor thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:48,766 | INFO     | [data] queue_monitor thread has finished
[2025-04-17 04:46:56] 2025-04-17 08:46:48,839 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140582482106176)>', '<ExcThread(monitor, started 140581695108864)>']
[2025-04-17 04:46:56] 2025-04-17 08:46:49,474 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2025-04-17 04:46:56] 2025-04-17 08:46:49,475 | INFO     | [monitor] control thread has ended
[2025-04-17 04:46:56] 2025-04-17 08:46:53,865 | INFO     | all workflow threads have been joined
[2025-04-17 04:46:56] 2025-04-17 08:46:53,870 | INFO     | end of generic workflow (traces error code: 0)
[2025-04-17 04:46:56] 2025-04-17 08:46:53,871 | INFO     | traces error code: 0
[2025-04-17 04:46:56] 2025-04-17 08:46:53,872 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2025-04-17 04:46:56] 2025-04-17 08:46:54,916 [wrapper] ==== pilot stdout END ====
[2025-04-17 04:46:56] 2025-04-17 08:46:54,967 [wrapper] ==== wrapper stdout RESUME ====
[2025-04-17 04:46:56] 2025-04-17 08:46:54,985 [wrapper] pilotpid: 1451587
[2025-04-17 04:46:56] 2025-04-17 08:46:55,008 [wrapper] Pilot exit status: 0
[2025-04-17 04:46:56] 2025-04-17 08:46:55,076 [wrapper] pandaids: 6604035657
[2025-04-17 04:46:56] 2025-04-17 08:46:55,443 [wrapper] cleanup supervisor_pilot  732013 1451588
[2025-04-17 04:46:56] 2025-04-17 08:46:55,453 [wrapper] Test setup, not cleaning
[2025-04-17 04:46:56] 2025-04-17 08:46:55,459 [wrapper] apfmon messages muted
[2025-04-17 04:46:56] 2025-04-17 08:46:55,465 [wrapper] ==== wrapper stdout END ====
[2025-04-17 04:46:56] 2025-04-17 08:46:55,470 [wrapper] ==== wrapper stderr END ====
[2025-04-17 04:46:56]  *** Error codes and diagnostics ***
[2025-04-17 04:46:56]     "exeErrorCode": 0,
[2025-04-17 04:46:56]     "exeErrorDiag": "",
[2025-04-17 04:46:56]     "pilotErrorCode": 0,
[2025-04-17 04:46:56]     "pilotErrorDiag": "",
[2025-04-17 04:46:56]  *** Listing of results directory ***
[2025-04-17 04:46:56] total 420412
[2025-04-17 04:46:56] -rw-r--r--. 1 boincer umatlas    495897 Apr 16 09:51 pilot3.tar.gz
[2025-04-17 04:46:56] -rw-r--r--. 1 boincer umatlas      5111 Apr 16 09:52 queuedata.json
[2025-04-17 04:46:56] -rwx------. 1 boincer umatlas     37140 Apr 16 09:53 runpilot2-wrapper.sh
[2025-04-17 04:46:56] -rw-r--r--. 1 boincer umatlas       100 Apr 16 14:35 wrapper_26015_x86_64-pc-linux-gnu
[2025-04-17 04:46:56] -rwxr-xr-x. 1 boincer umatlas      7986 Apr 16 14:35 run_atlas
[2025-04-17 04:46:56] -rw-r--r--. 1 boincer umatlas       105 Apr 16 14:35 job.xml
[2025-04-17 04:46:56] -rw-r--r--. 2 boincer umatlas 226254053 Apr 16 14:35 EVNT.44075481._001614.pool.root.1
[2025-04-17 04:46:56] drwxrwx--x. 2 boincer umatlas      4096 Apr 16 14:35 shared
[2025-04-17 04:46:56] -rw-r--r--. 2 boincer umatlas    508893 Apr 16 14:35 input.tar.gz
[2025-04-17 04:46:56] -rw-r--r--. 2 boincer umatlas     17569 Apr 16 14:35 start_atlas.sh
[2025-04-17 04:46:56] -rw-r--r--. 1 boincer umatlas         0 Apr 16 14:35 boinc_lockfile
[2025-04-17 04:46:56] -rw-r--r--. 1 boincer umatlas      2578 Apr 16 14:36 pandaJob.out
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas       467 Apr 16 14:36 setup.sh.local
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas    986552 Apr 16 14:37 agis_schedconf.cvmfs.json
[2025-04-17 04:46:56] drwx------. 4 boincer umatlas      4096 Apr 16 14:37 pilot3
[2025-04-17 04:46:56] -rw-r--r--. 1 boincer umatlas      6860 Apr 17 04:36 init_data.xml
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas 192461581 Apr 17 04:43 HITS.44075483._041195.pool.root.1
[2025-04-17 04:46:56] -rw-r--r--. 1 boincer umatlas       532 Apr 17 04:44 boinc_task_state.xml
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas      1053 Apr 17 04:45 memory_monitor_summary.json
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas   1618536 Apr 17 04:46 agis_ddmendpoints.agis.ALL.json
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas    654442 Apr 17 04:46 log.44075483._041195.job.log.tgz.1
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas      7756 Apr 17 04:46 heartbeat.json
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas        95 Apr 17 04:46 pilot_heartbeat.json
[2025-04-17 04:46:56] -rw-r--r--. 1 boincer umatlas        29 Apr 17 04:46 wrapper_checkpoint.txt
[2025-04-17 04:46:56] -rw-r--r--. 1 boincer umatlas      8192 Apr 17 04:46 boinc_mmap_file
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas      4353 Apr 17 04:46 pilotlog.txt
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas   3305966 Apr 17 04:46 log.44075483._041195.job.log.1
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas       357 Apr 17 04:46 output.list
[2025-04-17 04:46:56] -rw-r--r--. 1 boincer umatlas       620 Apr 17 04:46 runtime_log
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas   3983360 Apr 17 04:46 result.tar.gz
[2025-04-17 04:46:56] -rw-r--r--. 1 boincer umatlas     11429 Apr 17 04:46 runtime_log.err
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas       666 Apr 17 04:46 A4JNDmlNIP7nsSi4ap6QjLDmwznN0nGgGQJmkKkKDm2QaLDmXiSGNn.diag
[2025-04-17 04:46:56] -rw-r--r--. 1 boincer umatlas     21286 Apr 17 04:46 stderr.txt
[2025-04-17 04:46:56] HITS file was successfully produced:
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas 192461581 Apr 17 04:43 shared/HITS.pool.root.1
[2025-04-17 04:46:56]  *** Contents of shared directory: ***
[2025-04-17 04:46:56] total 413324
[2025-04-17 04:46:56] -rw-r--r--. 2 boincer umatlas 226254053 Apr 16 14:35 ATLAS.root_0
[2025-04-17 04:46:56] -rw-r--r--. 2 boincer umatlas    508893 Apr 16 14:35 input.tar.gz
[2025-04-17 04:46:56] -rw-r--r--. 2 boincer umatlas     17569 Apr 16 14:35 start_atlas.sh
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas 192461581 Apr 17 04:43 HITS.pool.root.1
[2025-04-17 04:46:56] -rw-------. 1 boincer umatlas   3983360 Apr 17 04:46 result.tar.gz
04:46:57 (1443371): run_atlas exited; CPU time 117190.540993
04:46:57 (1443371): called boinc_finish(0)

</stderr_txt>
]]>


©2025 CERN