Name XZjMDmV37R5nsSi4apGgGQJmABFKDmABFKDm4ySLDmbmQKDmgTJ6Wn_0
Workunit 223061866
Created 17 May 2024, 8:23:52 UTC
Sent 17 May 2024, 12:24:21 UTC
Report deadline 25 May 2024, 12:24:21 UTC
Received 19 May 2024, 1:23:36 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10830136
Run time 2 hours 41 min 42 sec
CPU time 1 days 4 hours 15 min 35 sec
Validate state Valid
Credit 1,499.41
Device peak FLOPS 26.76 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.91 GB
Peak swap size 3.37 GB
Peak disk usage 1.51 GB

Stderr output

<core_client_version>7.22.1</core_client_version>
<![CDATA[
<stderr_txt>
21:39:44 (2332363): wrapper (7.7.26015): starting
21:39:44 (2332363): wrapper: running run_atlas (--nthreads 12)
[2024-05-17 21:39:44] Arguments: --nthreads 12
[2024-05-17 21:39:44] Threads: 12
[2024-05-17 21:39:44] Checking for CVMFS
[2024-05-17 21:39:44] Probing /cvmfs/atlas.cern.ch... OK
[2024-05-17 21:39:44] Probing /cvmfs/atlas-condb.cern.ch... OK
[2024-05-17 21:39:44] Running cvmfs_config stat atlas.cern.ch
[2024-05-17 21:39:45] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2024-05-17 21:39:45] 2.11.0.0 2456805 963 86572 132855 2 240 4054013 6144001 8546 130560 0 4244116 99.271 3164760 5915 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://192.168.0.145:3128 1
[2024-05-17 21:39:45] CVMFS is ok
[2024-05-17 21:39:45] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-05-17 21:39:45] Checking for apptainer binary...
[2024-05-17 21:39:45] apptainer is not installed, using version from CVMFS
[2024-05-17 21:39:45] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-05-17 21:39:45] radiat0r
[2024-05-17 21:39:45] apptainer works
[2024-05-17 21:39:45] Set ATHENA_PROC_NUMBER=12
[2024-05-17 21:39:45] Set ATHENA_CORE_NUMBER=12
[2024-05-17 21:39:45] Starting ATLAS job with PandaID=6207856482
[2024-05-17 21:39:45] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/home/boinc/slots/75 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2024-05-18 00:21:23]  *** The last 200 lines of the pilot log: ***
[2024-05-18 00:21:23] 2024-05-18 00:21:06,723 | INFO     | -- intersect: -128618958799.33464
[2024-05-18 00:21:23] 2024-05-18 00:21:06,723 | INFO     | intersect: -128618958799.33464
[2024-05-18 00:21:23] 2024-05-18 00:21:06,723 | INFO     | chi2: 5.6509141063826105
[2024-05-18 00:21:23] 2024-05-18 00:21:06,724 | INFO     | model: linear, x: [1715982034.0, 1715982095.0, 1715982156.0, 1715982217.0, 1715982278.0, 1715982339.0, 1715982400.0, 1715982461.0, 1715982522.0, 1715982583.0, 1715
[2024-05-18 00:21:23] 2024-05-18 00:21:06,724 | INFO     | sum of square deviations: 1110539892.0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,725 | INFO     | sum of deviations: 99518596522.00002
[2024-05-18 00:21:23] 2024-05-18 00:21:06,725 | INFO     | mean x: 1715986670.0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,725 | INFO     | mean y: 2612359.0392156863
[2024-05-18 00:21:23] 2024-05-18 00:21:06,725 | INFO     | -- intersect: -153771769163.9078
[2024-05-18 00:21:23] 2024-05-18 00:21:06,725 | INFO     | intersect: -153771769163.9078
[2024-05-18 00:21:23] 2024-05-18 00:21:06,725 | INFO     | chi2: 4.90227331130245
[2024-05-18 00:21:23] 2024-05-18 00:21:06,726 | INFO     | current chi2=4.90227331130245 (change=13.248136159680499 %)
[2024-05-18 00:21:23] 2024-05-18 00:21:06,726 | INFO     | right removable region: 152
[2024-05-18 00:21:23] 2024-05-18 00:21:06,726 | INFO     | model: linear, x: [1715982339.0, 1715982400.0, 1715982461.0, 1715982522.0, 1715982583.0, 1715982644.0, 1715982705.0, 1715982766.0, 1715982827.0, 1715982888.0, 1715
[2024-05-18 00:21:23] 2024-05-18 00:21:06,726 | INFO     | sum of square deviations: 1110539892.0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,727 | INFO     | sum of deviations: 47053451965.0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,727 | INFO     | mean x: 1715986975.0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,727 | INFO     | mean y: 2662427.8758169934
[2024-05-18 00:21:23] 2024-05-18 00:21:06,727 | INFO     | -- intersect: -72703515245.14392
[2024-05-18 00:21:23] 2024-05-18 00:21:06,727 | INFO     | intersect: -72703515245.14392
[2024-05-18 00:21:23] 2024-05-18 00:21:06,728 | INFO     | chi2: 2.8509062850687776
[2024-05-18 00:21:23] 2024-05-18 00:21:06,728 | INFO     | current chi2=2.8509062850687776 (change=49.54964397974608 %)
[2024-05-18 00:21:23] 2024-05-18 00:21:06,728 | INFO     | model: linear, x: [1715982644.0, 1715982705.0, 1715982766.0, 1715982827.0, 1715982888.0, 1715982949.0, 1715983010.0, 1715983071.0, 1715983132.0, 1715983193.0, 1715
[2024-05-18 00:21:23] 2024-05-18 00:21:06,728 | INFO     | sum of square deviations: 1005179777.0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,729 | INFO     | sum of deviations: 10170029434.0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,729 | INFO     | mean x: 1715987127.5
[2024-05-18 00:21:23] 2024-05-18 00:21:06,729 | INFO     | mean y: 2715827.3243243243
[2024-05-18 00:21:23] 2024-05-18 00:21:06,729 | INFO     | -- intersect: -17358993982.561863
[2024-05-18 00:21:23] 2024-05-18 00:21:06,730 | INFO     | intersect: -17358993982.561863
[2024-05-18 00:21:23] 2024-05-18 00:21:06,730 | INFO     | chi2: 1.0889122986488369
[2024-05-18 00:21:23] 2024-05-18 00:21:06,730 | INFO     | current chi2=1.0889122986488369 (change=61.80469683090383 %)
[2024-05-18 00:21:23] 2024-05-18 00:21:06,730 | INFO     | model: linear, x: [1715982949.0, 1715983010.0, 1715983071.0, 1715983132.0, 1715983193.0, 1715983254.0, 1715983315.0, 1715983376.0, 1715983437.0, 1715983498.0, 1715
[2024-05-18 00:21:23] 2024-05-18 00:21:06,730 | INFO     | sum of square deviations: 906703512.0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,731 | INFO     | sum of deviations: -4153845873.999999
[2024-05-18 00:21:23] 2024-05-18 00:21:06,731 | INFO     | mean x: 1715987280.0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,731 | INFO     | mean y: 2737912.979020979
[2024-05-18 00:21:23] 2024-05-18 00:21:06,731 | INFO     | -- intersect: 7864124340.325826
[2024-05-18 00:21:23] 2024-05-18 00:21:06,732 | INFO     | intersect: 7864124340.325826
[2024-05-18 00:21:23] 2024-05-18 00:21:06,732 | INFO     | chi2: 0.8116989483224656
[2024-05-18 00:21:23] 2024-05-18 00:21:06,732 | INFO     | current chi2=0.8116989483224656 (change=25.457821595949277 %)
[2024-05-18 00:21:23] 2024-05-18 00:21:06,732 | INFO     | model: linear, x: [1715983254.0, 1715983315.0, 1715983376.0, 1715983437.0, 1715983498.0, 1715983559.0, 1715983620.0, 1715983681.0, 1715983742.0, 1715983803.0, 1715
[2024-05-18 00:21:23] 2024-05-18 00:21:06,732 | INFO     | sum of square deviations: 814878534.5
[2024-05-18 00:21:23] 2024-05-18 00:21:06,733 | INFO     | sum of deviations: -7121745425.0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,733 | INFO     | mean x: 1715987432.5
[2024-05-18 00:21:23] 2024-05-18 00:21:06,733 | INFO     | mean y: 2742730.782608696
[2024-05-18 00:21:23] 2024-05-18 00:21:06,733 | INFO     | -- intersect: 14999855956.084251
[2024-05-18 00:21:23] 2024-05-18 00:21:06,734 | INFO     | intersect: 14999855956.084251
[2024-05-18 00:21:23] 2024-05-18 00:21:06,734 | INFO     | chi2: 0.7745315898282277
[2024-05-18 00:21:23] 2024-05-18 00:21:06,734 | INFO     | current chi2=0.7745315898282277 (change=4.578958562291046 %)
[2024-05-18 00:21:23] 2024-05-18 00:21:06,734 | INFO     | left removable region: 40
[2024-05-18 00:21:23] 2024-05-18 00:21:06,734 | INFO     | model: linear, x: [1715984474.0, 1715984535.0, 1715984596.0, 1715984657.0, 1715984718.0, 1715984779.0, 1715984840.0, 1715984901.0, 1715984962.0, 1715985023.0, 1715
[2024-05-18 00:21:23] 2024-05-18 00:21:06,734 | INFO     | sum of square deviations: 435610028.0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,735 | INFO     | sum of deviations: 1668585277.0000002
[2024-05-18 00:21:23] 2024-05-18 00:21:06,735 | INFO     | mean x: 1715987859.5
[2024-05-18 00:21:23] 2024-05-18 00:21:06,735 | INFO     | mean y: 2762164.964285714
[2024-05-18 00:21:23] 2024-05-18 00:21:06,735 | INFO     | -- intersect: -6570254739.670528
[2024-05-18 00:21:23] 2024-05-18 00:21:06,735 | INFO     | intersect: -6570254739.670528
[2024-05-18 00:21:23] 2024-05-18 00:21:06,736 | INFO     | chi2: 0.0005361566666296354
[2024-05-18 00:21:23] 2024-05-18 00:21:06,736 | INFO     | -- intersect: -6570254739.670528
[2024-05-18 00:21:23] 2024-05-18 00:21:06,736 | INFO     | current memory leak: 3.83 B/s (using 112 data points, chi2=0.00)
[2024-05-18 00:21:23] 2024-05-18 00:21:06,736 | INFO     | ..............................
[2024-05-18 00:21:23] 2024-05-18 00:21:06,737 | INFO     | . Timing measurements:
[2024-05-18 00:21:23] 2024-05-18 00:21:06,737 | INFO     | . get job = 0 s
[2024-05-18 00:21:23] 2024-05-18 00:21:06,737 | INFO     | . initial setup = 1 s
[2024-05-18 00:21:23] 2024-05-18 00:21:06,737 | INFO     | . payload setup = 9 s
[2024-05-18 00:21:23] 2024-05-18 00:21:06,737 | INFO     | . stage-in = 0 s
[2024-05-18 00:21:23] 2024-05-18 00:21:06,737 | INFO     | . payload execution = 9626 s
[2024-05-18 00:21:23] 2024-05-18 00:21:06,737 | INFO     | . stage-out = 1 s
[2024-05-18 00:21:23] 2024-05-18 00:21:06,737 | INFO     | . log creation = 0 s
[2024-05-18 00:21:23] 2024-05-18 00:21:06,737 | INFO     | ..............................
[2024-05-18 00:21:23] 2024-05-18 00:21:06,877 | INFO     | 
[2024-05-18 00:21:23] 2024-05-18 00:21:06,877 | INFO     | job summary report
[2024-05-18 00:21:23] 2024-05-18 00:21:06,877 | INFO     | --------------------------------------------------
[2024-05-18 00:21:23] 2024-05-18 00:21:06,878 | INFO     | PanDA job id: 6207856482
[2024-05-18 00:21:23] 2024-05-18 00:21:06,878 | INFO     | task id: 38920987
[2024-05-18 00:21:23] 2024-05-18 00:21:06,878 | INFO     | errors: (none)
[2024-05-18 00:21:23] 2024-05-18 00:21:06,878 | INFO     | status: LOG_TRANSFER = DONE 
[2024-05-18 00:21:23] 2024-05-18 00:21:06,878 | INFO     | pilot state: finished 
[2024-05-18 00:21:23] 2024-05-18 00:21:06,878 | INFO     | transexitcode: 0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,878 | INFO     | exeerrorcode: 0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,878 | INFO     | exeerrordiag: 
[2024-05-18 00:21:23] 2024-05-18 00:21:06,878 | INFO     | exitcode: 0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,878 | INFO     | exitmsg: OK
[2024-05-18 00:21:23] 2024-05-18 00:21:06,878 | INFO     | cpuconsumptiontime: 101954 s
[2024-05-18 00:21:23] 2024-05-18 00:21:06,879 | INFO     | nevents: 400
[2024-05-18 00:21:23] 2024-05-18 00:21:06,879 | INFO     | neventsw: 0
[2024-05-18 00:21:23] 2024-05-18 00:21:06,879 | INFO     | pid: 2350939
[2024-05-18 00:21:23] 2024-05-18 00:21:06,879 | INFO     | pgrp: 2350939
[2024-05-18 00:21:23] 2024-05-18 00:21:06,879 | INFO     | corecount: 12
[2024-05-18 00:21:23] 2024-05-18 00:21:06,879 | INFO     | event service: False
[2024-05-18 00:21:23] 2024-05-18 00:21:06,879 | INFO     | sizes: {0: 2391904, 1: 2392103, 8: 2392309, 12: 2392337, 9639: 2420519, 9640: 2429659, 9648: 2429773}
[2024-05-18 00:21:23] 2024-05-18 00:21:06,879 | INFO     | --------------------------------------------------
[2024-05-18 00:21:23] 2024-05-18 00:21:06,879 | INFO     | 
[2024-05-18 00:21:23] 2024-05-18 00:21:06,879 | INFO     | executing command: ls -lF /home/boinc/slots/75
[2024-05-18 00:21:23] 2024-05-18 00:21:06,903 | INFO     | queue jobs had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,904 | INFO     | queue payloads had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,904 | INFO     | queue data_in had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,904 | INFO     | queue data_out had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,904 | INFO     | queue current_data_in had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,904 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,904 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,904 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,904 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,904 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,905 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,905 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,905 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,905 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,905 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,905 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,905 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,905 | INFO     | queue completed_jobids has 1 job(s)
[2024-05-18 00:21:23] 2024-05-18 00:21:06,905 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,906 | INFO     | queue messages had 0 job(s) [purged]
[2024-05-18 00:21:23] 2024-05-18 00:21:06,906 | INFO     | job 6207856482 has completed (purged errors)
[2024-05-18 00:21:23] 2024-05-18 00:21:06,906 | INFO     | overall cleanup function is called
[2024-05-18 00:21:23] 2024-05-18 00:21:07,913 | INFO     | --- collectZombieJob: --- 10, [2350939]
[2024-05-18 00:21:23] 2024-05-18 00:21:07,914 | INFO     | zombie collector waiting for pid 2350939
[2024-05-18 00:21:23] 2024-05-18 00:21:07,914 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2024-05-18 00:21:23] 2024-05-18 00:21:08,917 | INFO     | collected zombie processes
[2024-05-18 00:21:23] 2024-05-18 00:21:08,918 | INFO     | will now attempt to kill all subprocesses of pid=2350939
[2024-05-18 00:21:23] 2024-05-18 00:21:09,252 | INFO     | process IDs to be killed: [2350939] (in reverse order)
[2024-05-18 00:21:23] 2024-05-18 00:21:09,591 | WARNING  | found no corresponding commands to process id(s)
[2024-05-18 00:21:23] 2024-05-18 00:21:09,592 | INFO     | Do not look for orphan processes in BOINC jobs
[2024-05-18 00:21:23] 2024-05-18 00:21:09,642 | INFO     | did not find any defunct processes belonging to 2350939
[2024-05-18 00:21:23] 2024-05-18 00:21:09,675 | INFO     | did not find any defunct processes belonging to 2350939
[2024-05-18 00:21:23] 2024-05-18 00:21:09,676 | INFO     | ready for new job
[2024-05-18 00:21:23] 2024-05-18 00:21:09,676 | INFO     | pilot has finished with previous job - re-establishing logging
[2024-05-18 00:21:23] 2024-05-18 00:21:09,678 | INFO     | *************************************
[2024-05-18 00:21:23] 2024-05-18 00:21:09,678 | INFO     | ***  PanDA Pilot version 3.7.5.4  ***
[2024-05-18 00:21:23] 2024-05-18 00:21:09,678 | INFO     | *************************************
[2024-05-18 00:21:23] 2024-05-18 00:21:09,678 | INFO     | 
[2024-05-18 00:21:23] 2024-05-18 00:21:09,714 | INFO     | architecture information:
[2024-05-18 00:21:23] 2024-05-18 00:21:09,715 | INFO     | executing command: cat /etc/os-release
[2024-05-18 00:21:23] 2024-05-18 00:21:09,736 | INFO     | cat /etc/os-release:
[2024-05-18 00:21:23] NAME="CentOS Linux"
[2024-05-18 00:21:23] VERSION="7 (Core)"
[2024-05-18 00:21:23] ID="centos"
[2024-05-18 00:21:23] ID_LIKE="rhel fedora"
[2024-05-18 00:21:23] VERSION_ID="7"
[2024-05-18 00:21:23] PRETTY_NAME="CentOS Linux 7 (Core)"
[2024-05-18 00:21:23] ANSI_COLOR="0;31"
[2024-05-18 00:21:23] CPE_NAME="cpe:/o:centos:centos:7"
[2024-05-18 00:21:23] HOME_URL="https://www.centos.org/"
[2024-05-18 00:21:23] BUG_REPORT_URL="https://bugs.centos.org/"
[2024-05-18 00:21:23] 
[2024-05-18 00:21:23] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2024-05-18 00:21:23] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2024-05-18 00:21:23] REDHAT_SUPPORT_PRODUCT="centos"
[2024-05-18 00:21:23] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2024-05-18 00:21:23] 
[2024-05-18 00:21:23] 2024-05-18 00:21:09,736 | INFO     | *************************************
[2024-05-18 00:21:23] 2024-05-18 00:21:10,242 | INFO     | executing command: df -mP /home/boinc/slots/75
[2024-05-18 00:21:23] 2024-05-18 00:21:10,261 | INFO     | sufficient remaining disk space (1732454121472 B)
[2024-05-18 00:21:23] 2024-05-18 00:21:10,262 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2024-05-18 00:21:23] 2024-05-18 00:21:10,262 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2024-05-18 00:21:23] 2024-05-18 00:21:10,266 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2024-05-18 00:21:23] 2024-05-18 00:21:10,266 | INFO     | aborting loop
[2024-05-18 00:21:23] 2024-05-18 00:21:10,298 | INFO     | all payload control threads have been joined
[2024-05-18 00:21:23] 2024-05-18 00:21:10,331 | INFO     | found 0 job(s) in 20 queues
[2024-05-18 00:21:23] 2024-05-18 00:21:10,332 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2024-05-18 00:21:23] 2024-05-18 00:21:10,332 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2024-05-18 00:21:23] 2024-05-18 00:21:11,221 | INFO     | all data control threads have been joined
[2024-05-18 00:21:23] 2024-05-18 00:21:11,270 | INFO     | [job] retrieve thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:11,270 | INFO     | [job] job monitor thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:11,303 | INFO     | [payload] control thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:11,394 | INFO     | [job] create_data_payload thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:11,430 | INFO     | [payload] validate_pre thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:11,553 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2024-05-18 00:21:23] 2024-05-18 00:21:11,712 | INFO     | all job control threads have been joined
[2024-05-18 00:21:23] 2024-05-18 00:21:11,762 | INFO     | [payload] execute_payloads thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:11,858 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2024-05-18 00:21:23] 2024-05-18 00:21:11,890 | INFO     | [job] validate thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:11,998 | INFO     | [data] copytool_in thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:12,226 | INFO     | [data] control thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:12,554 | INFO     | [payload] failed_post thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:12,690 | INFO     | [payload] run_realtimelog thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:12,718 | INFO     | [job] control thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:12,802 | INFO     | [payload] validate_post thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:12,862 | INFO     | [job] queue monitor thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:13,558 | INFO     | [data] copytool_out thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:13,648 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2024-05-18 00:21:23] 2024-05-18 00:21:17,654 | INFO     | [data] queue_monitor thread has finished
[2024-05-18 00:21:23] 2024-05-18 00:21:17,666 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140528053503808)>', '<ExcThread(monitor, started 140527630542592)>']
[2024-05-18 00:21:23] 2024-05-18 00:21:18,381 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2024-05-18 00:21:23] 2024-05-18 00:21:18,382 | INFO     | [monitor] control thread has ended
[2024-05-18 00:21:23] 2024-05-18 00:21:22,691 | INFO     | all workflow threads have been joined
[2024-05-18 00:21:23] 2024-05-18 00:21:22,691 | INFO     | end of generic workflow (traces error code: 0)
[2024-05-18 00:21:23] 2024-05-18 00:21:22,692 | INFO     | traces error code: 0
[2024-05-18 00:21:23] 2024-05-18 00:21:22,692 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2024-05-18 00:21:23] 2024-05-18 00:21:22,852 [wrapper] ==== pilot stdout END ====
[2024-05-18 00:21:23] 2024-05-18 00:21:22,855 [wrapper] ==== wrapper stdout RESUME ====
[2024-05-18 00:21:23] 2024-05-18 00:21:22,860 [wrapper] pilotpid: 2339350
[2024-05-18 00:21:23] 2024-05-18 00:21:22,862 [wrapper] Pilot exit status: 0
[2024-05-18 00:21:23] 2024-05-18 00:21:22,873 [wrapper] pandaids: 6207856482
[2024-05-18 00:21:23] 2024-05-18 00:21:22,987 [wrapper] cleanup: SIGTERM to supervisor_pilot 3776375 2339351
[2024-05-18 00:21:23] 2024-05-18 00:21:22,990 [wrapper] Test setup, not cleaning
[2024-05-18 00:21:23] 2024-05-18 00:21:22,993 [wrapper] ==== wrapper stdout END ====
[2024-05-18 00:21:23] 2024-05-18 00:21:22,996 [wrapper] ==== wrapper stderr END ====
[2024-05-18 00:21:23] 2024-05-18 00:21:23,010 [wrapper] apfmon messages muted
[2024-05-18 00:21:23]  *** Error codes and diagnostics ***
[2024-05-18 00:21:23]     "exeErrorCode": 0,
[2024-05-18 00:21:23]     "exeErrorDiag": "",
[2024-05-18 00:21:23]     "pilotErrorCode": 0,
[2024-05-18 00:21:23]     "pilotErrorDiag": "",
[2024-05-18 00:21:23]  *** Listing of results directory ***
[2024-05-18 00:21:23] total 963464
[2024-05-18 00:21:23] -rw-r--r-- 1 boinc boinc    467845 May 17 08:13 pilot3.tar.gz
[2024-05-18 00:21:23] -rwx------ 1 boinc boinc     32251 May 17 08:23 runpilot2-wrapper.sh
[2024-05-18 00:21:23] -rw-r--r-- 1 boinc boinc      5633 May 17 08:23 queuedata.json
[2024-05-18 00:21:23] -rw-r--r-- 1 boinc boinc       100 May 17 21:39 wrapper_26015_x86_64-pc-linux-gnu
[2024-05-18 00:21:23] -rwxr-xr-x 1 boinc boinc      7986 May 17 21:39 run_atlas
[2024-05-18 00:21:23] -rw-r--r-- 1 boinc boinc       105 May 17 21:39 job.xml
[2024-05-18 00:21:23] -rw-r--r-- 2 boinc boinc     17537 May 17 21:39 start_atlas.sh
[2024-05-18 00:21:23] drwxrwx--x 2 boinc boinc      4096 May 17 21:39 shared
[2024-05-18 00:21:23] -rw-r--r-- 2 boinc boinc    480002 May 17 21:39 input.tar.gz
[2024-05-18 00:21:23] -rw-r--r-- 2 boinc boinc 640673205 May 17 21:39 EVNT.38776170._000129.pool.root.1
[2024-05-18 00:21:23] -rw-r--r-- 1 boinc boinc         0 May 17 21:39 boinc_lockfile
[2024-05-18 00:21:23] -rw-r--r-- 1 boinc boinc      2616 May 17 21:39 pandaJob.out
[2024-05-18 00:21:23] -rw------- 1 boinc boinc       424 May 17 21:39 setup.sh.local
[2024-05-18 00:21:23] -rw------- 1 boinc boinc   1019089 May 17 21:39 agis_schedconf.cvmfs.json
[2024-05-18 00:21:23] -rw------- 1 boinc boinc         0 May 17 21:39 agis_ddmendpoints.agis.ALL.json
[2024-05-18 00:21:23] -rw------- 1 boinc boinc   1324701 May 17 21:39 cric_ddmendpoints.json
[2024-05-18 00:21:23] drwx------ 4 boinc boinc      4096 May 17 21:40 pilot3
[2024-05-18 00:21:23] -rw-r--r-- 1 boinc boinc      9902 May 18 00:16 init_data.xml
[2024-05-18 00:21:23] -rw------- 1 boinc boinc 339647232 May 18 00:20 HITS.38920987._003383.pool.root.1
[2024-05-18 00:21:23] -rw-r--r-- 1 boinc boinc       531 May 18 00:20 boinc_task_state.xml
[2024-05-18 00:21:23] -rw------- 1 boinc boinc        95 May 18 00:20 pilot_heartbeat.json
[2024-05-18 00:21:23] -rw------- 1 boinc boinc      1021 May 18 00:20 memory_monitor_summary.json
[2024-05-18 00:21:23] -rw------- 1 boinc boinc    412559 May 18 00:20 log.38920987._003383.job.log.tgz.1
[2024-05-18 00:21:23] -rw------- 1 boinc boinc      7645 May 18 00:21 heartbeat.json
[2024-05-18 00:21:23] -rw-r--r-- 1 boinc boinc      8192 May 18 00:21 boinc_mmap_file
[2024-05-18 00:21:23] -rw-r--r-- 1 boinc boinc        28 May 18 00:21 wrapper_checkpoint.txt
[2024-05-18 00:21:23] -rw------- 1 boinc boinc      4211 May 18 00:21 pilotlog.txt
[2024-05-18 00:21:23] -rw------- 1 boinc boinc    952645 May 18 00:21 log.38920987._003383.job.log.1
[2024-05-18 00:21:23] -rw------- 1 boinc boinc       357 May 18 00:21 output.list
[2024-05-18 00:21:23] -rw-r--r-- 1 boinc boinc       620 May 18 00:21 runtime_log
[2024-05-18 00:21:23] -rw------- 1 boinc boinc   1382400 May 18 00:21 result.tar.gz
[2024-05-18 00:21:23] -rw-r--r-- 1 boinc boinc     10918 May 18 00:21 runtime_log.err
[2024-05-18 00:21:23] -rw------- 1 boinc boinc       635 May 18 00:21 XZjMDmV37R5nsSi4apGgGQJmABFKDmABFKDm4ySLDmbmQKDmgTJ6Wn.diag
[2024-05-18 00:21:23] -rw-r--r-- 1 boinc boinc     21200 May 18 00:21 stderr.txt
[2024-05-18 00:21:23] HITS file was successfully produced:
[2024-05-18 00:21:23] -rw------- 1 boinc boinc 339647232 May 18 00:20 shared/HITS.pool.root.1
[2024-05-18 00:21:23]  *** Contents of shared directory: ***
[2024-05-18 00:21:23] total 959200
[2024-05-18 00:21:23] -rw-r--r-- 2 boinc boinc     17537 May 17 21:39 start_atlas.sh
[2024-05-18 00:21:23] -rw-r--r-- 2 boinc boinc    480002 May 17 21:39 input.tar.gz
[2024-05-18 00:21:23] -rw-r--r-- 2 boinc boinc 640673205 May 17 21:39 ATLAS.root_0
[2024-05-18 00:21:23] -rw------- 1 boinc boinc 339647232 May 18 00:20 HITS.pool.root.1
[2024-05-18 00:21:23] -rw------- 1 boinc boinc   1382400 May 18 00:21 result.tar.gz
00:21:24 (2332363): run_atlas exited; CPU time 101671.852999
00:21:24 (2332363): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN