Name 2fnLDmzX1d5n9Rq4apOajLDm4fhM0noT9bVo2ijZDmPXWKDmz1snsn_0
Workunit 223654219
Created 19 Jun 2024, 3:52:43 UTC
Sent 19 Jun 2024, 10:17:45 UTC
Report deadline 27 Jun 2024, 10:17:45 UTC
Received 20 Jun 2024, 5:49:23 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10628444
Run time 19 hours 15 min 43 sec
CPU time 1 days 3 hours 49 min 17 sec
Validate state Valid
Credit 5,495.69
Device peak FLOPS 39.54 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.54 GB
Peak swap size 25.33 GB
Peak disk usage 1.54 GB

Stderr output

<core_client_version>7.7.0</core_client_version>
<![CDATA[
<stderr_txt>
06:18:42 (4186008): wrapper (7.7.26015): starting
06:18:42 (4186008): wrapper: running run_atlas (--nthreads 8)
[2024-06-19 06:18:42] Arguments: --nthreads 8
[2024-06-19 06:18:42] Threads: 8
[2024-06-19 06:18:42] Checking for CVMFS
[2024-06-19 06:18:43] Probing /cvmfs/atlas.cern.ch... OK
[2024-06-19 06:18:44] Probing /cvmfs/atlas-condb.cern.ch... OK
[2024-06-19 06:18:44] Running cvmfs_config stat atlas.cern.ch
[2024-06-19 06:18:45] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2024-06-19 06:18:45] 2.11.2.0 2197843 9403 78324 134049 1 8 11470883 18432001 3657 130560 0 30064320 99.982 2227320 30163 http://cvmfs-s1fnal.opensciencegrid.org:8000/cvmfs/atlas.cern.ch http://192.41.231.237:6081 1
[2024-06-19 06:18:45] CVMFS is ok
[2024-06-19 06:18:45] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-06-19 06:18:45] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-06-19 06:18:45] Further information can be found at the LHC@home message board.
[2024-06-19 06:18:45] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-06-19 06:18:45] Checking for apptainer binary...
[2024-06-19 06:18:45] Using apptainer found in PATH at /usr/bin/apptainer
[2024-06-19 06:18:45] Running /usr/bin/apptainer --version
[2024-06-19 06:18:45] apptainer version 1.2.4-1.el7
[2024-06-19 06:18:45] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-06-19 06:18:46] gc-9-36.aglt2.org
[2024-06-19 06:18:46] apptainer works
[2024-06-19 06:18:46] Set ATHENA_PROC_NUMBER=8
[2024-06-19 06:18:46] Set ATHENA_CORE_NUMBER=8
[2024-06-19 06:18:46] Starting ATLAS job with PandaID=6237350824
[2024-06-19 06:18:46] Running command: /usr/bin/apptainer exec -B /cvmfs,/data/boinchome/slots/2 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2024-06-20 01:34:22]  *** The last 200 lines of the pilot log: ***
[2024-06-20 01:34:23] 2024-06-20 05:33:57,439 | WARNING  | format EVNTtoHITS has no such key: dbData
[2024-06-20 01:34:23] 2024-06-20 05:33:57,440 | WARNING  | format EVNTtoHITS has no such key: dbTime
[2024-06-20 01:34:23] 2024-06-20 05:33:57,468 | INFO     | fitting pss+swap vs Time
[2024-06-20 01:34:23] 2024-06-20 05:33:57,473 | INFO     | model: linear, x: [1718792567.0, 1718792628.0, 1718792689.0, 1718792750.0, 1718792811.0, 1718792872.0, 1718792933.0, 1718792994.0, 1718793055.0, 1718793116.0, 1718
[2024-06-20 01:34:23] 2024-06-20 05:33:57,473 | INFO     | sum of square deviations: 449795285302.6744
[2024-06-20 01:34:23] 2024-06-20 05:33:57,531 | INFO     | sum of deviations: 326537953469.23615
[2024-06-20 01:34:23] 2024-06-20 05:33:57,531 | INFO     | mean x: 1718827063.2977033
[2024-06-20 01:34:23] 2024-06-20 05:33:57,531 | INFO     | mean y: 2538989.0141342757
[2024-06-20 01:34:23] 2024-06-20 05:33:57,531 | INFO     | -- intersect: -1245278162.3797204
[2024-06-20 01:34:23] 2024-06-20 05:33:57,531 | INFO     | intersect: -1245278162.3797204
[2024-06-20 01:34:23] 2024-06-20 05:33:57,532 | INFO     | chi2: 8.66169510186315
[2024-06-20 01:34:23] 2024-06-20 05:33:57,533 | INFO     | model: linear, x: [1718792567.0, 1718792628.0, 1718792689.0, 1718792750.0, 1718792811.0, 1718792872.0, 1718792933.0, 1718792994.0, 1718793055.0, 1718793116.0, 1718
[2024-06-20 01:34:23] 2024-06-20 05:33:57,534 | INFO     | sum of square deviations: 443861557270.08057
[2024-06-20 01:34:23] 2024-06-20 05:33:57,599 | INFO     | sum of deviations: 716761572789.0923
[2024-06-20 01:34:23] 2024-06-20 05:33:57,599 | INFO     | mean x: 1718826910.800355
[2024-06-20 01:34:23] 2024-06-20 05:33:57,599 | INFO     | mean y: 2549018.267080745
[2024-06-20 01:34:23] 2024-06-20 05:33:57,599 | INFO     | -- intersect: -2773066620.795438
[2024-06-20 01:34:23] 2024-06-20 05:33:57,599 | INFO     | intersect: -2773066620.795438
[2024-06-20 01:34:23] 2024-06-20 05:33:57,606 | INFO     | chi2: 4.685299625919458
[2024-06-20 01:34:23] 2024-06-20 05:33:57,607 | INFO     | current chi2=4.685299625919458 (change=45.90782091935285 %)
[2024-06-20 01:34:23] 2024-06-20 05:33:57,607 | INFO     | model: linear, x: [1718792567.0, 1718792628.0, 1718792689.0, 1718792750.0, 1718792811.0, 1718792872.0, 1718792933.0, 1718792994.0, 1718793055.0, 1718793116.0, 1718
[2024-06-20 01:34:23] 2024-06-20 05:33:57,608 | INFO     | sum of square deviations: 437980248702.96954
[2024-06-20 01:34:23] 2024-06-20 05:33:57,747 | INFO     | sum of deviations: 713391961720.364
[2024-06-20 01:34:23] 2024-06-20 05:33:57,750 | INFO     | mean x: 1718826758.3030303
[2024-06-20 01:34:23] 2024-06-20 05:33:57,750 | INFO     | mean y: 2548930.893048128
[2024-06-20 01:34:23] 2024-06-20 05:33:57,750 | INFO     | -- intersect: -2797114288.1550736
[2024-06-20 01:34:23] 2024-06-20 05:33:57,750 | INFO     | intersect: -2797114288.1550736
[2024-06-20 01:34:23] 2024-06-20 05:33:57,751 | INFO     | chi2: 4.685416470470644
[2024-06-20 01:34:23] 2024-06-20 05:33:57,752 | INFO     | current chi2=4.685416470470644 (change=-0.0024938544066480605 %)
[2024-06-20 01:34:23] 2024-06-20 05:33:57,752 | INFO     | right removable region: 1121
[2024-06-20 01:34:23] 2024-06-20 05:33:57,752 | INFO     | model: linear, x: [1718792872.0, 1718792933.0, 1718792994.0, 1718793055.0, 1718793116.0, 1718793177.0, 1718793238.0, 1718793299.0, 1718793360.0, 1718793421.0, 1718
[2024-06-20 01:34:23] 2024-06-20 05:33:57,753 | INFO     | sum of square deviations: 443861075369.4784
[2024-06-20 01:34:23] 2024-06-20 05:33:57,822 | INFO     | sum of deviations: -14538334874.949844
[2024-06-20 01:34:23] 2024-06-20 05:33:57,822 | INFO     | mean x: 1718827215.8012424
[2024-06-20 01:34:23] 2024-06-20 05:33:57,822 | INFO     | mean y: 2547750.250221828
[2024-06-20 01:34:23] 2024-06-20 05:33:57,822 | INFO     | -- intersect: 58846639.79509782
[2024-06-20 01:34:23] 2024-06-20 05:33:57,822 | INFO     | intersect: 58846639.79509782
[2024-06-20 01:34:23] 2024-06-20 05:33:57,823 | INFO     | chi2: 5.5020573232518615
[2024-06-20 01:34:23] 2024-06-20 05:33:57,823 | INFO     | current chi2=5.5020573232518615 (change=36.4782844634146 %)
[2024-06-20 01:34:23] 2024-06-20 05:33:57,828 | INFO     | model: linear, x: [1718793177.0, 1718793238.0, 1718793299.0, 1718793360.0, 1718793421.0, 1718793482.0, 1718793543.0, 1718793604.0, 1718793665.0, 1718793726.0, 1718
[2024-06-20 01:34:23] 2024-06-20 05:33:57,829 | INFO     | sum of square deviations: 437979285023.75446
[2024-06-20 01:34:23] 2024-06-20 05:33:57,872 | INFO     | sum of deviations: -233286614839.24585
[2024-06-20 01:34:23] 2024-06-20 05:33:57,872 | INFO     | mean x: 1718827368.304813
[2024-06-20 01:34:23] 2024-06-20 05:33:57,872 | INFO     | mean y: 2553419.971479501
[2024-06-20 01:34:23] 2024-06-20 05:33:57,873 | INFO     | -- intersect: 918074842.9153335
[2024-06-20 01:34:23] 2024-06-20 05:33:57,873 | INFO     | intersect: 918074842.9153335
[2024-06-20 01:34:23] 2024-06-20 05:33:57,874 | INFO     | chi2: 4.230110343689344
[2024-06-20 01:34:23] 2024-06-20 05:33:57,874 | INFO     | current chi2=4.230110343689344 (change=23.11766135527579 %)
[2024-06-20 01:34:23] 2024-06-20 05:33:57,874 | INFO     | left removable region: 20
[2024-06-20 01:34:23] 2024-06-20 05:33:57,875 | INFO     | model: linear, x: [1718793787.0, 1718793849.0, 1718793909.0, 1718793970.0, 1718794031.0, 1718794092.0, 1718794153.0, 1718794214.0, 1718794275.0, 1718794336.0, 1718
[2024-06-20 01:34:23] 2024-06-20 05:33:57,875 | INFO     | sum of square deviations: 413843880714.9396
[2024-06-20 01:34:23] 2024-06-20 05:33:57,902 | INFO     | sum of deviations: 41980951789.032684
[2024-06-20 01:34:23] 2024-06-20 05:33:57,902 | INFO     | mean x: 1718827337.8165305
[2024-06-20 01:34:23] 2024-06-20 05:33:57,902 | INFO     | mean y: 2566601.2179836514
[2024-06-20 01:34:23] 2024-06-20 05:33:57,902 | INFO     | -- intersect: -171793854.41540632
[2024-06-20 01:34:23] 2024-06-20 05:33:57,903 | INFO     | intersect: -171793854.41540632
[2024-06-20 01:34:23] 2024-06-20 05:33:57,904 | INFO     | chi2: 0.017403223578775072
[2024-06-20 01:34:23] 2024-06-20 05:33:57,904 | INFO     | -- intersect: -171793854.41540632
[2024-06-20 01:34:23] 2024-06-20 05:33:57,904 | INFO     | current memory leak: 0.10 B/s (using 1101 data points, chi2=0.02)
[2024-06-20 01:34:23] 2024-06-20 05:33:57,905 | INFO     | ..............................
[2024-06-20 01:34:23] 2024-06-20 05:33:57,905 | INFO     | . Timing measurements:
[2024-06-20 01:34:23] 2024-06-20 05:33:57,905 | INFO     | . get job = 1 s
[2024-06-20 01:34:23] 2024-06-20 05:33:57,905 | INFO     | . initial setup = 10 s
[2024-06-20 01:34:23] 2024-06-20 05:33:57,905 | INFO     | . payload setup = 52 s
[2024-06-20 01:34:23] 2024-06-20 05:33:57,905 | INFO     | . stage-in = 0 s
[2024-06-20 01:34:23] 2024-06-20 05:33:57,905 | INFO     | . payload execution = 69034 s
[2024-06-20 01:34:23] 2024-06-20 05:33:57,905 | INFO     | . stage-out = 7 s
[2024-06-20 01:34:23] 2024-06-20 05:33:57,906 | INFO     | . log creation = 1 s
[2024-06-20 01:34:23] 2024-06-20 05:33:57,906 | INFO     | ..............................
[2024-06-20 01:34:23] 2024-06-20 05:33:58,328 | INFO     | 
[2024-06-20 01:34:23] 2024-06-20 05:33:58,328 | INFO     | job summary report
[2024-06-20 01:34:23] 2024-06-20 05:33:58,328 | INFO     | --------------------------------------------------
[2024-06-20 01:34:23] 2024-06-20 05:33:58,328 | INFO     | PanDA job id: 6237350824
[2024-06-20 01:34:23] 2024-06-20 05:33:58,328 | INFO     | task id: 38920995
[2024-06-20 01:34:23] 2024-06-20 05:33:58,328 | INFO     | errors: (none)
[2024-06-20 01:34:23] 2024-06-20 05:33:58,328 | INFO     | status: LOG_TRANSFER = DONE 
[2024-06-20 01:34:23] 2024-06-20 05:33:58,328 | INFO     | pilot state: finished 
[2024-06-20 01:34:23] 2024-06-20 05:33:58,328 | INFO     | transexitcode: 0
[2024-06-20 01:34:23] 2024-06-20 05:33:58,328 | INFO     | exeerrorcode: 0
[2024-06-20 01:34:23] 2024-06-20 05:33:58,328 | INFO     | exeerrordiag: 
[2024-06-20 01:34:23] 2024-06-20 05:33:58,328 | INFO     | exitcode: 0
[2024-06-20 01:34:23] 2024-06-20 05:33:58,329 | INFO     | exitmsg: OK
[2024-06-20 01:34:23] 2024-06-20 05:33:58,329 | INFO     | cpuconsumptiontime: 100578 s
[2024-06-20 01:34:23] 2024-06-20 05:33:58,329 | INFO     | nevents: 400
[2024-06-20 01:34:23] 2024-06-20 05:33:58,329 | INFO     | neventsw: 0
[2024-06-20 01:34:23] 2024-06-20 05:33:58,329 | INFO     | pid: 14028
[2024-06-20 01:34:23] 2024-06-20 05:33:58,329 | INFO     | pgrp: 14028
[2024-06-20 01:34:23] 2024-06-20 05:33:58,329 | INFO     | corecount: 8
[2024-06-20 01:34:23] 2024-06-20 05:33:58,329 | INFO     | event service: False
[2024-06-20 01:34:23] 2024-06-20 05:33:58,329 | INFO     | sizes: {0: 2380942, 1: 2381141, 12: 2381141, 23: 2381169, 31: 2381403, 34: 2381431, 69091: 2437354, 69099: 2446316, 69101: 2446372, 69157: 2446542}
[2024-06-20 01:34:23] 2024-06-20 05:33:58,329 | INFO     | --------------------------------------------------
[2024-06-20 01:34:23] 2024-06-20 05:33:58,329 | INFO     | 
[2024-06-20 01:34:23] 2024-06-20 05:33:58,329 | INFO     | executing command: ls -lF /data/boinchome/slots/2
[2024-06-20 01:34:23] 2024-06-20 05:33:59,545 | INFO     | queue jobs had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue payloads had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue data_in had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue data_out had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue current_data_in had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,546 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,547 | INFO     | queue completed_jobids has 1 job(s)
[2024-06-20 01:34:23] 2024-06-20 05:33:59,547 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,547 | INFO     | queue messages had 0 job(s) [purged]
[2024-06-20 01:34:23] 2024-06-20 05:33:59,547 | INFO     | job 6237350824 has completed (purged errors)
[2024-06-20 01:34:23] 2024-06-20 05:33:59,547 | INFO     | overall cleanup function is called
[2024-06-20 01:34:23] 2024-06-20 05:34:00,558 | INFO     | --- collectZombieJob: --- 10, [14028]
[2024-06-20 01:34:23] 2024-06-20 05:34:00,558 | INFO     | zombie collector waiting for pid 14028
[2024-06-20 01:34:23] 2024-06-20 05:34:00,558 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2024-06-20 01:34:23] 2024-06-20 05:34:01,617 | INFO     | collected zombie processes
[2024-06-20 01:34:23] 2024-06-20 05:34:01,639 | INFO     | will now attempt to kill all subprocesses of pid=14028
[2024-06-20 01:34:23] 2024-06-20 05:34:02,919 | INFO     | process IDs to be killed: [14028] (in reverse order)
[2024-06-20 01:34:23] 2024-06-20 05:34:04,248 | WARNING  | found no corresponding commands to process id(s)
[2024-06-20 01:34:23] 2024-06-20 05:34:04,248 | INFO     | Do not look for orphan processes in BOINC jobs
[2024-06-20 01:34:23] 2024-06-20 05:34:04,350 | INFO     | did not find any defunct processes belonging to 14028
[2024-06-20 01:34:23] 2024-06-20 05:34:04,460 | INFO     | did not find any defunct processes belonging to 14028
[2024-06-20 01:34:23] 2024-06-20 05:34:04,461 | INFO     | ready for new job
[2024-06-20 01:34:23] 2024-06-20 05:34:04,461 | INFO     | pilot has finished with previous job - re-establishing logging
[2024-06-20 01:34:23] 2024-06-20 05:34:04,511 | INFO     | *************************************
[2024-06-20 01:34:23] 2024-06-20 05:34:04,512 | INFO     | ***  PanDA Pilot version 3.7.7.3  ***
[2024-06-20 01:34:23] 2024-06-20 05:34:04,512 | INFO     | *************************************
[2024-06-20 01:34:23] 2024-06-20 05:34:04,512 | INFO     | 
[2024-06-20 01:34:23] 2024-06-20 05:34:04,564 | INFO     | architecture information:
[2024-06-20 01:34:23] 2024-06-20 05:34:04,604 | INFO     | executing command: cat /etc/os-release
[2024-06-20 01:34:23] 2024-06-20 05:34:04,721 | INFO     | cat /etc/os-release:
[2024-06-20 01:34:23] NAME="CentOS Linux"
[2024-06-20 01:34:23] VERSION="7 (Core)"
[2024-06-20 01:34:23] ID="centos"
[2024-06-20 01:34:23] ID_LIKE="rhel fedora"
[2024-06-20 01:34:23] VERSION_ID="7"
[2024-06-20 01:34:23] PRETTY_NAME="CentOS Linux 7 (Core)"
[2024-06-20 01:34:23] ANSI_COLOR="0;31"
[2024-06-20 01:34:23] CPE_NAME="cpe:/o:centos:centos:7"
[2024-06-20 01:34:23] HOME_URL="https://www.centos.org/"
[2024-06-20 01:34:23] BUG_REPORT_URL="https://bugs.centos.org/"
[2024-06-20 01:34:23] 
[2024-06-20 01:34:23] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2024-06-20 01:34:23] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2024-06-20 01:34:23] REDHAT_SUPPORT_PRODUCT="centos"
[2024-06-20 01:34:23] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2024-06-20 01:34:23] 
[2024-06-20 01:34:23] 2024-06-20 05:34:04,721 | INFO     | *************************************
[2024-06-20 01:34:23] 2024-06-20 05:34:05,224 | INFO     | executing command: df -mP /data/boinchome/slots/2
[2024-06-20 01:34:23] 2024-06-20 05:34:05,415 | INFO     | sufficient remaining disk space (905801891840 B)
[2024-06-20 01:34:23] 2024-06-20 05:34:05,415 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2024-06-20 01:34:23] 2024-06-20 05:34:05,415 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2024-06-20 01:34:23] 2024-06-20 05:34:05,415 | WARNING  | aborting monitor loop since graceful_stop has been set (timing out remaining threads)
[2024-06-20 01:34:23] 2024-06-20 05:34:05,416 | INFO     | found 0 job(s) in 20 queues
[2024-06-20 01:34:23] 2024-06-20 05:34:05,416 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2024-06-20 01:34:23] 2024-06-20 05:34:05,416 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2024-06-20 01:34:23] 2024-06-20 05:34:05,416 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2024-06-20 01:34:23] 2024-06-20 05:34:05,416 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2024-06-20 01:34:23] 2024-06-20 05:34:05,416 | INFO     | aborting loop
[2024-06-20 01:34:23] 2024-06-20 05:34:06,143 | INFO     | all data control threads have been joined
[2024-06-20 01:34:23] 2024-06-20 05:34:06,216 | INFO     | all job control threads have been joined
[2024-06-20 01:34:23] 2024-06-20 05:34:06,421 | INFO     | [job] retrieve thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:06,421 | INFO     | [job] job monitor thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:06,466 | INFO     | [payload] failed_post thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:06,688 | INFO     | [payload] execute_payloads thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:06,703 | INFO     | [job] validate thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:06,709 | INFO     | [job] create_data_payload thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:06,710 | INFO     | [payload] validate_pre thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:06,721 | INFO     | [data] copytool_in thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:06,969 | INFO     | all payload control threads have been joined
[2024-06-20 01:34:23] 2024-06-20 05:34:07,076 | INFO     | [payload] validate_post thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:07,150 | INFO     | [data] control thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:07,224 | INFO     | [job] control thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:07,425 | INFO     | [data] copytool_out thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:07,719 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2024-06-20 01:34:23] 2024-06-20 05:34:07,747 | INFO     | [payload] run_realtimelog thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:07,976 | INFO     | [payload] control thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:08,713 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2024-06-20 01:34:23] 2024-06-20 05:34:08,732 | INFO     | [job] queue monitor thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:12,724 | INFO     | [data] queue_monitor thread has finished
[2024-06-20 01:34:23] 2024-06-20 05:34:13,933 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139952907220800)>', '<ExcThread(monitor, started 139952599832320)>']
[2024-06-20 01:34:23] 2024-06-20 05:34:14,475 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2024-06-20 01:34:23] 2024-06-20 05:34:14,475 | INFO     | [monitor] control thread has ended
[2024-06-20 01:34:23] 2024-06-20 05:34:18,960 | INFO     | all workflow threads have been joined
[2024-06-20 01:34:23] 2024-06-20 05:34:18,960 | INFO     | end of generic workflow (traces error code: 0)
[2024-06-20 01:34:23] 2024-06-20 05:34:18,960 | INFO     | traces error code: 0
[2024-06-20 01:34:23] 2024-06-20 05:34:18,961 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2024-06-20 01:34:23] 2024-06-20 05:34:19,686 [wrapper] ==== pilot stdout END ====
[2024-06-20 01:34:23] 2024-06-20 05:34:19,717 [wrapper] ==== wrapper stdout RESUME ====
[2024-06-20 01:34:23] 2024-06-20 05:34:19,747 [wrapper] pilotpid: 4192932
[2024-06-20 01:34:23] 2024-06-20 05:34:19,793 [wrapper] Pilot exit status: 0
[2024-06-20 01:34:23] 2024-06-20 05:34:20,222 [wrapper] pandaids: 6237350824
[2024-06-20 01:34:23] 2024-06-20 05:34:20,581 [wrapper] cleanup supervisor_pilot  134935 4192933
[2024-06-20 01:34:23] 2024-06-20 05:34:20,679 [wrapper] Test setup, not cleaning
[2024-06-20 01:34:23] 2024-06-20 05:34:20,708 [wrapper] ==== wrapper stdout END ====
[2024-06-20 01:34:23] 2024-06-20 05:34:20,745 [wrapper] ==== wrapper stderr END ====
[2024-06-20 01:34:23] 2024-06-20 05:34:20,834 [wrapper] apfmon messages muted
[2024-06-20 01:34:23]  *** Error codes and diagnostics ***
[2024-06-20 01:34:23]     "exeErrorCode": 0,
[2024-06-20 01:34:23]     "exeErrorDiag": "",
[2024-06-20 01:34:23]     "pilotErrorCode": 0,
[2024-06-20 01:34:23]     "pilotErrorDiag": "",
[2024-06-20 01:34:23]  *** Listing of results directory ***
[2024-06-20 01:34:23] total 988784
[2024-06-20 01:34:23] -rwx------ 1 boincer umatlas     32308 Jun 18 23:52 runpilot2-wrapper.sh
[2024-06-20 01:34:23] -rw-r--r-- 1 boincer umatlas      5654 Jun 18 23:52 queuedata.json
[2024-06-20 01:34:23] -rw-r--r-- 1 boincer umatlas    469766 Jun 18 23:52 pilot3.tar.gz
[2024-06-20 01:34:23] -rw-r--r-- 1 boincer umatlas       100 Jun 19 06:18 wrapper_26015_x86_64-pc-linux-gnu
[2024-06-20 01:34:23] -rwxr-xr-x 1 boincer umatlas      7986 Jun 19 06:18 run_atlas
[2024-06-20 01:34:23] -rw-r--r-- 1 boincer umatlas       105 Jun 19 06:18 job.xml
[2024-06-20 01:34:23] -rw-r--r-- 2 boincer umatlas 636398037 Jun 19 06:18 EVNT.38776180._000466.pool.root.1
[2024-06-20 01:34:23] -rw-r--r-- 2 boincer umatlas     17537 Jun 19 06:18 start_atlas.sh
[2024-06-20 01:34:23] drwxrwx--x 2 boincer umatlas      4096 Jun 19 06:18 shared
[2024-06-20 01:34:23] -rw-r--r-- 2 boincer umatlas    482515 Jun 19 06:18 input.tar.gz
[2024-06-20 01:34:23] -rw-r--r-- 1 boincer umatlas         0 Jun 19 06:18 boinc_lockfile
[2024-06-20 01:34:23] -rw-r--r-- 1 boincer umatlas      2612 Jun 19 06:18 pandaJob.out
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas       461 Jun 19 06:18 setup.sh.local
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas   1012157 Jun 19 06:20 agis_schedconf.cvmfs.json
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas   1317838 Jun 19 06:20 cric_ddmendpoints.json
[2024-06-20 01:34:23] drwx------ 4 boincer umatlas      4096 Jun 19 06:20 pilot3
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas 351638921 Jun 20 01:28 HITS.38920995._056139.pool.root.1
[2024-06-20 01:34:23] -rw-r--r-- 1 boincer umatlas       533 Jun 20 01:28 boinc_task_state.xml
[2024-06-20 01:34:23] -rw-r--r-- 1 boincer umatlas      9221 Jun 20 01:32 init_data.xml
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas      1066 Jun 20 01:32 memory_monitor_summary.json
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas         0 Jun 20 01:32 agis_ddmendpoints.agis.ALL.json
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas   1070501 Jun 20 01:32 log.38920995._056139.job.log.tgz.1
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas        95 Jun 20 01:33 pilot_heartbeat.json
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas      7778 Jun 20 01:33 heartbeat.json
[2024-06-20 01:34:23] -rw-r--r-- 1 boincer umatlas      8192 Jun 20 01:34 boinc_mmap_file
[2024-06-20 01:34:23] -rw-r--r-- 1 boincer umatlas        29 Jun 20 01:34 wrapper_checkpoint.txt
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas      4336 Jun 20 01:34 pilotlog.txt
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas   9401976 Jun 20 01:34 log.38920995._056139.job.log.1
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas       357 Jun 20 01:34 output.list
[2024-06-20 01:34:23] -rw-r--r-- 1 boincer umatlas       620 Jun 20 01:34 runtime_log
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas  10496000 Jun 20 01:34 result.tar.gz
[2024-06-20 01:34:23] -rw-r--r-- 1 boincer umatlas     11382 Jun 20 01:34 runtime_log.err
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas       652 Jun 20 01:34 2fnLDmzX1d5n9Rq4apOajLDm4fhM0noT9bVo2ijZDmPXWKDmz1snsn.diag
[2024-06-20 01:34:23] -rw-r--r-- 1 boincer umatlas     21650 Jun 20 01:34 stderr.txt
[2024-06-20 01:34:23] HITS file was successfully produced:
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas 351638921 Jun 20 01:28 shared/HITS.pool.root.1
[2024-06-20 01:34:23]  *** Contents of shared directory: ***
[2024-06-20 01:34:23] total 975636
[2024-06-20 01:34:23] -rw-r--r-- 2 boincer umatlas 636398037 Jun 19 06:18 ATLAS.root_0
[2024-06-20 01:34:23] -rw-r--r-- 2 boincer umatlas     17537 Jun 19 06:18 start_atlas.sh
[2024-06-20 01:34:23] -rw-r--r-- 2 boincer umatlas    482515 Jun 19 06:18 input.tar.gz
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas 351638921 Jun 20 01:28 HITS.pool.root.1
[2024-06-20 01:34:23] -rw------- 1 boincer umatlas  10496000 Jun 20 01:34 result.tar.gz
01:34:25 (4186008): run_atlas exited; CPU time 99758.779001
01:34:25 (4186008): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN