Name hzUNDmDVKS5nsSi4apGgGQJmABFKDmABFKDm4ySLDmAbRKDmLwOIpn_0
Workunit 223078653
Created 17 May 2024, 21:41:32 UTC
Sent 18 May 2024, 2:02:34 UTC
Report deadline 26 May 2024, 2:02:34 UTC
Received 18 May 2024, 10:34:10 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10511677
Run time 7 hours 32 min 6 sec
CPU time 12 hours 56 min 38 sec
Validate state Valid
Credit 1,330.26
Device peak FLOPS 88.59 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.24 GB
Peak swap size 34.18 GB
Peak disk usage 1.35 GB

Stderr output

<core_client_version>8.0.0</core_client_version>
<![CDATA[
<stderr_txt>
05:00:50 (111557): wrapper (7.15.26016): starting
05:00:50 (111557): wrapper (7.15.26016): starting
05:00:50 (111557): wrapper: running run_atlas (--nthreads 2)
[2024-05-18 05:00:50] Arguments: --nthreads 2
[2024-05-18 05:00:50] Threads: 2
[2024-05-18 05:00:50] Checking for CVMFS
[2024-05-18 05:00:51] Probing /cvmfs/atlas.cern.ch... OK
[2024-05-18 05:00:51] Probing /cvmfs/atlas-condb.cern.ch... OK
[2024-05-18 05:00:51] Running cvmfs_config stat atlas.cern.ch
[2024-05-18 05:00:52] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2024-05-18 05:00:52] 2.11.3.0 3703 5190 57868 132863 3 56 4386306 6291456 8147 130560 3 13654744 99.997 821421 2374 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://203.0.113.60:7028 1
[2024-05-18 05:00:52] CVMFS is ok
[2024-05-18 05:00:52] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-05-18 05:00:52] Checking for apptainer binary...
[2024-05-18 05:00:52] Using apptainer found in PATH at /usr/bin/apptainer
[2024-05-18 05:00:52] Running /usr/bin/apptainer --version
[2024-05-18 05:00:52] apptainer version 1.3.0-1.2
[2024-05-18 05:00:52] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-05-18 05:00:52] b3
[2024-05-18 05:00:52] apptainer works
[2024-05-18 05:00:52] Set ATHENA_PROC_NUMBER=2
[2024-05-18 05:00:52] Set ATHENA_CORE_NUMBER=2
[2024-05-18 05:00:53] Starting ATLAS job with PandaID=6208359534
[2024-05-18 05:00:53] Running command: /usr/bin/apptainer exec -B /cvmfs,/home/boinc3/BOINC_ATLAS/slots/4 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2024-05-18 05:00:53] Starting apptainer container.
[2024-05-18 05:00:53] To get some details on systemd level run
[2024-05-18 05:00:53] systemctl status ATLAS_boinc3_4_hzUNDmDVKS5nsSi4apGgGQJmABFKDmABFKDm4ySLDmAbRKDmLwOIpn_0.scope
[2024-05-18 05:00:53] ----,^^^^,<<<~_____---,^^^,<<~____--,^^,<~__;_
[2024-05-18 12:32:52] Container ATLAS_boinc3_4_hzUNDmDVKS5nsSi4apGgGQJmABFKDmABFKDm4ySLDmAbRKDmLwOIpn_0 finished with status code 0.
[2024-05-18 12:32:52]  *** The last 200 lines of the pilot log: ***
[2024-05-18 12:32:52] 2024-05-18 10:32:34,358 | WARNING  | GPU info not found in prmon json
[2024-05-18 12:32:52] 2024-05-18 10:32:34,358 | WARNING  | format EVNTtoHITS has no such key: dbData
[2024-05-18 12:32:52] 2024-05-18 10:32:34,359 | WARNING  | format EVNTtoHITS has no such key: dbTime
[2024-05-18 12:32:52] 2024-05-18 10:32:34,366 | INFO     | fitting pss+swap vs Time
[2024-05-18 12:32:52] 2024-05-18 10:32:34,370 | INFO     | model: linear, x: [1716001434.0, 1716001495.0, 1716001556.0, 1716001617.0, 1716001678.0, 1716001739.0, 1716001800.0, 1716001861.0, 1716001922.0, 1716001983.0, 1716
[2024-05-18 12:32:52] 2024-05-18 10:32:34,370 | INFO     | sum of square deviations: 26594507940.0
[2024-05-18 12:32:52] 2024-05-18 10:32:34,378 | INFO     | sum of deviations: 134787368634.00002
[2024-05-18 12:32:52] 2024-05-18 10:32:34,378 | INFO     | mean x: 1716014854.0
[2024-05-18 12:32:52] 2024-05-18 10:32:34,378 | INFO     | mean y: 2259545.3333333335
[2024-05-18 12:32:52] 2024-05-18 10:32:34,378 | INFO     | -- intersect: -8694916850.234814
[2024-05-18 12:32:52] 2024-05-18 10:32:34,378 | INFO     | intersect: -8694916850.234814
[2024-05-18 12:32:52] 2024-05-18 10:32:34,379 | INFO     | chi2: 2.951231753954296
[2024-05-18 12:32:52] 2024-05-18 10:32:34,379 | INFO     | model: linear, x: [1716001434.0, 1716001495.0, 1716001556.0, 1716001617.0, 1716001678.0, 1716001739.0, 1716001800.0, 1716001861.0, 1716001922.0, 1716001983.0, 1716
[2024-05-18 12:32:52] 2024-05-18 10:32:34,379 | INFO     | sum of square deviations: 25700146985.0
[2024-05-18 12:32:52] 2024-05-18 10:32:34,390 | INFO     | sum of deviations: 132629519772.5
[2024-05-18 12:32:52] 2024-05-18 10:32:34,390 | INFO     | mean x: 1716014701.5
[2024-05-18 12:32:52] 2024-05-18 10:32:34,390 | INFO     | mean y: 2259177.9380733944
[2024-05-18 12:32:52] 2024-05-18 10:32:34,390 | INFO     | -- intersect: -8853495846.160864
[2024-05-18 12:32:52] 2024-05-18 10:32:34,391 | INFO     | intersect: -8853495846.160864
[2024-05-18 12:32:52] 2024-05-18 10:32:34,391 | INFO     | chi2: 2.9518541095764874
[2024-05-18 12:32:52] 2024-05-18 10:32:34,391 | INFO     | current chi2=2.9518541095764874 (change=-0.02108799559227137 %)
[2024-05-18 12:32:52] 2024-05-18 10:32:34,391 | INFO     | right removable region: 435
[2024-05-18 12:32:52] 2024-05-18 10:32:34,392 | INFO     | model: linear, x: [1716001739.0, 1716001800.0, 1716001861.0, 1716001922.0, 1716001983.0, 1716002044.0, 1716002105.0, 1716002166.0, 1716002227.0, 1716002288.0, 1716
[2024-05-18 12:32:52] 2024-05-18 10:32:34,392 | INFO     | sum of square deviations: 25700146985.0
[2024-05-18 12:32:52] 2024-05-18 10:32:34,399 | INFO     | sum of deviations: 29726691806.5
[2024-05-18 12:32:52] 2024-05-18 10:32:34,399 | INFO     | mean x: 1716015006.5
[2024-05-18 12:32:52] 2024-05-18 10:32:34,399 | INFO     | mean y: 2277427.8004587158
[2024-05-18 12:32:52] 2024-05-18 10:32:34,399 | INFO     | -- intersect: -1982592513.3453114
[2024-05-18 12:32:52] 2024-05-18 10:32:34,399 | INFO     | intersect: -1982592513.3453114
[2024-05-18 12:32:52] 2024-05-18 10:32:34,403 | INFO     | chi2: 0.3043407509290126
[2024-05-18 12:32:52] 2024-05-18 10:32:34,404 | INFO     | current chi2=0.3043407509290126 (change=89.68767022375546 %)
[2024-05-18 12:32:52] 2024-05-18 10:32:34,404 | INFO     | model: linear, x: [1716002044.0, 1716002105.0, 1716002166.0, 1716002227.0, 1716002288.0, 1716002349.0, 1716002410.0, 1716002471.0, 1716002532.0, 1716002593.0, 1716
[2024-05-18 12:32:52] 2024-05-18 10:32:34,404 | INFO     | sum of square deviations: 24826065480.0
[2024-05-18 12:32:52] 2024-05-18 10:32:34,412 | INFO     | sum of deviations: 4317966129.999999
[2024-05-18 12:32:52] 2024-05-18 10:32:34,412 | INFO     | mean x: 1716015159.0
[2024-05-18 12:32:52] 2024-05-18 10:32:34,412 | INFO     | mean y: 2281833.4431554526
[2024-05-18 12:32:52] 2024-05-18 10:32:34,412 | INFO     | -- intersect: -296182510.0549252
[2024-05-18 12:32:52] 2024-05-18 10:32:34,412 | INFO     | intersect: -296182510.0549252
[2024-05-18 12:32:52] 2024-05-18 10:32:34,413 | INFO     | chi2: 0.008965873412660464
[2024-05-18 12:32:52] 2024-05-18 10:32:34,413 | INFO     | current chi2=0.008965873412660464 (change=97.05400167894317 %)
[2024-05-18 12:32:52] 2024-05-18 10:32:34,417 | INFO     | model: linear, x: [1716002349.0, 1716002410.0, 1716002471.0, 1716002532.0, 1716002593.0, 1716002654.0, 1716002715.0, 1716002776.0, 1716002837.0, 1716002898.0, 1716
[2024-05-18 12:32:52] 2024-05-18 10:32:34,417 | INFO     | sum of square deviations: 23972030862.5
[2024-05-18 12:32:52] 2024-05-18 10:32:34,424 | INFO     | sum of deviations: 5356181981.999995
[2024-05-18 12:32:52] 2024-05-18 10:32:34,424 | INFO     | mean x: 1716015311.5
[2024-05-18 12:32:52] 2024-05-18 10:32:34,424 | INFO     | mean y: 2281646.488262911
[2024-05-18 12:32:52] 2024-05-18 10:32:34,425 | INFO     | -- intersect: -381135609.43854123
[2024-05-18 12:32:52] 2024-05-18 10:32:34,425 | INFO     | intersect: -381135609.43854123
[2024-05-18 12:32:52] 2024-05-18 10:32:34,425 | INFO     | chi2: 0.007847686749518915
[2024-05-18 12:32:52] 2024-05-18 10:32:34,425 | INFO     | current chi2=0.007847686749518915 (change=12.471586555779252 %)
[2024-05-18 12:32:52] 2024-05-18 10:32:34,425 | INFO     | left removable region: 30
[2024-05-18 12:32:52] 2024-05-18 10:32:34,426 | INFO     | model: linear, x: [1716003264.0, 1716003325.0, 1716003386.0, 1716003447.0, 1716003508.0, 1716003569.0, 1716003630.0, 1716003691.0, 1716003752.0, 1716003813.0, 1716
[2024-05-18 12:32:52] 2024-05-18 10:32:34,426 | INFO     | sum of square deviations: 20598749010.0
[2024-05-18 12:32:52] 2024-05-18 10:32:34,433 | INFO     | sum of deviations: 6900777500.000004
[2024-05-18 12:32:52] 2024-05-18 10:32:34,433 | INFO     | mean x: 1716015586.0
[2024-05-18 12:32:52] 2024-05-18 10:32:34,433 | INFO     | mean y: 2281093.6765432097
[2024-05-18 12:32:52] 2024-05-18 10:32:34,436 | INFO     | -- intersect: -572600504.2190039
[2024-05-18 12:32:52] 2024-05-18 10:32:34,437 | INFO     | intersect: -572600504.2190039
[2024-05-18 12:32:52] 2024-05-18 10:32:34,437 | INFO     | chi2: 0.005734282430045999
[2024-05-18 12:32:52] 2024-05-18 10:32:34,437 | INFO     | -- intersect: -572600504.2190039
[2024-05-18 12:32:52] 2024-05-18 10:32:34,437 | INFO     | current memory leak: 0.34 B/s (using 405 data points, chi2=0.01)
[2024-05-18 12:32:52] 2024-05-18 10:32:34,438 | INFO     | ..............................
[2024-05-18 12:32:52] 2024-05-18 10:32:34,438 | INFO     | . Timing measurements:
[2024-05-18 12:32:52] 2024-05-18 10:32:34,438 | INFO     | . get job = 0 s
[2024-05-18 12:32:52] 2024-05-18 10:32:34,438 | INFO     | . initial setup = 3 s
[2024-05-18 12:32:52] 2024-05-18 10:32:34,439 | INFO     | . payload setup = 36 s
[2024-05-18 12:32:52] 2024-05-18 10:32:34,439 | INFO     | . stage-in = 0 s
[2024-05-18 12:32:52] 2024-05-18 10:32:34,439 | INFO     | . payload execution = 26909 s
[2024-05-18 12:32:52] 2024-05-18 10:32:34,439 | INFO     | . stage-out = 2 s
[2024-05-18 12:32:52] 2024-05-18 10:32:34,439 | INFO     | . log creation = 0 s
[2024-05-18 12:32:52] 2024-05-18 10:32:34,439 | INFO     | ..............................
[2024-05-18 12:32:52] 2024-05-18 10:32:34,673 | INFO     | 
[2024-05-18 12:32:52] 2024-05-18 10:32:34,674 | INFO     | job summary report
[2024-05-18 12:32:52] 2024-05-18 10:32:34,674 | INFO     | --------------------------------------------------
[2024-05-18 12:32:52] 2024-05-18 10:32:34,674 | INFO     | PanDA job id: 6208359534
[2024-05-18 12:32:52] 2024-05-18 10:32:34,674 | INFO     | task id: 38776125
[2024-05-18 12:32:52] 2024-05-18 10:32:34,674 | INFO     | errors: (none)
[2024-05-18 12:32:52] 2024-05-18 10:32:34,674 | INFO     | status: LOG_TRANSFER = DONE 
[2024-05-18 12:32:52] 2024-05-18 10:32:34,674 | INFO     | pilot state: finished 
[2024-05-18 12:32:52] 2024-05-18 10:32:34,674 | INFO     | transexitcode: 0
[2024-05-18 12:32:52] 2024-05-18 10:32:34,674 | INFO     | exeerrorcode: 0
[2024-05-18 12:32:52] 2024-05-18 10:32:34,674 | INFO     | exeerrordiag: 
[2024-05-18 12:32:52] 2024-05-18 10:32:34,674 | INFO     | exitcode: 0
[2024-05-18 12:32:52] 2024-05-18 10:32:34,674 | INFO     | exitmsg: OK
[2024-05-18 12:32:52] 2024-05-18 10:32:34,674 | INFO     | cpuconsumptiontime: 46734 s
[2024-05-18 12:32:52] 2024-05-18 10:32:34,675 | INFO     | nevents: 400
[2024-05-18 12:32:52] 2024-05-18 10:32:34,675 | INFO     | neventsw: 0
[2024-05-18 12:32:52] 2024-05-18 10:32:34,675 | INFO     | pid: 129447
[2024-05-18 12:32:52] 2024-05-18 10:32:34,675 | INFO     | pgrp: 129447
[2024-05-18 12:32:52] 2024-05-18 10:32:34,675 | INFO     | corecount: 2
[2024-05-18 12:32:52] 2024-05-18 10:32:34,675 | INFO     | event service: False
[2024-05-18 12:32:52] 2024-05-18 10:32:34,675 | INFO     | sizes: {0: 2391297, 1: 2392232, 2: 2392232, 12: 2392260, 23: 2392288, 24: 2392522, 34: 2392678, 26949: 2428745, 26953: 2437781, 26980: 2437895}
[2024-05-18 12:32:52] 2024-05-18 10:32:34,675 | INFO     | --------------------------------------------------
[2024-05-18 12:32:52] 2024-05-18 10:32:34,675 | INFO     | 
[2024-05-18 12:32:52] 2024-05-18 10:32:34,675 | INFO     | executing command: ls -lF /home/boinc3/BOINC_ATLAS/slots/4
[2024-05-18 12:32:52] 2024-05-18 10:32:34,853 | INFO     | queue jobs had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,854 | INFO     | queue payloads had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,854 | INFO     | queue data_in had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,854 | INFO     | queue data_out had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,854 | INFO     | queue current_data_in had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,854 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,854 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,854 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,854 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,854 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,854 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,855 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,855 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,855 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,855 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,855 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,855 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,855 | INFO     | queue completed_jobids has 1 job(s)
[2024-05-18 12:32:52] 2024-05-18 10:32:34,855 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,855 | INFO     | queue messages had 0 job(s) [purged]
[2024-05-18 12:32:52] 2024-05-18 10:32:34,855 | INFO     | job 6208359534 has completed (purged errors)
[2024-05-18 12:32:52] 2024-05-18 10:32:34,855 | INFO     | overall cleanup function is called
[2024-05-18 12:32:52] 2024-05-18 10:32:35,860 | INFO     | --- collectZombieJob: --- 10, [129447]
[2024-05-18 12:32:52] 2024-05-18 10:32:35,860 | INFO     | zombie collector waiting for pid 129447
[2024-05-18 12:32:52] 2024-05-18 10:32:35,860 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2024-05-18 12:32:52] 2024-05-18 10:32:36,866 | INFO     | collected zombie processes
[2024-05-18 12:32:52] 2024-05-18 10:32:36,867 | INFO     | will now attempt to kill all subprocesses of pid=129447
[2024-05-18 12:32:52] 2024-05-18 10:32:37,312 | INFO     | process IDs to be killed: [129447] (in reverse order)
[2024-05-18 12:32:52] 2024-05-18 10:32:37,481 | WARNING  | found no corresponding commands to process id(s)
[2024-05-18 12:32:52] 2024-05-18 10:32:37,482 | INFO     | Do not look for orphan processes in BOINC jobs
[2024-05-18 12:32:52] 2024-05-18 10:32:37,495 | INFO     | did not find any defunct processes belonging to 129447
[2024-05-18 12:32:52] 2024-05-18 10:32:37,515 | INFO     | did not find any defunct processes belonging to 129447
[2024-05-18 12:32:52] 2024-05-18 10:32:37,515 | INFO     | ready for new job
[2024-05-18 12:32:52] 2024-05-18 10:32:37,515 | INFO     | pilot has finished with previous job - re-establishing logging
[2024-05-18 12:32:52] 2024-05-18 10:32:37,520 | INFO     | *************************************
[2024-05-18 12:32:52] 2024-05-18 10:32:37,521 | INFO     | ***  PanDA Pilot version 3.7.5.4  ***
[2024-05-18 12:32:52] 2024-05-18 10:32:37,521 | INFO     | *************************************
[2024-05-18 12:32:52] 2024-05-18 10:32:37,521 | INFO     | 
[2024-05-18 12:32:52] 2024-05-18 10:32:37,523 | INFO     | architecture information:
[2024-05-18 12:32:52] 2024-05-18 10:32:37,527 | INFO     | executing command: cat /etc/os-release
[2024-05-18 12:32:52] 2024-05-18 10:32:37,584 | INFO     | cat /etc/os-release:
[2024-05-18 12:32:52] NAME="CentOS Linux"
[2024-05-18 12:32:52] VERSION="7 (Core)"
[2024-05-18 12:32:52] ID="centos"
[2024-05-18 12:32:52] ID_LIKE="rhel fedora"
[2024-05-18 12:32:52] VERSION_ID="7"
[2024-05-18 12:32:52] PRETTY_NAME="CentOS Linux 7 (Core)"
[2024-05-18 12:32:52] ANSI_COLOR="0;31"
[2024-05-18 12:32:52] CPE_NAME="cpe:/o:centos:centos:7"
[2024-05-18 12:32:52] HOME_URL="https://www.centos.org/"
[2024-05-18 12:32:52] BUG_REPORT_URL="https://bugs.centos.org/"
[2024-05-18 12:32:52] 
[2024-05-18 12:32:52] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2024-05-18 12:32:52] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2024-05-18 12:32:52] REDHAT_SUPPORT_PRODUCT="centos"
[2024-05-18 12:32:52] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2024-05-18 12:32:52] 
[2024-05-18 12:32:52] 2024-05-18 10:32:37,584 | INFO     | *************************************
[2024-05-18 12:32:52] 2024-05-18 10:32:38,087 | INFO     | executing command: df -mP /home/boinc3/BOINC_ATLAS/slots/4
[2024-05-18 12:32:52] 2024-05-18 10:32:38,177 | INFO     | sufficient remaining disk space (99018080256 B)
[2024-05-18 12:32:52] 2024-05-18 10:32:38,177 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2024-05-18 12:32:52] 2024-05-18 10:32:38,177 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2024-05-18 12:32:52] 2024-05-18 10:32:38,260 | INFO     | all data control threads have been joined
[2024-05-18 12:32:52] 2024-05-18 10:32:38,350 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2024-05-18 12:32:52] 2024-05-18 10:32:38,617 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2024-05-18 12:32:52] 2024-05-18 10:32:38,617 | INFO     | aborting loop
[2024-05-18 12:32:52] 2024-05-18 10:32:38,960 | INFO     | found 0 job(s) in 20 queues
[2024-05-18 12:32:52] 2024-05-18 10:32:38,960 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2024-05-18 12:32:52] 2024-05-18 10:32:38,960 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2024-05-18 12:32:52] 2024-05-18 10:32:39,070 | INFO     | all payload control threads have been joined
[2024-05-18 12:32:52] 2024-05-18 10:32:39,187 | INFO     | [job] retrieve thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:39,263 | INFO     | [data] control thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:39,290 | INFO     | [payload] run_realtimelog thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:39,470 | INFO     | [job] create_data_payload thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:39,486 | INFO     | all job control threads have been joined
[2024-05-18 12:32:52] 2024-05-18 10:32:39,487 | INFO     | [payload] failed_post thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:39,560 | INFO     | [payload] validate_pre thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:39,620 | INFO     | [job] job monitor thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:39,690 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2024-05-18 12:32:52] 2024-05-18 10:32:39,887 | INFO     | [job] validate thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:39,887 | INFO     | [payload] execute_payloads thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:40,083 | INFO     | [payload] control thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:40,360 | INFO     | [data] copytool_out thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:40,393 | INFO     | [data] copytool_in thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:40,493 | INFO     | [job] control thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:40,697 | INFO     | [job] queue monitor thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:40,787 | INFO     | [payload] validate_post thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:41,223 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2024-05-18 12:32:52] 2024-05-18 10:32:45,233 | INFO     | [data] queue_monitor thread has finished
[2024-05-18 12:32:52] 2024-05-18 10:32:47,090 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 140581747574592)>', '<ExcThread(monitor, started 140581281990400)>']
[2024-05-18 12:32:52] 2024-05-18 10:32:48,011 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2024-05-18 12:32:52] 2024-05-18 10:32:48,012 | INFO     | [monitor] control thread has ended
[2024-05-18 12:32:52] 2024-05-18 10:32:52,114 | INFO     | all workflow threads have been joined
[2024-05-18 12:32:52] 2024-05-18 10:32:52,114 | INFO     | end of generic workflow (traces error code: 0)
[2024-05-18 12:32:52] 2024-05-18 10:32:52,115 | INFO     | traces error code: 0
[2024-05-18 12:32:52] 2024-05-18 10:32:52,115 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2024-05-18 12:32:52] 2024-05-18 10:32:52,293 [wrapper] ==== pilot stdout END ====
[2024-05-18 12:32:52] 2024-05-18 10:32:52,316 [wrapper] ==== wrapper stdout RESUME ====
[2024-05-18 12:32:52] 2024-05-18 10:32:52,337 [wrapper] pilotpid: 116816
[2024-05-18 12:32:52] 2024-05-18 10:32:52,341 [wrapper] Pilot exit status: 0
[2024-05-18 12:32:52] 2024-05-18 10:32:52,368 [wrapper] pandaids: 6208359534
[2024-05-18 12:32:52] 2024-05-18 10:32:52,519 [wrapper] cleanup: SIGTERM to supervisor_pilot  46059 116817
[2024-05-18 12:32:52] 2024-05-18 10:32:52,526 [wrapper] Test setup, not cleaning
[2024-05-18 12:32:52] 2024-05-18 10:32:52,529 [wrapper] ==== wrapper stdout END ====
[2024-05-18 12:32:52] 2024-05-18 10:32:52,545 [wrapper] ==== wrapper stderr END ====
[2024-05-18 12:32:52] 2024-05-18 10:32:52,559 [wrapper] apfmon messages muted
[2024-05-18 12:32:52]  *** Error codes and diagnostics ***
[2024-05-18 12:32:52]     "exeErrorCode": 0,
[2024-05-18 12:32:52]     "exeErrorDiag": "",
[2024-05-18 12:32:52]     "pilotErrorCode": 0,
[2024-05-18 12:32:52]     "pilotErrorDiag": "",
[2024-05-18 12:32:52]  *** Listing of results directory ***
[2024-05-18 12:32:52] total 834696
[2024-05-18 12:32:52] -rw-r--r-- 1 boinc3 boinc    467845 May 17 23:26 pilot3.tar.gz
[2024-05-18 12:32:52] -rwx------ 1 boinc3 boinc     32251 May 17 23:41 runpilot2-wrapper.sh
[2024-05-18 12:32:52] -rw-r--r-- 1 boinc3 boinc      5633 May 17 23:41 queuedata.json
[2024-05-18 12:32:52] -rw-r--r-- 1 boinc3 boinc       100 May 18 05:00 wrapper_26015_x86_64-pc-linux-gnu
[2024-05-18 12:32:52] -rwxr-xr-x 1 boinc3 boinc      9842 May 18 05:00 run_atlas
[2024-05-18 12:32:52] -rw-r--r-- 1 boinc3 boinc       105 May 18 05:00 job.xml
[2024-05-18 12:32:52] -rw-r--r-- 2 boinc3 boinc     17537 May 18 05:00 start_atlas.sh
[2024-05-18 12:32:52] drwxrwx--x 2 boinc3 boinc       100 May 18 05:00 shared
[2024-05-18 12:32:52] -rw-r--r-- 2 boinc3 boinc    480014 May 18 05:00 input.tar.gz
[2024-05-18 12:32:52] -rw-r--r-- 1 boinc3 boinc      6685 May 18 05:00 init_data.xml
[2024-05-18 12:32:52] -rw-r--r-- 1 boinc3 boinc      8192 May 18 05:00 boinc_mmap_file
[2024-05-18 12:32:52] -rw-r--r-- 2 boinc3 boinc 603922287 May 18 05:00 EVNT.38776119._000247.pool.root.1
[2024-05-18 12:32:52] -rw-r--r-- 1 boinc3 boinc         0 May 18 05:00 boinc_lockfile
[2024-05-18 12:32:52] -rw-r--r-- 1 boinc3 boinc      2633 May 18 05:00 pandaJob.out
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc       452 May 18 05:00 setup.sh.local
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc   1019073 May 18 05:01 agis_schedconf.cvmfs.json
[2024-05-18 12:32:52] drwx------ 4 boinc3 boinc       400 May 18 05:01 pilot3
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc 240468524 May 18 12:31 HITS.38776125._015145.pool.root.1
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc      1017 May 18 12:32 memory_monitor_summary.json
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc        95 May 18 12:32 pilot_heartbeat.json
[2024-05-18 12:32:52] -rw-r--r-- 1 boinc3 boinc         0 May 18 12:32 agis_ddmendpoints.agis.ALL.json
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc   1324701 May 18 12:32 cric_ddmendpoints.json
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc    454894 May 18 12:32 log.38776125._015145.job.log.tgz.1
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc      7643 May 18 12:32 heartbeat.json
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc      4221 May 18 12:32 pilotlog.txt
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc   2960129 May 18 12:32 log.38776125._015145.job.log.1
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc       357 May 18 12:32 output.list
[2024-05-18 12:32:52] -rw-r--r-- 1 boinc3 boinc       620 May 18 12:32 runtime_log
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc   3430400 May 18 12:32 result.tar.gz
[2024-05-18 12:32:52] -rw-r--r-- 1 boinc3 boinc     11451 May 18 12:32 runtime_log.err
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc       632 May 18 12:32 hzUNDmDVKS5nsSi4apGgGQJmABFKDmABFKDm4ySLDmAbRKDmLwOIpn.diag
[2024-05-18 12:32:52] -rw-r--r-- 1 boinc3 boinc     21738 May 18 12:32 stderr.txt
[2024-05-18 12:32:52] HITS file was successfully produced:
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc 240468524 May 18 12:31 shared/HITS.pool.root.1
[2024-05-18 12:32:52]  *** Contents of shared directory: ***
[2024-05-18 12:32:52] total 828448
[2024-05-18 12:32:52] -rw-r--r-- 2 boinc3 boinc     17537 May 18 05:00 start_atlas.sh
[2024-05-18 12:32:52] -rw-r--r-- 2 boinc3 boinc    480014 May 18 05:00 input.tar.gz
[2024-05-18 12:32:52] -rw-r--r-- 2 boinc3 boinc 603922287 May 18 05:00 ATLAS.root_0
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc 240468524 May 18 12:31 HITS.pool.root.1
[2024-05-18 12:32:52] -rw------- 1 boinc3 boinc   3430400 May 18 12:32 result.tar.gz
12:32:54 (111557): run_atlas exited; CPU time 46598.580441
12:32:54 (111557): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN