Name 7b2LDm9SeR5nsSi4apGgGQJmABFKDmABFKDm4ySLDm8zOKDmlkwNUn_0
Workunit 223039641
Created 16 May 2024, 0:48:34 UTC
Sent 16 May 2024, 4:57:30 UTC
Report deadline 24 May 2024, 4:57:30 UTC
Received 16 May 2024, 12:40:35 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10511677
Run time 6 hours 14 min 32 sec
CPU time 11 hours 25 min 27 sec
Validate state Valid
Credit 1,207.20
Device peak FLOPS 88.59 GFLOPS
Application version ATLAS Simulation v3.01 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 2.42 GB
Peak swap size 35.19 GB
Peak disk usage 1.33 GB

Stderr output

<core_client_version>8.0.0</core_client_version>
<![CDATA[
<stderr_txt>
08:24:55 (53540): wrapper (7.15.26016): starting
08:24:55 (53540): wrapper (7.15.26016): starting
08:24:55 (53540): wrapper: running run_atlas (--nthreads 2)
[2024-05-16 08:24:55] Arguments: --nthreads 2
[2024-05-16 08:24:55] Threads: 2
[2024-05-16 08:24:55] Checking for CVMFS
[2024-05-16 08:24:55] Probing /cvmfs/atlas.cern.ch... OK
[2024-05-16 08:24:56] Probing /cvmfs/atlas-condb.cern.ch... OK
[2024-05-16 08:24:56] Running cvmfs_config stat atlas.cern.ch
[2024-05-16 08:24:56] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2024-05-16 08:24:56] 2.11.3.0 3703 2514 57876 132788 0 189 3602792 6291457 1810 130560 3 5860072 99.996 450481 2278 http://s1cern-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://203.0.113.126:7028 1
[2024-05-16 08:24:56] CVMFS is ok
[2024-05-16 08:24:56] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-05-16 08:24:56] Checking for apptainer binary...
[2024-05-16 08:24:56] Using apptainer found in PATH at /usr/bin/apptainer
[2024-05-16 08:24:56] Running /usr/bin/apptainer --version
[2024-05-16 08:24:56] apptainer version 1.3.0-1.2
[2024-05-16 08:24:56] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-05-16 08:24:56] b3
[2024-05-16 08:24:56] apptainer works
[2024-05-16 08:24:56] Set ATHENA_PROC_NUMBER=2
[2024-05-16 08:24:56] Set ATHENA_CORE_NUMBER=2
[2024-05-16 08:24:57] Starting ATLAS job with PandaID=6207077608
[2024-05-16 08:24:57] Running command: /usr/bin/apptainer exec -B /cvmfs,/home/boinc3/BOINC_ATLAS/slots/0 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2024-05-16 08:24:57] Starting apptainer container.
[2024-05-16 08:24:57] To get some details on systemd level run
[2024-05-16 08:24:57] systemctl status ATLAS_boinc3_0_7b2LDm9SeR5nsSi4apGgGQJmABFKDmABFKDm4ySLDm8zOKDmlkwNUn_0.scope
[2024-05-16 08:24:57] ----,^^^^,<<<~_____---,^^^,<<~____--,^^,<~__;_
[2024-05-16 14:39:24] Container ATLAS_boinc3_0_7b2LDm9SeR5nsSi4apGgGQJmABFKDmABFKDm4ySLDm8zOKDmlkwNUn_0 finished with status code 0.
[2024-05-16 14:39:24]  *** The last 200 lines of the pilot log: ***
[2024-05-16 14:39:24] 2024-05-16 12:39:07,417 | INFO     | intersect: -7967105321.452073
[2024-05-16 14:39:24] 2024-05-16 12:39:07,418 | INFO     | chi2: 2.2000345553512206
[2024-05-16 14:39:24] 2024-05-16 12:39:07,418 | INFO     | model: linear, x: [1715840796.0, 1715840857.0, 1715840918.0, 1715840979.0, 1715841040.0, 1715841101.0, 1715841162.0, 1715841223.0, 1715841284.0, 1715841345.0, 1715
[2024-05-16 14:39:24] 2024-05-16 12:39:07,418 | INFO     | sum of square deviations: 14588031660.0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,421 | INFO     | sum of deviations: 69300518086.99998
[2024-05-16 14:39:24] 2024-05-16 12:39:07,421 | INFO     | mean x: 1715851776.0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,421 | INFO     | mean y: 2273626.324099723
[2024-05-16 14:39:24] 2024-05-16 12:39:07,421 | INFO     | -- intersect: -8148888902.569058
[2024-05-16 14:39:24] 2024-05-16 12:39:07,422 | INFO     | intersect: -8148888902.569058
[2024-05-16 14:39:24] 2024-05-16 12:39:07,422 | INFO     | chi2: 2.200690319900454
[2024-05-16 14:39:24] 2024-05-16 12:39:07,422 | INFO     | current chi2=2.200690319900454 (change=-0.02980701133253974 %)
[2024-05-16 14:39:24] 2024-05-16 12:39:07,422 | INFO     | right removable region: 360
[2024-05-16 14:39:24] 2024-05-16 12:39:07,422 | INFO     | model: linear, x: [1715841101.0, 1715841162.0, 1715841223.0, 1715841284.0, 1715841345.0, 1715841406.0, 1715841467.0, 1715841528.0, 1715841589.0, 1715841650.0, 1715
[2024-05-16 14:39:24] 2024-05-16 12:39:07,423 | INFO     | sum of square deviations: 14588031660.0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,425 | INFO     | sum of deviations: -7067347942.999999
[2024-05-16 14:39:24] 2024-05-16 12:39:07,426 | INFO     | mean x: 1715852081.0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,426 | INFO     | mean y: 2293182.182825485
[2024-05-16 14:39:24] 2024-05-16 12:39:07,426 | INFO     | -- intersect: 833558424.6622634
[2024-05-16 14:39:24] 2024-05-16 12:39:07,426 | INFO     | intersect: 833558424.6622634
[2024-05-16 14:39:24] 2024-05-16 12:39:07,426 | INFO     | chi2: 0.05550543414632338
[2024-05-16 14:39:24] 2024-05-16 12:39:07,426 | INFO     | current chi2=0.05550543414632338 (change=97.4770653483003 %)
[2024-05-16 14:39:24] 2024-05-16 12:39:07,427 | INFO     | model: linear, x: [1715841406.0, 1715841467.0, 1715841528.0, 1715841589.0, 1715841650.0, 1715841711.0, 1715841772.0, 1715841833.0, 1715841894.0, 1715841955.0, 1715
[2024-05-16 14:39:24] 2024-05-16 12:39:07,427 | INFO     | sum of square deviations: 13990234405.0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,430 | INFO     | sum of deviations: -7770457184.0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,430 | INFO     | mean x: 1715852233.5
[2024-05-16 14:39:24] 2024-05-16 12:39:07,430 | INFO     | mean y: 2293343.0561797754
[2024-05-16 14:39:24] 2024-05-16 12:39:07,430 | INFO     | -- intersect: 955312136.6310343
[2024-05-16 14:39:24] 2024-05-16 12:39:07,430 | INFO     | intersect: 955312136.6310343
[2024-05-16 14:39:24] 2024-05-16 12:39:07,430 | INFO     | chi2: 0.02088554401940245
[2024-05-16 14:39:24] 2024-05-16 12:39:07,431 | INFO     | current chi2=0.02088554401940245 (change=62.37207340033771 %)
[2024-05-16 14:39:24] 2024-05-16 12:39:07,431 | INFO     | model: linear, x: [1715841711.0, 1715841772.0, 1715841833.0, 1715841894.0, 1715841955.0, 1715842016.0, 1715842077.0, 1715842138.0, 1715842199.0, 1715842260.0, 1715
[2024-05-16 14:39:24] 2024-05-16 12:39:07,431 | INFO     | sum of square deviations: 13408995600.0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,434 | INFO     | sum of deviations: -2428131901.000003
[2024-05-16 14:39:24] 2024-05-16 12:39:07,434 | INFO     | mean x: 1715852386.0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,434 | INFO     | mean y: 2291945.376068376
[2024-05-16 14:39:24] 2024-05-16 12:39:07,434 | INFO     | -- intersect: 313002459.43228674
[2024-05-16 14:39:24] 2024-05-16 12:39:07,434 | INFO     | intersect: 313002459.43228674
[2024-05-16 14:39:24] 2024-05-16 12:39:07,435 | INFO     | chi2: 0.011139314666040104
[2024-05-16 14:39:24] 2024-05-16 12:39:07,435 | INFO     | current chi2=0.011139314666040104 (change=46.664953253351705 %)
[2024-05-16 14:39:24] 2024-05-16 12:39:07,435 | INFO     | model: linear, x: [1715842016.0, 1715842077.0, 1715842138.0, 1715842199.0, 1715842260.0, 1715842321.0, 1715842382.0, 1715842443.0, 1715842504.0, 1715842565.0, 1715
[2024-05-16 14:39:24] 2024-05-16 12:39:07,435 | INFO     | sum of square deviations: 12844082682.5
[2024-05-16 14:39:24] 2024-05-16 12:39:07,438 | INFO     | sum of deviations: 198543714.99999982
[2024-05-16 14:39:24] 2024-05-16 12:39:07,438 | INFO     | mean x: 1715852538.5
[2024-05-16 14:39:24] 2024-05-16 12:39:07,438 | INFO     | mean y: 2291236.768786127
[2024-05-16 14:39:24] 2024-05-16 12:39:07,438 | INFO     | -- intersect: -24232396.394221596
[2024-05-16 14:39:24] 2024-05-16 12:39:07,438 | INFO     | intersect: -24232396.394221596
[2024-05-16 14:39:24] 2024-05-16 12:39:07,439 | INFO     | chi2: 0.008898291767173635
[2024-05-16 14:39:24] 2024-05-16 12:39:07,439 | INFO     | current chi2=0.008898291767173635 (change=20.11813981427932 %)
[2024-05-16 14:39:24] 2024-05-16 12:39:07,439 | INFO     | left removable region: 40
[2024-05-16 14:39:24] 2024-05-16 12:39:07,439 | INFO     | model: linear, x: [1715843236.0, 1715843297.0, 1715843358.0, 1715843419.0, 1715843480.0, 1715843541.0, 1715843602.0, 1715843663.0, 1715843724.0, 1715843785.0, 1715
[2024-05-16 14:39:24] 2024-05-16 12:39:07,439 | INFO     | sum of square deviations: 10160711440.0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,442 | INFO     | sum of deviations: 6169932535.0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,442 | INFO     | mean x: 1715852965.5
[2024-05-16 14:39:24] 2024-05-16 12:39:07,442 | INFO     | mean y: 2289208.15
[2024-05-16 14:39:24] 2024-05-16 12:39:07,442 | INFO     | -- intersect: -1039635572.3764592
[2024-05-16 14:39:24] 2024-05-16 12:39:07,442 | INFO     | intersect: -1039635572.3764592
[2024-05-16 14:39:24] 2024-05-16 12:39:07,442 | INFO     | chi2: 0.004323837537007187
[2024-05-16 14:39:24] 2024-05-16 12:39:07,443 | INFO     | -- intersect: -1039635572.3764592
[2024-05-16 14:39:24] 2024-05-16 12:39:07,443 | INFO     | current memory leak: 0.61 B/s (using 320 data points, chi2=0.00)
[2024-05-16 14:39:24] 2024-05-16 12:39:07,444 | INFO     | ..............................
[2024-05-16 14:39:24] 2024-05-16 12:39:07,444 | INFO     | . Timing measurements:
[2024-05-16 14:39:24] 2024-05-16 12:39:07,444 | INFO     | . get job = 0 s
[2024-05-16 14:39:24] 2024-05-16 12:39:07,444 | INFO     | . initial setup = 1 s
[2024-05-16 14:39:24] 2024-05-16 12:39:07,444 | INFO     | . payload setup = 18 s
[2024-05-16 14:39:24] 2024-05-16 12:39:07,444 | INFO     | . stage-in = 0 s
[2024-05-16 14:39:24] 2024-05-16 12:39:07,444 | INFO     | . payload execution = 22335 s
[2024-05-16 14:39:24] 2024-05-16 12:39:07,444 | INFO     | . stage-out = 1 s
[2024-05-16 14:39:24] 2024-05-16 12:39:07,444 | INFO     | . log creation = 0 s
[2024-05-16 14:39:24] 2024-05-16 12:39:07,444 | INFO     | ..............................
[2024-05-16 14:39:24] 2024-05-16 12:39:07,826 | INFO     | 
[2024-05-16 14:39:24] 2024-05-16 12:39:07,826 | INFO     | job summary report
[2024-05-16 14:39:24] 2024-05-16 12:39:07,826 | INFO     | --------------------------------------------------
[2024-05-16 14:39:24] 2024-05-16 12:39:07,826 | INFO     | PanDA job id: 6207077608
[2024-05-16 14:39:24] 2024-05-16 12:39:07,826 | INFO     | task id: 38776104
[2024-05-16 14:39:24] 2024-05-16 12:39:07,826 | INFO     | errors: (none)
[2024-05-16 14:39:24] 2024-05-16 12:39:07,826 | INFO     | status: LOG_TRANSFER = DONE 
[2024-05-16 14:39:24] 2024-05-16 12:39:07,827 | INFO     | pilot state: finished 
[2024-05-16 14:39:24] 2024-05-16 12:39:07,827 | INFO     | transexitcode: 0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,827 | INFO     | exeerrorcode: 0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,827 | INFO     | exeerrordiag: 
[2024-05-16 14:39:24] 2024-05-16 12:39:07,827 | INFO     | exitcode: 0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,827 | INFO     | exitmsg: OK
[2024-05-16 14:39:24] 2024-05-16 12:39:07,827 | INFO     | cpuconsumptiontime: 41247 s
[2024-05-16 14:39:24] 2024-05-16 12:39:07,827 | INFO     | nevents: 400
[2024-05-16 14:39:24] 2024-05-16 12:39:07,827 | INFO     | neventsw: 0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,827 | INFO     | pid: 69127
[2024-05-16 14:39:24] 2024-05-16 12:39:07,827 | INFO     | pgrp: 69127
[2024-05-16 14:39:24] 2024-05-16 12:39:07,827 | INFO     | corecount: 2
[2024-05-16 14:39:24] 2024-05-16 12:39:07,828 | INFO     | event service: False
[2024-05-16 14:39:24] 2024-05-16 12:39:07,828 | INFO     | sizes: {0: 2392211, 11: 2392211, 13: 2392445, 22: 2392501, 22357: 2426619, 22359: 2435599, 22362: 2435783, 22385: 2435953}
[2024-05-16 14:39:24] 2024-05-16 12:39:07,828 | INFO     | --------------------------------------------------
[2024-05-16 14:39:24] 2024-05-16 12:39:07,828 | INFO     | 
[2024-05-16 14:39:24] 2024-05-16 12:39:07,828 | INFO     | executing command: ls -lF /home/boinc3/BOINC_ATLAS/slots/0
[2024-05-16 14:39:24] 2024-05-16 12:39:07,860 | INFO     | queue jobs had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,860 | INFO     | queue payloads had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,860 | INFO     | queue data_in had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,860 | INFO     | queue data_out had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,861 | INFO     | queue current_data_in had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,861 | INFO     | queue validated_jobs had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,861 | INFO     | queue validated_payloads had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,861 | INFO     | queue monitored_payloads had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,861 | INFO     | queue finished_jobs had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,861 | INFO     | queue finished_payloads had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,861 | INFO     | queue finished_data_in had 1 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,861 | INFO     | queue finished_data_out had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,861 | INFO     | queue failed_jobs had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,861 | INFO     | queue failed_payloads had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,861 | INFO     | queue failed_data_in had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,861 | INFO     | queue failed_data_out had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,862 | INFO     | queue completed_jobs had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,862 | INFO     | queue completed_jobids has 1 job(s)
[2024-05-16 14:39:24] 2024-05-16 12:39:07,862 | INFO     | queue realtimelog_payloads had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,862 | INFO     | queue messages had 0 job(s) [purged]
[2024-05-16 14:39:24] 2024-05-16 12:39:07,862 | INFO     | job 6207077608 has completed (purged errors)
[2024-05-16 14:39:24] 2024-05-16 12:39:07,862 | INFO     | overall cleanup function is called
[2024-05-16 14:39:24] 2024-05-16 12:39:08,868 | INFO     | --- collectZombieJob: --- 10, [69127]
[2024-05-16 14:39:24] 2024-05-16 12:39:08,869 | INFO     | zombie collector waiting for pid 69127
[2024-05-16 14:39:24] 2024-05-16 12:39:08,869 | INFO     | harmless exception when collecting zombies: [Errno 10] No child processes
[2024-05-16 14:39:24] 2024-05-16 12:39:09,876 | INFO     | collected zombie processes
[2024-05-16 14:39:24] 2024-05-16 12:39:09,877 | INFO     | will now attempt to kill all subprocesses of pid=69127
[2024-05-16 14:39:24] 2024-05-16 12:39:10,058 | INFO     | process IDs to be killed: [69127] (in reverse order)
[2024-05-16 14:39:24] 2024-05-16 12:39:10,181 | WARNING  | found no corresponding commands to process id(s)
[2024-05-16 14:39:24] 2024-05-16 12:39:10,181 | INFO     | Do not look for orphan processes in BOINC jobs
[2024-05-16 14:39:24] 2024-05-16 12:39:10,190 | INFO     | did not find any defunct processes belonging to 69127
[2024-05-16 14:39:24] 2024-05-16 12:39:10,199 | INFO     | did not find any defunct processes belonging to 69127
[2024-05-16 14:39:24] 2024-05-16 12:39:10,199 | INFO     | ready for new job
[2024-05-16 14:39:24] 2024-05-16 12:39:10,199 | INFO     | pilot has finished with previous job - re-establishing logging
[2024-05-16 14:39:24] 2024-05-16 12:39:10,201 | INFO     | *************************************
[2024-05-16 14:39:24] 2024-05-16 12:39:10,201 | INFO     | ***  PanDA Pilot version 3.7.5.4  ***
[2024-05-16 14:39:24] 2024-05-16 12:39:10,201 | INFO     | *************************************
[2024-05-16 14:39:24] 2024-05-16 12:39:10,201 | INFO     | 
[2024-05-16 14:39:24] 2024-05-16 12:39:10,203 | INFO     | architecture information:
[2024-05-16 14:39:24] 2024-05-16 12:39:10,204 | INFO     | executing command: cat /etc/os-release
[2024-05-16 14:39:24] 2024-05-16 12:39:10,287 | INFO     | cat /etc/os-release:
[2024-05-16 14:39:24] NAME="CentOS Linux"
[2024-05-16 14:39:24] VERSION="7 (Core)"
[2024-05-16 14:39:24] ID="centos"
[2024-05-16 14:39:24] ID_LIKE="rhel fedora"
[2024-05-16 14:39:24] VERSION_ID="7"
[2024-05-16 14:39:24] PRETTY_NAME="CentOS Linux 7 (Core)"
[2024-05-16 14:39:24] ANSI_COLOR="0;31"
[2024-05-16 14:39:24] CPE_NAME="cpe:/o:centos:centos:7"
[2024-05-16 14:39:24] HOME_URL="https://www.centos.org/"
[2024-05-16 14:39:24] BUG_REPORT_URL="https://bugs.centos.org/"
[2024-05-16 14:39:24] 
[2024-05-16 14:39:24] CENTOS_MANTISBT_PROJECT="CentOS-7"
[2024-05-16 14:39:24] CENTOS_MANTISBT_PROJECT_VERSION="7"
[2024-05-16 14:39:24] REDHAT_SUPPORT_PRODUCT="centos"
[2024-05-16 14:39:24] REDHAT_SUPPORT_PRODUCT_VERSION="7"
[2024-05-16 14:39:24] 
[2024-05-16 14:39:24] 2024-05-16 12:39:10,287 | INFO     | *************************************
[2024-05-16 14:39:24] 2024-05-16 12:39:10,790 | INFO     | executing command: df -mP /home/boinc3/BOINC_ATLAS/slots/0
[2024-05-16 14:39:24] 2024-05-16 12:39:10,827 | INFO     | sufficient remaining disk space (101573459968 B)
[2024-05-16 14:39:24] 2024-05-16 12:39:10,827 | WARNING  | since timefloor is set to 0, pilot was only allowed to run one job
[2024-05-16 14:39:24] 2024-05-16 12:39:10,827 | WARNING  | setting graceful_stop since proceed_with_getjob() returned False (pilot will end)
[2024-05-16 14:39:24] 2024-05-16 12:39:10,828 | WARNING  | aborting monitor loop since graceful_stop has been set (timing out remaining threads)
[2024-05-16 14:39:24] 2024-05-16 12:39:10,828 | INFO     | found 0 job(s) in 20 queues
[2024-05-16 14:39:24] 2024-05-16 12:39:10,828 | WARNING  | pilot monitor received instruction that args.graceful_stop has been set
[2024-05-16 14:39:24] 2024-05-16 12:39:10,828 | WARNING  | will wait for a maximum of 300 s for threads to finish
[2024-05-16 14:39:24] 2024-05-16 12:39:10,828 | WARNING  | data:copytool_out:received graceful stop - abort after this iteration
[2024-05-16 14:39:24] 2024-05-16 12:39:10,830 | WARNING  | job:job_monitor:received graceful stop - abort after this iteration
[2024-05-16 14:39:24] 2024-05-16 12:39:10,830 | INFO     | aborting loop
[2024-05-16 14:39:24] 2024-05-16 12:39:10,996 | INFO     | all job control threads have been joined
[2024-05-16 14:39:24] 2024-05-16 12:39:11,731 | INFO     | all data control threads have been joined
[2024-05-16 14:39:24] 2024-05-16 12:39:11,830 | INFO     | [job] retrieve thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:11,834 | INFO     | all payload control threads have been joined
[2024-05-16 14:39:24] 2024-05-16 12:39:11,837 | INFO     | [job] job monitor thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:12,003 | INFO     | [job] control thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:12,503 | INFO     | [job] validate thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:12,523 | INFO     | [payload] execute_payloads thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:12,560 | WARNING  | job:queue_monitor:received graceful stop - abort after this iteration
[2024-05-16 14:39:24] 2024-05-16 12:39:12,576 | INFO     | [data] copytool_in thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:12,577 | INFO     | [job] create_data_payload thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:12,741 | INFO     | [data] control thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:12,835 | INFO     | [data] copytool_out thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:12,842 | INFO     | [payload] control thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:12,893 | INFO     | [payload] validate_pre thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:12,906 | INFO     | [payload] run_realtimelog thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:13,136 | INFO     | [payload] validate_post thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:13,206 | INFO     | [payload] failed_post thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:13,563 | INFO     | [job] queue monitor thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:14,013 | WARNING  | data:queue_monitoring:received graceful stop - abort after this iteration
[2024-05-16 14:39:24] 2024-05-16 12:39:18,030 | INFO     | [data] queue_monitor thread has finished
[2024-05-16 14:39:24] 2024-05-16 12:39:18,156 | INFO     | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 139989102516032)>', '<ExcThread(monitor, started 139988675069696)>']
[2024-05-16 14:39:24] 2024-05-16 12:39:18,886 | WARNING  | job_aborted has been set - aborting pilot monitoring
[2024-05-16 14:39:24] 2024-05-16 12:39:18,887 | INFO     | [monitor] control thread has ended
[2024-05-16 14:39:24] 2024-05-16 12:39:23,183 | INFO     | all workflow threads have been joined
[2024-05-16 14:39:24] 2024-05-16 12:39:23,183 | INFO     | end of generic workflow (traces error code: 0)
[2024-05-16 14:39:24] 2024-05-16 12:39:23,184 | INFO     | traces error code: 0
[2024-05-16 14:39:24] 2024-05-16 12:39:23,184 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2024-05-16 14:39:24] 2024-05-16 12:39:23,373 [wrapper] ==== pilot stdout END ====
[2024-05-16 14:39:24] 2024-05-16 12:39:23,393 [wrapper] ==== wrapper stdout RESUME ====
[2024-05-16 14:39:24] 2024-05-16 12:39:23,399 [wrapper] pilotpid: 59430
[2024-05-16 14:39:24] 2024-05-16 12:39:23,402 [wrapper] Pilot exit status: 0
[2024-05-16 14:39:24] 2024-05-16 12:39:23,442 [wrapper] pandaids: 6207077608
[2024-05-16 14:39:24] 2024-05-16 12:39:23,645 [wrapper] cleanup: SIGTERM to supervisor_pilot   6718 59431
[2024-05-16 14:39:24] 2024-05-16 12:39:23,649 [wrapper] Test setup, not cleaning
[2024-05-16 14:39:24] 2024-05-16 12:39:23,657 [wrapper] ==== wrapper stdout END ====
[2024-05-16 14:39:24] 2024-05-16 12:39:23,666 [wrapper] ==== wrapper stderr END ====
[2024-05-16 14:39:24] 2024-05-16 12:39:23,673 [wrapper] apfmon messages muted
[2024-05-16 14:39:24]  *** Error codes and diagnostics ***
[2024-05-16 14:39:24]     "exeErrorCode": 0,
[2024-05-16 14:39:24]     "exeErrorDiag": "",
[2024-05-16 14:39:24]     "pilotErrorCode": 0,
[2024-05-16 14:39:24]     "pilotErrorDiag": "",
[2024-05-16 14:39:24]  *** Listing of results directory ***
[2024-05-16 14:39:24] total 823972
[2024-05-16 14:39:24] -rw-r--r-- 1 boinc3 boinc    467845 May 16 02:20 pilot3.tar.gz
[2024-05-16 14:39:24] -rw-r--r-- 1 boinc3 boinc      5633 May 16 02:46 queuedata.json
[2024-05-16 14:39:24] -rwx------ 1 boinc3 boinc     32251 May 16 02:48 runpilot2-wrapper.sh
[2024-05-16 14:39:24] -rw-r--r-- 1 boinc3 boinc       100 May 16 08:24 wrapper_26015_x86_64-pc-linux-gnu
[2024-05-16 14:39:24] -rwxr-xr-x 1 boinc3 boinc      9842 May 16 08:24 run_atlas
[2024-05-16 14:39:24] -rw-r--r-- 1 boinc3 boinc       105 May 16 08:24 job.xml
[2024-05-16 14:39:24] -rw-r--r-- 2 boinc3 boinc     17537 May 16 08:24 start_atlas.sh
[2024-05-16 14:39:24] drwxrwx--x 2 boinc3 boinc       100 May 16 08:24 shared
[2024-05-16 14:39:24] -rw-r--r-- 2 boinc3 boinc    480002 May 16 08:24 input.tar.gz
[2024-05-16 14:39:24] -rw-r--r-- 1 boinc3 boinc      6684 May 16 08:24 init_data.xml
[2024-05-16 14:39:24] -rw-r--r-- 1 boinc3 boinc      8192 May 16 08:24 boinc_mmap_file
[2024-05-16 14:39:24] -rw-r--r-- 2 boinc3 boinc 600721106 May 16 08:24 EVNT.38776100._000369.pool.root.1
[2024-05-16 14:39:24] -rw-r--r-- 1 boinc3 boinc         0 May 16 08:24 boinc_lockfile
[2024-05-16 14:39:24] -rw-r--r-- 1 boinc3 boinc      2640 May 16 08:24 pandaJob.out
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc       452 May 16 08:24 setup.sh.local
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc   1010635 May 16 08:25 agis_schedconf.cvmfs.json
[2024-05-16 14:39:24] drwx------ 4 boinc3 boinc       400 May 16 08:25 pilot3
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc 233764775 May 16 14:38 HITS.38776104._009215.pool.root.1
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc        95 May 16 14:38 pilot_heartbeat.json
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc      1020 May 16 14:38 memory_monitor_summary.json
[2024-05-16 14:39:24] -rw-r--r-- 1 boinc3 boinc         0 May 16 14:38 agis_ddmendpoints.agis.ALL.json
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc   1324701 May 16 14:38 cric_ddmendpoints.json
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc    387347 May 16 14:38 log.38776104._009215.job.log.tgz.1
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc      7651 May 16 14:39 heartbeat.json
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc      4345 May 16 14:39 pilotlog.txt
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc   2492682 May 16 14:39 log.38776104._009215.job.log.1
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc       357 May 16 14:39 output.list
[2024-05-16 14:39:24] -rw-r--r-- 1 boinc3 boinc       620 May 16 14:39 runtime_log
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc   2897920 May 16 14:39 result.tar.gz
[2024-05-16 14:39:24] -rw-r--r-- 1 boinc3 boinc     11451 May 16 14:39 runtime_log.err
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc       632 May 16 14:39 7b2LDm9SeR5nsSi4apGgGQJmABFKDmABFKDm4ySLDm8zOKDmlkwNUn.diag
[2024-05-16 14:39:24] -rw-r--r-- 1 boinc3 boinc     21753 May 16 14:39 stderr.txt
[2024-05-16 14:39:24] HITS file was successfully produced:
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc 233764775 May 16 14:38 shared/HITS.pool.root.1
[2024-05-16 14:39:24]  *** Contents of shared directory: ***
[2024-05-16 14:39:24] total 818256
[2024-05-16 14:39:24] -rw-r--r-- 2 boinc3 boinc     17537 May 16 08:24 start_atlas.sh
[2024-05-16 14:39:24] -rw-r--r-- 2 boinc3 boinc    480002 May 16 08:24 input.tar.gz
[2024-05-16 14:39:24] -rw-r--r-- 2 boinc3 boinc 600721106 May 16 08:24 ATLAS.root_0
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc 233764775 May 16 14:38 HITS.pool.root.1
[2024-05-16 14:39:24] -rw------- 1 boinc3 boinc   2897920 May 16 14:39 result.tar.gz
14:39:25 (53540): run_atlas exited; CPU time 41127.447643
14:39:25 (53540): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN