Name | MS1NDmCYNP7n9Rq4apOajLDm4fhM0noT9bVoFjIUDmO22KDmICqxHn_0 |
Workunit | 231663653 |
Created | 16 Apr 2025, 19:27:28 UTC |
Sent | 16 Apr 2025, 22:39:46 UTC |
Report deadline | 24 Apr 2025, 22:39:46 UTC |
Received | 17 Apr 2025, 1:42:14 UTC |
Server state | Over |
Outcome | Success |
Client state | Done |
Exit status | 0 (0x00000000) |
Computer ID | 10853270 |
Run time | 3 hours 1 min 9 sec |
CPU time | 11 hours 2 min 12 sec |
Validate state | Valid |
Credit | 707.21 |
Device peak FLOPS | 20.17 GFLOPS |
Application version | ATLAS Simulation v3.01 (native_mt) x86_64-pc-linux-gnu |
Peak working set size | 2.48 GB |
Peak swap size | 21.83 GB |
Peak disk usage | 620.01 MB |
<core_client_version>8.0.4</core_client_version> <![CDATA[ <stderr_txt> 23:40:03 (706994): wrapper (7.7.26015): starting 23:40:03 (706994): wrapper: running run_atlas (--nthreads 4) [2025-04-16 23:40:03] Arguments: --nthreads 4 [2025-04-16 23:40:03] Threads: 4 [2025-04-16 23:40:03] Checking for CVMFS [2025-04-16 23:40:03] Probing /cvmfs/atlas.cern.ch... OK [2025-04-16 23:40:03] Probing /cvmfs/atlas-condb.cern.ch... OK [2025-04-16 23:40:03] Running cvmfs_config stat atlas.cern.ch [2025-04-16 23:40:03] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE [2025-04-16 23:40:03] 2.12.7.0 6550 1693 56024 144941 3 187 2122799 4096001 11584 130560 0 12722174 99.999 574287 16300 http://s1ral-cvmfs.openhtc.io/cvmfs/atlas.cern.ch http://192.168.0.178:3128 1 [2025-04-16 23:40:03] CVMFS is ok [2025-04-16 23:40:03] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 [2025-04-16 23:40:03] Checking for apptainer binary... [2025-04-16 23:40:03] apptainer is not installed, using version from CVMFS [2025-04-16 23:40:03] Checking apptainer works with /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname [2025-04-16 23:40:03] senture-z10pe-l [2025-04-16 23:40:03] apptainer works [2025-04-16 23:40:04] Set ATHENA_PROC_NUMBER=4 [2025-04-16 23:40:04] Set ATHENA_CORE_NUMBER=4 [2025-04-16 23:40:04] Starting ATLAS job with PandaID=6604465004 [2025-04-16 23:40:04] Running command: /cvmfs/atlas.cern.ch/repo/containers/sw/apptainer/x86_64-el7/current/bin/apptainer exec -B /cvmfs,/var/lib/boinc-client/slots/9 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh [2025-04-17 02:41:08] *** The last 200 lines of the pilot log: *** [2025-04-17 02:41:08] 2025-04-17 01:40:52,956 | INFO | chi2: 4.715899566002616 [2025-04-17 02:41:08] 2025-04-17 01:40:52,957 | INFO | current chi2=4.715899566002616 (change=14.271375270325008 %) [2025-04-17 02:41:08] 2025-04-17 01:40:52,957 | INFO | right removable region: 172 [2025-04-17 02:41:08] 2025-04-17 01:40:52,957 | INFO | sum of square deviations: 1605470102.0 [2025-04-17 02:41:08] 2025-04-17 01:40:52,958 | INFO | sum of deviations: 34429973922.0 [2025-04-17 02:41:08] 2025-04-17 01:40:52,958 | INFO | mean x: 1744848792.0 [2025-04-17 02:41:08] 2025-04-17 01:40:52,958 | INFO | mean y: 2248522.075144509 [2025-04-17 02:41:08] 2025-04-17 01:40:52,958 | INFO | -- intersect: -37416759363.2509 [2025-04-17 02:41:08] 2025-04-17 01:40:52,958 | INFO | intersect: -37416759363.2509 [2025-04-17 02:41:08] 2025-04-17 01:40:52,958 | INFO | chi2: 2.7377022289046806 [2025-04-17 02:41:08] 2025-04-17 01:40:52,958 | INFO | current chi2=2.7377022289046806 (change=50.23230590080087 %) [2025-04-17 02:41:08] 2025-04-17 01:40:52,959 | INFO | sum of square deviations: 1470248962.0 [2025-04-17 02:41:08] 2025-04-17 01:40:52,959 | INFO | sum of deviations: 1992197109.000002 [2025-04-17 02:41:08] 2025-04-17 01:40:52,960 | INFO | mean x: 1744848944.5 [2025-04-17 02:41:08] 2025-04-17 01:40:52,960 | INFO | mean y: 2285112.3333333335 [2025-04-17 02:41:08] 2025-04-17 01:40:52,960 | INFO | -- intersect: -2361996796.8652563 [2025-04-17 02:41:08] 2025-04-17 01:40:52,960 | INFO | intersect: -2361996796.8652563 [2025-04-17 02:41:08] 2025-04-17 01:40:52,960 | INFO | chi2: 1.2133106936103402 [2025-04-17 02:41:08] 2025-04-17 01:40:52,960 | INFO | current chi2=1.2133106936103402 (change=55.68142215029097 %) [2025-04-17 02:41:08] 2025-04-17 01:40:52,961 | INFO | sum of square deviations: 1342841922.0 [2025-04-17 02:41:08] 2025-04-17 01:40:52,961 | INFO | sum of deviations: -9785265651.0 [2025-04-17 02:41:08] 2025-04-17 01:40:52,961 | INFO | mean x: 1744849097.0 [2025-04-17 02:41:08] 2025-04-17 01:40:52,962 | INFO | mean y: 2299001.472392638 [2025-04-17 02:41:08] 2025-04-17 01:40:52,962 | INFO | -- intersect: 12716983921.066725 [2025-04-17 02:41:08] 2025-04-17 01:40:52,962 | INFO | intersect: 12716983921.066725 [2025-04-17 02:41:08] 2025-04-17 01:40:52,962 | INFO | chi2: 0.8323520715983668 [2025-04-17 02:41:08] 2025-04-17 01:40:52,962 | INFO | current chi2=0.8323520715983668 (change=31.398274491291993 %) [2025-04-17 02:41:08] 2025-04-17 01:40:52,962 | INFO | sum of square deviations: 1223016419.5 [2025-04-17 02:41:08] 2025-04-17 01:40:52,963 | INFO | sum of deviations: -9628266108.0 [2025-04-17 02:41:08] 2025-04-17 01:40:52,964 | INFO | mean x: 1744849249.5 [2025-04-17 02:41:08] 2025-04-17 01:40:52,964 | INFO | mean y: 2298796.3924050634 [2025-04-17 02:41:08] 2025-04-17 01:40:52,964 | INFO | -- intersect: 13738723446.683115 [2025-04-17 02:41:08] 2025-04-17 01:40:52,964 | INFO | intersect: 13738723446.683115 [2025-04-17 02:41:08] 2025-04-17 01:40:52,964 | INFO | chi2: 0.832727430358473 [2025-04-17 02:41:08] 2025-04-17 01:40:52,964 | INFO | current chi2=0.832727430358473 (change=-0.04509615256743347 %) [2025-04-17 02:41:08] 2025-04-17 01:40:52,965 | INFO | left removable region: 40 [2025-04-17 02:41:08] 2025-04-17 01:40:52,965 | INFO | sum of square deviations: 713140813.0 [2025-04-17 02:41:08] 2025-04-17 01:40:52,965 | INFO | sum of deviations: 1809905197.0000005 [2025-04-17 02:41:08] 2025-04-17 01:40:52,966 | INFO | mean x: 1744849676.5 [2025-04-17 02:41:08] 2025-04-17 01:40:52,966 | INFO | mean y: 2309278.303030303 [2025-04-17 02:41:08] 2025-04-17 01:40:52,966 | INFO | -- intersect: -4426006195.882459 [2025-04-17 02:41:08] 2025-04-17 01:40:52,966 | INFO | intersect: -4426006195.882459 [2025-04-17 02:41:08] 2025-04-17 01:40:52,966 | INFO | chi2: 0.0001481767630113407 [2025-04-17 02:41:08] 2025-04-17 01:40:52,967 | INFO | -- intersect: -4426006195.882459 [2025-04-17 02:41:08] 2025-04-17 01:40:52,967 | INFO | current memory leak: 2.54 B/s (using 132 data points, chi2=0.00) [2025-04-17 02:41:08] 2025-04-17 01:40:52,967 | INFO | sufficient remaining disk space (112350724096 B) [2025-04-17 02:41:08] 2025-04-17 01:40:52,968 | INFO | .............................. [2025-04-17 02:41:08] 2025-04-17 01:40:52,968 | INFO | . Timing measurements: [2025-04-17 02:41:08] 2025-04-17 01:40:52,968 | INFO | . get job = 0 s [2025-04-17 02:41:08] 2025-04-17 01:40:52,968 | INFO | . initial setup = 1 s [2025-04-17 02:41:08] 2025-04-17 01:40:52,969 | INFO | . payload setup = 6 s [2025-04-17 02:41:08] 2025-04-17 01:40:52,969 | INFO | . stage-in = 0 s [2025-04-17 02:41:08] 2025-04-17 01:40:52,969 | INFO | . payload execution = 10806 s [2025-04-17 02:41:08] 2025-04-17 01:40:52,969 | INFO | . stage-out = 1 s [2025-04-17 02:41:08] 2025-04-17 01:40:52,969 | INFO | . log creation = 0 s [2025-04-17 02:41:08] 2025-04-17 01:40:52,969 | INFO | .............................. [2025-04-17 02:41:08] 2025-04-17 01:40:52,969 | INFO | work directory size check will use 2537553920 B as a max limit (10% grace limit added) [2025-04-17 02:41:08] 2025-04-17 01:40:53,057 | INFO | size of work directory /var/lib/boinc-client/slots/9/PanDA_Pilot-6604465004: 2611703 B (within 2537553920 B limit) [2025-04-17 02:41:08] 2025-04-17 01:40:53,058 | INFO | pfn file=/var/lib/boinc-client/slots/9/PanDA_Pilot-6604465004/HITS.44075483._044822.pool.root.1 does not exist (skip from workdir size calculation) [2025-04-17 02:41:08] 2025-04-17 01:40:53,058 | INFO | total size of present files: 0 B (workdir size: 2611703 B) [2025-04-17 02:41:08] 2025-04-17 01:40:53,058 | INFO | output file size check: skipping output file /var/lib/boinc-client/slots/9/PanDA_Pilot-6604465004/HITS.44075483._044822.pool.root.1 since it does not exist [2025-04-17 02:41:08] 2025-04-17 01:40:53,355 | INFO | number of running child processes to parent process 728165: 1 [2025-04-17 02:41:08] 2025-04-17 01:40:53,355 | INFO | maximum number of monitored processes: 6 [2025-04-17 02:41:08] 2025-04-17 01:40:53,355 | INFO | aborting job monitoring since job object (job id=6604465004) has expired [2025-04-17 02:41:08] 2025-04-17 01:40:53,388 | INFO | [2025-04-17 02:41:08] 2025-04-17 01:40:53,388 | INFO | job summary report [2025-04-17 02:41:08] 2025-04-17 01:40:53,388 | INFO | -------------------------------------------------- [2025-04-17 02:41:08] 2025-04-17 01:40:53,388 | INFO | PanDA job id: 6604465004 [2025-04-17 02:41:08] 2025-04-17 01:40:53,388 | INFO | task id: 44075483 [2025-04-17 02:41:08] 2025-04-17 01:40:53,388 | INFO | errors: (none) [2025-04-17 02:41:08] 2025-04-17 01:40:53,388 | INFO | status: LOG_TRANSFER = DONE [2025-04-17 02:41:08] 2025-04-17 01:40:53,388 | INFO | pilot state: finished [2025-04-17 02:41:08] 2025-04-17 01:40:53,388 | INFO | transexitcode: 0 [2025-04-17 02:41:08] 2025-04-17 01:40:53,388 | INFO | exeerrorcode: 0 [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | exeerrordiag: [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | exitcode: 0 [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | exitmsg: OK [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | cpuconsumptiontime: 39099 s [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | nevents: 400 [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | neventsw: 0 [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | pid: 728165 [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | pgrp: 728165 [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | corecount: 4 [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | event service: False [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | sizes: {0: 2416487, 1: 2417350, 6: 2417556, 12: 2417584, 10817: 2446271, 10818: 2455410, 10823: 2455524} [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | -------------------------------------------------- [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | [2025-04-17 02:41:08] 2025-04-17 01:40:53,389 | INFO | executing command: ls -lF /var/lib/boinc-client/slots/9 [2025-04-17 02:41:08] 2025-04-17 01:40:53,415 | INFO | queue jobs had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,415 | INFO | queue payloads had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,415 | INFO | queue data_in had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,416 | INFO | queue data_out had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,416 | INFO | queue current_data_in had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,416 | INFO | queue validated_jobs had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,416 | INFO | queue validated_payloads had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,416 | INFO | queue monitored_payloads had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,416 | INFO | queue finished_jobs had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,416 | INFO | queue finished_payloads had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,416 | INFO | queue finished_data_in had 1 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,416 | INFO | queue finished_data_out had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,416 | INFO | queue failed_jobs had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,416 | INFO | queue failed_payloads had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,416 | INFO | queue failed_data_in had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,417 | INFO | queue failed_data_out had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,417 | INFO | queue completed_jobs had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,417 | INFO | queue completed_jobids has 1 job(s) [2025-04-17 02:41:08] 2025-04-17 01:40:53,417 | INFO | queue realtimelog_payloads had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,417 | INFO | queue messages had 0 job(s) [purged] [2025-04-17 02:41:08] 2025-04-17 01:40:53,417 | INFO | job 6604465004 has completed (purged errors) [2025-04-17 02:41:08] 2025-04-17 01:40:53,417 | INFO | overall cleanup function is called [2025-04-17 02:41:08] 2025-04-17 01:40:54,425 | INFO | --- collectZombieJob: --- 10, [728165] [2025-04-17 02:41:08] 2025-04-17 01:40:54,425 | INFO | zombie collector waiting for pid 728165 [2025-04-17 02:41:08] 2025-04-17 01:40:54,425 | INFO | harmless exception when collecting zombies: [Errno 10] No child processes [2025-04-17 02:41:08] 2025-04-17 01:40:54,426 | INFO | collected zombie processes [2025-04-17 02:41:08] 2025-04-17 01:40:54,426 | INFO | will attempt to kill all subprocesses of pid=728165 [2025-04-17 02:41:08] 2025-04-17 01:40:54,714 | INFO | process IDs to be killed: [728165] (in reverse order) [2025-04-17 02:41:08] 2025-04-17 01:40:54,854 | WARNING | found no corresponding commands to process id(s) [2025-04-17 02:41:08] 2025-04-17 01:40:54,854 | INFO | Do not look for orphan processes in BOINC jobs [2025-04-17 02:41:08] 2025-04-17 01:40:54,862 | INFO | did not find any defunct processes belonging to 728165 [2025-04-17 02:41:08] 2025-04-17 01:40:54,871 | INFO | did not find any defunct processes belonging to 728165 [2025-04-17 02:41:08] 2025-04-17 01:40:54,871 | INFO | ready for new job [2025-04-17 02:41:08] 2025-04-17 01:40:54,871 | INFO | pilot has finished with previous job - re-establishing logging [2025-04-17 02:41:08] 2025-04-17 01:40:54,873 | INFO | ************************************** [2025-04-17 02:41:08] 2025-04-17 01:40:54,873 | INFO | *** PanDA Pilot version 3.10.2.2 *** [2025-04-17 02:41:08] 2025-04-17 01:40:54,873 | INFO | ************************************** [2025-04-17 02:41:08] 2025-04-17 01:40:54,873 | INFO | [2025-04-17 02:41:08] 2025-04-17 01:40:54,876 | INFO | pilot is running in a VM [2025-04-17 02:41:08] 2025-04-17 01:40:54,876 | INFO | architecture information: [2025-04-17 02:41:08] 2025-04-17 01:40:54,877 | INFO | executing command: cat /etc/os-release [2025-04-17 02:41:08] 2025-04-17 01:40:54,897 | INFO | cat /etc/os-release: [2025-04-17 02:41:08] NAME="CentOS Linux" [2025-04-17 02:41:08] VERSION="7 (Core)" [2025-04-17 02:41:08] ID="centos" [2025-04-17 02:41:08] ID_LIKE="rhel fedora" [2025-04-17 02:41:08] VERSION_ID="7" [2025-04-17 02:41:08] PRETTY_NAME="CentOS Linux 7 (Core)" [2025-04-17 02:41:08] ANSI_COLOR="0;31" [2025-04-17 02:41:08] CPE_NAME="cpe:/o:centos:centos:7" [2025-04-17 02:41:08] HOME_URL="https://www.centos.org/" [2025-04-17 02:41:08] BUG_REPORT_URL="https://bugs.centos.org/" [2025-04-17 02:41:08] [2025-04-17 02:41:08] CENTOS_MANTISBT_PROJECT="CentOS-7" [2025-04-17 02:41:08] CENTOS_MANTISBT_PROJECT_VERSION="7" [2025-04-17 02:41:08] REDHAT_SUPPORT_PRODUCT="centos" [2025-04-17 02:41:08] REDHAT_SUPPORT_PRODUCT_VERSION="7" [2025-04-17 02:41:08] [2025-04-17 02:41:08] 2025-04-17 01:40:54,898 | INFO | ************************************** [2025-04-17 02:41:08] 2025-04-17 01:40:55,401 | INFO | executing command: df -mP /var/lib/boinc-client/slots/9 [2025-04-17 02:41:08] 2025-04-17 01:40:55,421 | INFO | sufficient remaining disk space (112352821248 B) [2025-04-17 02:41:08] 2025-04-17 01:40:55,421 | WARNING | since timefloor is set to 0, pilot was only allowed to run one job [2025-04-17 02:41:08] 2025-04-17 01:40:55,421 | INFO | current server update state: UPDATING_FINAL [2025-04-17 02:41:08] 2025-04-17 01:40:55,421 | INFO | update_server=False [2025-04-17 02:41:08] 2025-04-17 01:40:55,421 | WARNING | setting graceful_stop since proceed_with_getjob() returned False (pilot will end) [2025-04-17 02:41:08] 2025-04-17 01:40:55,422 | WARNING | aborting monitor loop since graceful_stop has been set (timing out remaining threads) [2025-04-17 02:41:08] 2025-04-17 01:40:55,422 | INFO | found 0 job(s) in 20 queues [2025-04-17 02:41:08] 2025-04-17 01:40:55,422 | WARNING | pilot monitor received instruction that args.graceful_stop has been set [2025-04-17 02:41:08] 2025-04-17 01:40:55,422 | WARNING | will wait for a maximum of 300 s for threads to finish [2025-04-17 02:41:08] 2025-04-17 01:40:55,572 | INFO | all data control threads have been joined [2025-04-17 02:41:08] 2025-04-17 01:40:55,858 | WARNING | job monitor detected an abort_job request (signal=args.signal) [2025-04-17 02:41:08] 2025-04-17 01:40:55,864 | WARNING | cannot recover job monitoring - aborting pilot [2025-04-17 02:41:08] 2025-04-17 01:40:55,864 | WARNING | job:job_monitor:received graceful stop - abort after this iteration [2025-04-17 02:41:08] 2025-04-17 01:40:55,864 | INFO | will abort loop [2025-04-17 02:41:08] 2025-04-17 01:40:56,273 | WARNING | data:copytool_out:received graceful stop - abort after this iteration [2025-04-17 02:41:08] 2025-04-17 01:40:56,373 | INFO | all payload control threads have been joined [2025-04-17 02:41:08] 2025-04-17 01:40:56,425 | INFO | [job] retrieve thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:56,428 | INFO | [payload] execute_payloads thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:56,573 | INFO | [data] control thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:56,672 | INFO | [data] copytool_in thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:56,870 | INFO | [job] job monitor thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:57,015 | INFO | [payload] failed_post thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:57,019 | INFO | all job control threads have been joined [2025-04-17 02:41:08] 2025-04-17 01:40:57,286 | INFO | [job] validate thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:57,369 | INFO | [payload] validate_post thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:57,374 | INFO | [payload] control thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:57,542 | INFO | [job] create_data_payload thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:57,763 | INFO | [payload] validate_pre thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:57,915 | INFO | [payload] run_realtimelog thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:58,025 | INFO | [job] control thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:58,068 | WARNING | job:queue_monitor:received graceful stop - abort after this iteration [2025-04-17 02:41:08] 2025-04-17 01:40:58,277 | INFO | [data] copytool_out thread has finished [2025-04-17 02:41:08] 2025-04-17 01:40:58,854 | WARNING | data:queue_monitoring:received graceful stop - abort after this iteration [2025-04-17 02:41:08] 2025-04-17 01:40:59,073 | INFO | [job] queue monitor thread has finished [2025-04-17 02:41:08] 2025-04-17 01:41:02,860 | INFO | [data] queue_monitor thread has finished [2025-04-17 02:41:08] 2025-04-17 01:41:03,374 | INFO | only monitor.control thread still running - safe to abort: ['<_MainThread(MainThread, started 131366957352768)>', '<ExcThread(monitor, started 131366557554432)>'] [2025-04-17 02:41:08] 2025-04-17 01:41:03,461 | WARNING | job_aborted has been set - aborting pilot monitoring [2025-04-17 02:41:08] 2025-04-17 01:41:03,461 | INFO | [monitor] control thread has ended [2025-04-17 02:41:08] 2025-04-17 01:41:08,375 | INFO | all workflow threads have been joined [2025-04-17 02:41:08] 2025-04-17 01:41:08,375 | INFO | end of generic workflow (traces error code: 0) [2025-04-17 02:41:08] 2025-04-17 01:41:08,376 | INFO | traces error code: 0 [2025-04-17 02:41:08] 2025-04-17 01:41:08,376 | INFO | pilot has finished (exit code=0, shell exit code=0) [2025-04-17 02:41:08] 2025-04-17 01:41:08,531 [wrapper] ==== pilot stdout END ==== [2025-04-17 02:41:08] 2025-04-17 01:41:08,534 [wrapper] ==== wrapper stdout RESUME ==== [2025-04-17 02:41:08] 2025-04-17 01:41:08,537 [wrapper] pilotpid: 713701 [2025-04-17 02:41:08] 2025-04-17 01:41:08,540 [wrapper] Pilot exit status: 0 [2025-04-17 02:41:08] 2025-04-17 01:41:08,551 [wrapper] pandaids: 6604465004 [2025-04-17 02:41:08] 2025-04-17 01:41:08,615 [wrapper] cleanup supervisor_pilot 1156768 713703 [2025-04-17 02:41:08] 2025-04-17 01:41:08,619 [wrapper] Test setup, not cleaning [2025-04-17 02:41:08] 2025-04-17 01:41:08,622 [wrapper] apfmon messages muted [2025-04-17 02:41:08] 2025-04-17 01:41:08,625 [wrapper] ==== wrapper stdout END ==== [2025-04-17 02:41:08] 2025-04-17 01:41:08,635 [wrapper] ==== wrapper stderr END ==== [2025-04-17 02:41:08] *** Error codes and diagnostics *** [2025-04-17 02:41:08] "exeErrorCode": 0, [2025-04-17 02:41:08] "exeErrorDiag": "", [2025-04-17 02:41:08] "pilotErrorCode": 0, [2025-04-17 02:41:08] "pilotErrorDiag": "", [2025-04-17 02:41:08] *** Listing of results directory *** [2025-04-17 02:41:08] total 415936 [2025-04-17 02:41:08] -rw-r--r-- 1 boinc boinc 495897 Apr 16 20:16 pilot3.tar.gz [2025-04-17 02:41:08] -rw-r--r-- 1 boinc boinc 5111 Apr 16 20:23 queuedata.json [2025-04-17 02:41:08] -rwx------ 1 boinc boinc 37140 Apr 16 20:24 runpilot2-wrapper.sh [2025-04-17 02:41:08] -rw-r--r-- 1 boinc boinc 100 Apr 16 23:40 wrapper_26015_x86_64-pc-linux-gnu [2025-04-17 02:41:08] -rwxr-xr-x 1 boinc boinc 7986 Apr 16 23:40 run_atlas [2025-04-17 02:41:08] -rw-r--r-- 1 boinc boinc 105 Apr 16 23:40 job.xml [2025-04-17 02:41:08] -rw-r--r-- 1 boinc boinc 6641 Apr 16 23:40 init_data.xml [2025-04-17 02:41:08] -rw-r--r-- 2 boinc boinc 225220181 Apr 16 23:40 EVNT.44075481._001753.pool.root.1 [2025-04-17 02:41:08] -rw-r--r-- 2 boinc boinc 17569 Apr 16 23:40 start_atlas.sh [2025-04-17 02:41:08] drwxrwx--x 2 boinc boinc 4096 Apr 16 23:40 shared [2025-04-17 02:41:08] -rw-r--r-- 2 boinc boinc 508894 Apr 16 23:40 input.tar.gz [2025-04-17 02:41:08] -rw-r--r-- 1 boinc boinc 0 Apr 16 23:40 boinc_lockfile [2025-04-17 02:41:08] -rw-r--r-- 1 boinc boinc 2578 Apr 16 23:40 pandaJob.out [2025-04-17 02:41:08] -rw------- 1 boinc boinc 424 Apr 16 23:40 setup.sh.local [2025-04-17 02:41:08] -rw------- 1 boinc boinc 986560 Apr 16 23:40 agis_schedconf.cvmfs.json [2025-04-17 02:41:08] drwx------ 4 boinc boinc 4096 Apr 16 23:40 pilot3 [2025-04-17 02:41:08] -rw------- 1 boinc boinc 95 Apr 17 02:39 pilot_heartbeat.json [2025-04-17 02:41:08] -rw------- 1 boinc boinc 194251858 Apr 17 02:40 HITS.44075483._044822.pool.root.1 [2025-04-17 02:41:08] -rw-r--r-- 1 boinc boinc 531 Apr 17 02:40 boinc_task_state.xml [2025-04-17 02:41:08] -rw------- 1 boinc boinc 1031 Apr 17 02:40 memory_monitor_summary.json [2025-04-17 02:41:08] -rw------- 1 boinc boinc 1603529 Apr 17 02:40 agis_ddmendpoints.agis.ALL.json [2025-04-17 02:41:08] -rw------- 1 boinc boinc 295883 Apr 17 02:40 log.44075483._044822.job.log.tgz.1 [2025-04-17 02:41:08] -rw------- 1 boinc boinc 7689 Apr 17 02:40 heartbeat.json [2025-04-17 02:41:08] -rw-r--r-- 1 boinc boinc 8192 Apr 17 02:41 boinc_mmap_file [2025-04-17 02:41:08] -rw-r--r-- 1 boinc boinc 28 Apr 17 02:41 wrapper_checkpoint.txt [2025-04-17 02:41:08] -rw------- 1 boinc boinc 4732 Apr 17 02:41 pilotlog.txt [2025-04-17 02:41:08] -rw------- 1 boinc boinc 1003216 Apr 17 02:41 log.44075483._044822.job.log.1 [2025-04-17 02:41:08] -rw------- 1 boinc boinc 357 Apr 17 02:41 output.list [2025-04-17 02:41:08] -rw-r--r-- 1 boinc boinc 620 Apr 17 02:41 runtime_log [2025-04-17 02:41:08] -rw------- 1 boinc boinc 1320960 Apr 17 02:41 result.tar.gz [2025-04-17 02:41:08] -rw-r--r-- 1 boinc boinc 11131 Apr 17 02:41 runtime_log.err [2025-04-17 02:41:08] -rw------- 1 boinc boinc 652 Apr 17 02:41 MS1NDmCYNP7n9Rq4apOajLDm4fhM0noT9bVoFjIUDmO22KDmICqxHn.diag [2025-04-17 02:41:08] -rw-r--r-- 1 boinc boinc 21025 Apr 17 02:41 stderr.txt [2025-04-17 02:41:08] HITS file was successfully produced: [2025-04-17 02:41:08] -rw------- 1 boinc boinc 194251858 Apr 17 02:40 shared/HITS.pool.root.1 [2025-04-17 02:41:08] *** Contents of shared directory: *** [2025-04-17 02:41:08] total 411464 [2025-04-17 02:41:08] -rw-r--r-- 2 boinc boinc 225220181 Apr 16 23:40 ATLAS.root_0 [2025-04-17 02:41:08] -rw-r--r-- 2 boinc boinc 17569 Apr 16 23:40 start_atlas.sh [2025-04-17 02:41:08] -rw-r--r-- 2 boinc boinc 508894 Apr 16 23:40 input.tar.gz [2025-04-17 02:41:08] -rw------- 1 boinc boinc 194251858 Apr 17 02:40 HITS.pool.root.1 [2025-04-17 02:41:08] -rw------- 1 boinc boinc 1320960 Apr 17 02:41 result.tar.gz 02:41:10 (706994): run_atlas exited; CPU time 39496.102947 02:41:10 (706994): called boinc_finish(0) </stderr_txt> ]]>
©2025 CERN