Name RecLDmNR04tnyYickojUe11pABFKDmABFKDm47aRDmABFKDmPtpnxn_0
Workunit 106338151
Created 19 Jan 2019, 7:41:53 UTC
Sent 19 Jan 2019, 10:21:19 UTC
Report deadline 27 Jan 2019, 10:21:19 UTC
Received 20 Jan 2019, 11:23:12 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10560000
Run time 9 min 22 sec
CPU time 19 sec
Validate state Valid
Credit 170.64
Device peak FLOPS 13.11 GFLOPS
Application version ATLAS Simulation v2.54 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 64.88 MB
Peak swap size 406.88 MB
Peak disk usage 778.15 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
12:04:24 (740): wrapper (7.7.26015): starting
12:04:24 (740): wrapper: running run_atlas (--nthreads 8)
singularity image is /cvmfs/atlas.cern.ch/repo/images/singularity/x86_64-slc6.img
sys.argv = ['run_atlas', '--nthreads', '8']
THREADS=8
Checking for CVMFS
CVMFS is installed
OS:CentOS Linux release 7.6.1810 (Core) 

This is not SLC6, need to run with Singularity....
Checking Singularity...
Singularity is installed
copy /var/lib/boinc/slots/92/shared/ATLAS.root_0
copy /var/lib/boinc/slots/92/shared/input.tar.gz
copy /var/lib/boinc/slots/92/shared/RTE.tar.gz
copy /var/lib/boinc/slots/92/shared/start_atlas.sh
export ATHENA_PROC_NUMBER=8;start atlas job with PandaID=4215841409
Testing the function of Singularity...
check singularity with cmd:singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/images/singularity/x86_64-slc6.img hostname
Singularity Works...
cmd = singularity exec --pwd /var/lib/boinc/slots/92 -B /cvmfs,/var /cvmfs/atlas.cern.ch/repo/images/singularity/x86_64-slc6.img sh start_atlas.sh > runtime_log 2> runtime_log.err
running cmd return value is 0

***********************log_extracts.txt*************************
- Last 10 lines from /var/lib/boinc/slots/92/Panda_Pilot_1140_1547982305/PandaJob/athena_stdout.txt -
Error: unable to setup default version value for asetup
Error: unable to setup default version value for rcsetup

- Walltime -
JobRetrival=1, StageIn=70, Execution=163, StageOut=0, CleanUp=54

***********************pilot_error_report.json*********************
{
    "4215841409": {
        "2": [
            {
                "pilotErrorCode": 0,
                "pilotErrorDiag": "Job failed: Non-zero failed job return code: 1"
            }
        ]
    }
}
*****************The last 100 lines of the pilot log******************
    "recoverdir": null, 
    "region": "Nordugrid", 
    "releases": null, 
    "resource_type": "cloud_special", 
    "retry": "False", 
    "se": "token:ATLASDATADISK:srm://srm.ndgf.org:8443/srm/managerv2?SFN=", 
    "sein": null, 
    "seinopt": null, 
    "seopt": "token:ATLASDATADISK:srm://srm.ndgf.org:8443/srm/managerv2?SFN=", 
    "sepath": "/atlas/disk/atlasdatadisk/rucio", 
    "seprodpath": "/atlas/disk/atlasdatadisk/rucio", 
    "setokens": "ATLASDATADISK", 
    "site": "BOINC", 
    "siteid": "BOINC_MCORE", 
    "sitershare": null, 
    "space": 0, 
    "special_par": null, 
    "stageinretry": 2, 
    "stageoutretry": 2, 
    "status": "brokeroff", 
    "statusoverride": "offline", 
    "sysconfig": "manual", 
    "system": "arc", 
    "tags": "arc", 
    "tier": "T3", 
    "timefloor": 0, 
    "tmpdir": null, 
    "transferringlimit": 20000, 
    "tspace": "2070-01-01T00:00:00", 
    "use_newmover": "True", 
    "validatedreleases": "True", 
    "version": null, 
    "wansinklimit": null, 
    "wansourcelimit": null, 
    "wnconnectivity": "full", 
    "wntmpdir": null, 
    "workflow": null
}

2019-01-20 11:05:05|1140|SiteInformat| Queuedata was successfully downloaded by pilot wrapper script
2019-01-20 11:05:05|1140|ATLASSiteInf| curl command returned valid queuedata
2019-01-20 11:05:05|1140|ATLASSiteInf| Site BOINC_MCORE is currently in brokeroff mode
2019-01-20 11:05:05|1140|ATLASSiteInf| Job recovery turned off
2019-01-20 11:05:05|1140|ATLASSiteInf| Confirmed correctly formatted rucio sepath
2019-01-20 11:05:05|1140|ATLASSiteInf| Confirmed correctly formatted rucio seprodpath
2019-01-20 11:05:05|1140|SiteInformat| Evaluating queuedata
2019-01-20 11:05:05|1140|SiteInformat| Setting unset pilot variables using queuedata
2019-01-20 11:05:05|1140|SiteInformat| appdir: 
2019-01-20 11:05:05|1140|pUtil.py    | File registration will be done by server
2019-01-20 11:05:05|1140|pUtil.py    | Updated stage-in retry number to 2
2019-01-20 11:05:05|1140|pUtil.py    | Updated stage-out retry number to 2
2019-01-20 11:05:05|1140|pUtil.py    | Detected unset (NULL) release/homepackage string
2019-01-20 11:05:05|1140|ATLASExperim| Application dir confirmed: /var/lib/boinc/slots/92/
2019-01-20 11:05:05|1140|pilot.py    | Pilot will serve experiment: Nordugrid-ATLAS
2019-01-20 11:05:05|1140|ATLASExperim| Architecture information:
2019-01-20 11:05:05|1140|ATLASExperim| Excuting command: lsb_release -a
2019-01-20 11:05:05|1140|ATLASExperim| 
sh: lsb_release: command not found
2019-01-20 11:05:05|1140|pUtil.py    | getSiteInformation: got experiment=ATLAS
2019-01-20 11:05:05|1140|ATLASExperim| appdirs = ['/cvmfs/atlas.cern.ch/repo/sw']
2019-01-20 11:05:07|1140|ATLASExperim| head of /cvmfs/atlas.cern.ch/repo/sw/ChangeLog: 
--------------------------------------------------------------------------------
head: cannot open `/cvmfs/atlas.cern.ch/repo/sw/ChangeLog' for reading: Input/output error
--------------------------------------------------------------------------------
2019-01-20 11:05:07|1140|ATLASExperim| ATLAS_PYTHON_PILOT set to /usr/bin/python
2019-01-20 11:05:07|1140|pUtil.py    | getSiteInformation: got experiment=ATLAS
2019-01-20 11:05:07|1140|ATLASExperim| Executing command: export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase;$ATLAS_LOCAL_ROOT_BASE/utilities/checkValidity.sh (time-out: 300)
2019-01-20 11:05:07|1140|pUtil.py    | Executing command: export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase;$ATLAS_LOCAL_ROOT_BASE/utilities/checkValidity.sh (protected by timed_command, timeout: 300 s)
2019-01-20 11:05:13|1140|pUtil.py    | Elapsed time: 5
2019-01-20 11:05:13|1140|ATLASExperim| Diagnostics tool has verified CVMFS
2019-01-20 11:05:13|1140|Node.py     | Collecting machine features
2019-01-20 11:05:13|1140|Node.py     | $MACHINEFEATURES not defined locally
2019-01-20 11:05:13|1140|Node.py     | $JOBFEATURES not defined locally
2019-01-20 11:05:13|1140|Node.py     | Executing command: hostname -i
2019-01-20 11:05:13|1140|Node.py     | IP number of worker node: 128.142.170.84
2019-01-20 11:05:13|1140|pUtil.py    | getSiteInformation: got experiment=Nordugrid-ATLAS
2019-01-20 11:05:13|1140|pilot.py    | Using site information for experiment: Nordugrid-ATLAS
2019-01-20 11:05:13|1140|pilot.py    | Will attempt to create workdir: /var/lib/boinc/slots/92/Panda_Pilot_1140_1547982305
2019-01-20 11:05:13|1140|pilot.py    | Creating file: /var/lib/boinc/slots/92/CURRENT_SITEWORKDIR
2019-01-20 11:05:13|1140|pUtil.py    | Wrote string "/var/lib/boinc/slots/92/Panda_Pilot_1140_1547982305" to file: /var/lib/boinc/slots/92/CURRENT_SITEWORKDIR
2019-01-20 11:05:13|1140|ATLASExperim| ATLAS_POOLCOND_PATH not set by wrapper
2019-01-20 11:05:13|1140|pilot.py    | Preparing to execute Cleaner
2019-01-20 11:05:13|1140|pilot.py    | Cleaning /var/lib/boinc/slots/92
2019-01-20 11:05:13|1140|Cleaner.py  | Cleaner initialized with clean-up limit: 2 hours
2019-01-20 11:05:13|1140|Cleaner.py  | Cleaner will scan for lost directories in verified path: /var/lib/boinc/slots/92
2019-01-20 11:05:13|1140|Cleaner.py  | Executing empty dirs clean-up, stage 1/5
2019-01-20 11:05:13|1140|Cleaner.py  | Purged 0 empty directories
2019-01-20 11:05:13|1140|Cleaner.py  | Executing work dir clean-up, stage 2/5
2019-01-20 11:05:13|1140|Cleaner.py  | Purged 0 single workDirs directories
2019-01-20 11:05:13|1140|Cleaner.py  | Executing maxed-out dirs clean-up, stage 3/5
2019-01-20 11:05:13|1140|Cleaner.py  | Purged 0 empty directories
2019-01-20 11:05:13|1140|Cleaner.py  | Executing AthenaMP clean-up, stage 4/5 <SKIPPED>
2019-01-20 11:05:13|1140|Cleaner.py  | Executing PanDA Pilot dir clean-up, stage 5/5
2019-01-20 11:05:13|1140|Cleaner.py  | Number of found job state files: 0
2019-01-20 11:05:13|1140|Cleaner.py  | No job state files were found, aborting clean-up
2019-01-20 11:05:13|1140|pilot.py    | Update frequencies:
2019-01-20 11:05:13|1140|pilot.py    | ...Processes: 300 s
2019-01-20 11:05:13|1140|pilot.py    | .......Space: 600 s
2019-01-20 11:05:13|1140|pilot.py    | ......Server: 1800 s
2019-01-20 11:05:13|1140|pUtil.py    | Timefloor set to zero in queuedata (multi-jobs disabled)
***************diag file************
runtimeenvironments=APPS/HEP/ATLAS-SITE;
Processors=1
WallTime=520.41s
KernelTime=4.92s
UserTime=18.78s
CPUUsage=4%
MaxResidentMemory=72648kB
AverageResidentMemory=0kB
AverageTotalMemory=0kB
AverageUnsharedMemory=0kB
AverageUnsharedStack=0kB
AverageSharedMemory=0kB
PageSize=4096B
MajorPageFaults=144
MinorPageFaults=650109
Swaps=0
ForcedSwitches=1490
WaitSwitches=13005
Inputs=56376
Outputs=34896
SocketReceived=0
SocketSent=0
Signals=0

nodename=Agile_Boincers@gp015-boinc-c-13.cern.ch
exitcode=0
******************************WorkDir***********************
total 397552
drwxrwx--x.   6 boinc boinc      4096 Jan 20 12:13 .
drwxrwx--x. 102 boinc boinc      4096 Jan 19 08:25 ..
-rw-------.   1 boinc boinc   7159039 Jan 20 12:06 agis_ddmendpoints.cvmfs.json
-rw-------.   1 boinc boinc      8304 Jan 20 12:07 agis_schedconf.agis.BOINC_MCORE.json
drwx------.   2 boinc boinc         6 Jan 20 12:07 .alrb
drwxr-xr-x.   3 boinc boinc        17 Jan 20 12:05 APPS
-rwx------.   1 boinc boinc      2441 Jan 19 08:41 ARCpilot
-rw-------.   1 boinc boinc       543 Jan 20 12:05 .asetup
-rw-r--r--.   1 boinc boinc         0 Jan 20 12:04 boinc_lockfile
-rw-r--r--.   1 boinc boinc      8192 Jan 20 12:13 boinc_mmap_file
-rw-r--r--.   1 boinc boinc       522 Jan 20 12:13 boinc_task_state.xml
-rw-------.   1 boinc boinc        51 Jan 20 12:05 CURRENT_SITEWORKDIR
-rw-r--r--.   1 boinc boinc 398442265 Jan 20 12:05 EVNT.16512936._000044.pool.root.1
-rw-r--r--.   1 boinc boinc      5965 Jan 20 12:04 init_data.xml
-rw-r--r--.   1 boinc boinc   1088717 Jan 20 12:05 input.tar.gz
-rw-------.   1 boinc boinc      1255 Jan 20 12:13 jobSmallFiles.tgz
-rw-r--r--.   1 boinc boinc       105 Jan 20 12:04 job.xml
-rw-------.   1 boinc boinc    162508 Jan 20 12:13 log.16745581._002187.job.log.1
-rw-------.   1 boinc boinc     20818 Jan 20 12:11 log.16745581._002187.job.log.tgz.1
-rw-------.   1 boinc boinc       294 Jan 20 12:12 log_extracts.txt
-rw-------.   1 boinc boinc       598 Jan 20 12:13 metadata-surl.xml
-rw-------.   1 boinc boinc       241 Jan 20 12:12 output.list
-rw-------.   1 boinc boinc        11 Jan 20 12:05 pandaIDs.out
-rw-------.   1 boinc boinc      2915 Jan 20 12:05 pandaJobData_1.out
-rw-------.   1 boinc boinc      2915 Jan 20 12:05 pandaJobData.out
-rw-------.   1 boinc boinc      1980 Jan 20 12:12 panda_node_struct.pickle
-rw-------.   1 boinc boinc       202 Jan 20 12:10 pilot_error_report.json
-rw-------.   1 boinc boinc        23 Jan 20 12:05 PILOT_INITDIR
-rw-------.   1 boinc boinc       137 Jan 20 12:13 pilotlog-last.txt
-rw-------.   1 boinc boinc     11165 Jan 20 12:05 pilotlog.txt
drwx------.   3 boinc boinc        19 Jan 20 12:07 .pki
-rw-------.   1 boinc boinc      3801 Jan 20 12:05 queuedata.json
-rw-r--r--.   1 boinc boinc      4436 Jan 19 08:40 queuedata.pilot.json
-rw-------.   1 boinc boinc       499 Jan 20 12:13 RecLDmNR04tnyYickojUe11pABFKDmABFKDm47aRDmABFKDmPtpnxn.diag
-rw-r--r--.   1 boinc boinc       605 Jan 20 12:05 RTE.tar.gz
-rwxr-xr-x.   1 boinc boinc      8356 Jan 20 12:04 run_atlas
-rw-r--r--.   1 boinc boinc       604 Jan 20 12:13 runtime_log
-rw-r--r--.   1 boinc boinc     10273 Jan 20 12:13 runtime_log.err
drwxrwx--x.   2 boinc boinc       107 Jan 20 12:13 shared
-rw-r--r--.   1 boinc boinc     14353 Jan 20 12:05 start_atlas.sh
-rw-------.   1 boinc boinc        19 Jan 20 12:05 START_TIME_4215841409
-rw-------.   1 boinc boinc         1 Jan 20 12:05 STATUSCODE
-rw-r--r--.   1 boinc boinc      8527 Jan 20 12:13 stderr.txt
-rw-------.   1 boinc boinc        46 Jan 20 12:11 workdir_size-4215841409.json
-rw-r--r--.   1 boinc boinc       100 Jan 20 12:04 wrapper_26015_x86_64-pc-linux-gnu
-rw-r--r--.   1 boinc boinc        23 Jan 20 12:13 wrapper_checkpoint.txt
running start_atlas return value is 0
Parent exit 0
child process exit 0
12:13:44 (740): run_atlas exited; CPU time 19.245583
12:13:44 (740): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN