Name J37MDmYX72tnlyackoJh5iwnABFKDmABFKDmlQbRDmABFKDmY7L2No_0
Workunit 106038218
Created 14 Jan 2019, 2:52:40 UTC
Sent 14 Jan 2019, 3:57:29 UTC
Report deadline 22 Jan 2019, 3:57:29 UTC
Received 14 Jan 2019, 4:44:59 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 10559972
Run time 8 min 22 sec
CPU time 19 sec
Validate state Valid
Credit 58.82
Device peak FLOPS 12.68 GFLOPS
Application version ATLAS Simulation v2.54 (native_mt)
x86_64-pc-linux-gnu
Peak working set size 64.88 MB
Peak swap size 406.88 MB
Peak disk usage 828.21 MB

Stderr output

<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
05:09:06 (19826): wrapper (7.7.26015): starting
05:09:06 (19826): wrapper: running run_atlas (--nthreads 8)
singularity image is /cvmfs/atlas.cern.ch/repo/images/singularity/x86_64-slc6.img
sys.argv = ['run_atlas', '--nthreads', '8']
THREADS=8
Checking for CVMFS
CVMFS is installed
OS:CentOS Linux release 7.6.1810 (Core) 

This is not SLC6, need to run with Singularity....
Checking Singularity...
Singularity is installed
copy /var/lib/boinc/slots/45/shared/ATLAS.root_0
copy /var/lib/boinc/slots/45/shared/input.tar.gz
copy /var/lib/boinc/slots/45/shared/RTE.tar.gz
copy /var/lib/boinc/slots/45/shared/start_atlas.sh
export ATHENA_PROC_NUMBER=8;start atlas job with PandaID=4208575496
Testing the function of Singularity...
check singularity with cmd:singularity exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/images/singularity/x86_64-slc6.img hostname
Singularity Works...
cmd = singularity exec --pwd /var/lib/boinc/slots/45 -B /cvmfs,/var /cvmfs/atlas.cern.ch/repo/images/singularity/x86_64-slc6.img sh start_atlas.sh > runtime_log 2> runtime_log.err
running cmd return value is 0

***********************log_extracts.txt*************************
- Last 10 lines from /var/lib/boinc/slots/45/Panda_Pilot_20199_1547438950/PandaJob/athena_stdout.txt -
Error: unable to setup default version value for asetup
Error: unable to setup default version value for rcsetup

- Walltime -
JobRetrival=1, StageIn=14, Execution=153, StageOut=0, CleanUp=47

***********************pilot_error_report.json*********************
{
    "4208575496": {
        "2": [
            {
                "pilotErrorCode": 0,
                "pilotErrorDiag": "Job failed: Non-zero failed job return code: 1"
            }
        ]
    }
}
*****************The last 100 lines of the pilot log******************
    "recoverdir": null, 
    "region": "Nordugrid", 
    "releases": null, 
    "resource_type": "cloud_special", 
    "retry": "False", 
    "se": "token:ATLASDATADISK:srm://srm.ndgf.org:8443/srm/managerv2?SFN=", 
    "sein": null, 
    "seinopt": null, 
    "seopt": "token:ATLASDATADISK:srm://srm.ndgf.org:8443/srm/managerv2?SFN=", 
    "sepath": "/atlas/disk/atlasdatadisk/rucio", 
    "seprodpath": "/atlas/disk/atlasdatadisk/rucio", 
    "setokens": "ATLASDATADISK", 
    "site": "BOINC", 
    "siteid": "BOINC_MCORE", 
    "sitershare": null, 
    "space": 0, 
    "special_par": null, 
    "stageinretry": 2, 
    "stageoutretry": 2, 
    "status": "brokeroff", 
    "statusoverride": "offline", 
    "sysconfig": "manual", 
    "system": "arc", 
    "tags": "arc", 
    "tier": "T3", 
    "timefloor": 0, 
    "tmpdir": null, 
    "transferringlimit": 20000, 
    "tspace": "2070-01-01T00:00:00", 
    "use_newmover": "True", 
    "validatedreleases": "True", 
    "version": null, 
    "wansinklimit": null, 
    "wansourcelimit": null, 
    "wnconnectivity": "full", 
    "wntmpdir": null, 
    "workflow": null
}

2019-01-14 04:09:10|20199|SiteInformat| Queuedata was successfully downloaded by pilot wrapper script
2019-01-14 04:09:10|20199|ATLASSiteInf| curl command returned valid queuedata
2019-01-14 04:09:10|20199|ATLASSiteInf| Site BOINC_MCORE is currently in brokeroff mode
2019-01-14 04:09:10|20199|ATLASSiteInf| Job recovery turned off
2019-01-14 04:09:10|20199|ATLASSiteInf| Confirmed correctly formatted rucio sepath
2019-01-14 04:09:10|20199|ATLASSiteInf| Confirmed correctly formatted rucio seprodpath
2019-01-14 04:09:10|20199|SiteInformat| Evaluating queuedata
2019-01-14 04:09:10|20199|SiteInformat| Setting unset pilot variables using queuedata
2019-01-14 04:09:10|20199|SiteInformat| appdir: 
2019-01-14 04:09:10|20199|pUtil.py    | File registration will be done by server
2019-01-14 04:09:10|20199|pUtil.py    | Updated stage-in retry number to 2
2019-01-14 04:09:10|20199|pUtil.py    | Updated stage-out retry number to 2
2019-01-14 04:09:10|20199|pUtil.py    | Detected unset (NULL) release/homepackage string
2019-01-14 04:09:10|20199|ATLASExperim| Application dir confirmed: /var/lib/boinc/slots/45/
2019-01-14 04:09:10|20199|pilot.py    | Pilot will serve experiment: Nordugrid-ATLAS
2019-01-14 04:09:10|20199|ATLASExperim| Architecture information:
2019-01-14 04:09:10|20199|ATLASExperim| Excuting command: lsb_release -a
2019-01-14 04:09:10|20199|ATLASExperim| 
sh: lsb_release: command not found
2019-01-14 04:09:10|20199|pUtil.py    | getSiteInformation: got experiment=ATLAS
2019-01-14 04:09:10|20199|ATLASExperim| appdirs = ['/cvmfs/atlas.cern.ch/repo/sw']
2019-01-14 04:09:59|20199|ATLASExperim| head of /cvmfs/atlas.cern.ch/repo/sw/ChangeLog: 
--------------------------------------------------------------------------------
head: cannot open `/cvmfs/atlas.cern.ch/repo/sw/ChangeLog' for reading: Input/output error
--------------------------------------------------------------------------------
2019-01-14 04:09:59|20199|ATLASExperim| ATLAS_PYTHON_PILOT set to /usr/bin/python
2019-01-14 04:09:59|20199|pUtil.py    | getSiteInformation: got experiment=ATLAS
2019-01-14 04:09:59|20199|ATLASExperim| Executing command: export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase;$ATLAS_LOCAL_ROOT_BASE/utilities/checkValidity.sh (time-out: 300)
2019-01-14 04:09:59|20199|pUtil.py    | Executing command: export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase;$ATLAS_LOCAL_ROOT_BASE/utilities/checkValidity.sh (protected by timed_command, timeout: 300 s)
2019-01-14 04:10:04|20199|pUtil.py    | Elapsed time: 4
2019-01-14 04:10:04|20199|ATLASExperim| Diagnostics tool has verified CVMFS
2019-01-14 04:10:04|20199|Node.py     | Collecting machine features
2019-01-14 04:10:04|20199|Node.py     | $MACHINEFEATURES not defined locally
2019-01-14 04:10:04|20199|Node.py     | $JOBFEATURES not defined locally
2019-01-14 04:10:04|20199|Node.py     | Executing command: hostname -i
2019-01-14 04:10:04|20199|Node.py     | IP number of worker node: 128.142.209.155
2019-01-14 04:10:04|20199|pUtil.py    | getSiteInformation: got experiment=Nordugrid-ATLAS
2019-01-14 04:10:04|20199|pilot.py    | Using site information for experiment: Nordugrid-ATLAS
2019-01-14 04:10:04|20199|pilot.py    | Will attempt to create workdir: /var/lib/boinc/slots/45/Panda_Pilot_20199_1547438950
2019-01-14 04:10:04|20199|pilot.py    | Creating file: /var/lib/boinc/slots/45/CURRENT_SITEWORKDIR
2019-01-14 04:10:04|20199|pUtil.py    | Wrote string "/var/lib/boinc/slots/45/Panda_Pilot_20199_1547438950" to file: /var/lib/boinc/slots/45/CURRENT_SITEWORKDIR
2019-01-14 04:10:04|20199|ATLASExperim| ATLAS_POOLCOND_PATH not set by wrapper
2019-01-14 04:10:04|20199|pilot.py    | Preparing to execute Cleaner
2019-01-14 04:10:04|20199|pilot.py    | Cleaning /var/lib/boinc/slots/45
2019-01-14 04:10:04|20199|Cleaner.py  | Cleaner initialized with clean-up limit: 2 hours
2019-01-14 04:10:04|20199|Cleaner.py  | Cleaner will scan for lost directories in verified path: /var/lib/boinc/slots/45
2019-01-14 04:10:04|20199|Cleaner.py  | Executing empty dirs clean-up, stage 1/5
2019-01-14 04:10:04|20199|Cleaner.py  | Purged 0 empty directories
2019-01-14 04:10:04|20199|Cleaner.py  | Executing work dir clean-up, stage 2/5
2019-01-14 04:10:04|20199|Cleaner.py  | Purged 0 single workDirs directories
2019-01-14 04:10:04|20199|Cleaner.py  | Executing maxed-out dirs clean-up, stage 3/5
2019-01-14 04:10:04|20199|Cleaner.py  | Purged 0 empty directories
2019-01-14 04:10:04|20199|Cleaner.py  | Executing AthenaMP clean-up, stage 4/5 <SKIPPED>
2019-01-14 04:10:04|20199|Cleaner.py  | Executing PanDA Pilot dir clean-up, stage 5/5
2019-01-14 04:10:04|20199|Cleaner.py  | Number of found job state files: 0
2019-01-14 04:10:04|20199|Cleaner.py  | No job state files were found, aborting clean-up
2019-01-14 04:10:04|20199|pilot.py    | Update frequencies:
2019-01-14 04:10:04|20199|pilot.py    | ...Processes: 300 s
2019-01-14 04:10:04|20199|pilot.py    | .......Space: 600 s
2019-01-14 04:10:04|20199|pilot.py    | ......Server: 1800 s
2019-01-14 04:10:04|20199|pUtil.py    | Timefloor set to zero in queuedata (multi-jobs disabled)
***************diag file************
runtimeenvironments=APPS/HEP/ATLAS-SITE;
Processors=1
WallTime=498.11s
KernelTime=4.89s
UserTime=18.84s
CPUUsage=4%
MaxResidentMemory=72872kB
AverageResidentMemory=0kB
AverageTotalMemory=0kB
AverageUnsharedMemory=0kB
AverageUnsharedStack=0kB
AverageSharedMemory=0kB
PageSize=4096B
MajorPageFaults=144
MinorPageFaults=639268
Swaps=0
ForcedSwitches=1660
WaitSwitches=14364
Inputs=56376
Outputs=34880
SocketReceived=0
SocketSent=0
Signals=0

nodename=Agile_Boincers@gp015-boinc-b-12.cern.ch
exitcode=0
******************************WorkDir***********************
total 423240
drwxrwx--x.  6 boinc boinc      4096 Jan 14 05:17 .
drwxrwx--x. 48 boinc boinc      4096 Jan 14 01:14 ..
-rw-------.  1 boinc boinc   7159039 Jan 14 05:12 agis_ddmendpoints.cvmfs.json
-rw-------.  1 boinc boinc      8304 Jan 14 05:12 agis_schedconf.agis.BOINC_MCORE.json
drwx------.  2 boinc boinc         6 Jan 14 05:12 .alrb
drwxr-xr-x.  3 boinc boinc        17 Jan 14 05:09 APPS
-rwx------.  1 boinc boinc      2441 Jan 14 03:52 ARCpilot
-rw-------.  1 boinc boinc       543 Jan 14 05:11 .asetup
-rw-r--r--.  1 boinc boinc         0 Jan 14 05:09 boinc_lockfile
-rw-r--r--.  1 boinc boinc      8192 Jan 14 05:16 boinc_mmap_file
-rw-r--r--.  1 boinc boinc       522 Jan 14 05:16 boinc_task_state.xml
-rw-------.  1 boinc boinc        52 Jan 14 05:10 CURRENT_SITEWORKDIR
-rw-r--r--.  1 boinc boinc 424742656 Jan 14 05:09 EVNT.16512947._000072.pool.root.1
-rw-r--r--.  1 boinc boinc      5966 Jan 14 05:09 init_data.xml
-rw-r--r--.  1 boinc boinc   1088718 Jan 14 05:09 input.tar.gz
-rw-------.  1 boinc boinc       499 Jan 14 05:17 J37MDmYX72tnlyackoJh5iwnABFKDmABFKDmlQbRDmABFKDmY7L2No.diag
-rw-------.  1 boinc boinc      1255 Jan 14 05:17 jobSmallFiles.tgz
-rw-r--r--.  1 boinc boinc       105 Jan 14 05:09 job.xml
-rw-------.  1 boinc boinc    166588 Jan 14 05:17 log.16698131._003577.job.log.1
-rw-------.  1 boinc boinc     21300 Jan 14 05:15 log.16698131._003577.job.log.tgz.1
-rw-------.  1 boinc boinc       295 Jan 14 05:16 log_extracts.txt
-rw-------.  1 boinc boinc       598 Jan 14 05:17 metadata-surl.xml
-rw-------.  1 boinc boinc       241 Jan 14 05:16 output.list
-rw-------.  1 boinc boinc        11 Jan 14 05:10 pandaIDs.out
-rw-------.  1 boinc boinc      2914 Jan 14 05:10 pandaJobData_1.out
-rw-------.  1 boinc boinc      2914 Jan 14 05:09 pandaJobData.out
-rw-------.  1 boinc boinc      1983 Jan 14 05:16 panda_node_struct.pickle
-rw-------.  1 boinc boinc       202 Jan 14 05:15 pilot_error_report.json
-rw-------.  1 boinc boinc        23 Jan 14 05:09 PILOT_INITDIR
-rw-------.  1 boinc boinc       139 Jan 14 05:17 pilotlog-last.txt
-rw-------.  1 boinc boinc     11243 Jan 14 05:10 pilotlog.txt
drwx------.  3 boinc boinc        19 Jan 14 05:12 .pki
-rw-------.  1 boinc boinc      3801 Jan 14 05:10 queuedata.json
-rw-r--r--.  1 boinc boinc      4436 Jan 14 03:51 queuedata.pilot.json
-rw-r--r--.  1 boinc boinc       606 Jan 14 05:09 RTE.tar.gz
-rwxr-xr-x.  1 boinc boinc      8356 Jan 14 05:09 run_atlas
-rw-r--r--.  1 boinc boinc       604 Jan 14 05:17 runtime_log
-rw-r--r--.  1 boinc boinc     10272 Jan 14 05:17 runtime_log.err
drwxrwx--x.  2 boinc boinc       107 Jan 14 05:17 shared
-rw-r--r--.  1 boinc boinc     14351 Jan 14 05:09 start_atlas.sh
-rw-------.  1 boinc boinc        19 Jan 14 05:10 START_TIME_4208575496
-rw-------.  1 boinc boinc         1 Jan 14 05:10 STATUSCODE
-rw-r--r--.  1 boinc boinc      8592 Jan 14 05:17 stderr.txt
-rw-------.  1 boinc boinc        46 Jan 14 05:15 workdir_size-4208575496.json
-rw-r--r--.  1 boinc boinc       100 Jan 14 05:09 wrapper_26015_x86_64-pc-linux-gnu
-rw-r--r--.  1 boinc boinc        23 Jan 14 05:16 wrapper_checkpoint.txt
running start_atlas return value is 0
Parent exit 0
child process exit 0
05:17:26 (19826): run_atlas exited; CPU time 19.345396
05:17:26 (19826): called boinc_finish(0)

</stderr_txt>
]]>


©2024 CERN