Stderr output

<core_client_version>7.6.33</core_client_version>
<![CDATA[
<stderr_txt>
2019-01-16 16:05:14 (15984): vboxwrapper (7.7.26196): starting
2019-01-16 16:05:16 (15984): Error creating VirtualBox instance! rc = 0x80004002
2019-01-16 16:05:16 (15984): Feature: Checkpoint interval offset (119 seconds)
2019-01-16 16:05:16 (15984): Detected: VirtualBox VboxManage Interface (Version: 5.2.6)
2019-01-16 16:05:16 (15984): Detected: Minimum checkpoint interval (900.000000 seconds)
2019-01-16 16:05:16 (15984): Successfully copied 'init_data.xml' to the shared directory.
2019-01-16 16:05:19 (15984): Create VM. (boinc_ed01d463bb2d3cb6, slot#1)
2019-01-16 16:05:21 (15984): Setting Memory Size for VM. (5700MB)
2019-01-16 16:05:22 (15984): Setting CPU Count for VM. (3)
2019-01-16 16:05:22 (15984): Setting Chipset Options for VM.
2019-01-16 16:05:23 (15984): Setting Boot Options for VM.
2019-01-16 16:05:24 (15984): Setting Network Configuration for NAT.
2019-01-16 16:05:24 (15984): Enabling VM Network Access.
2019-01-16 16:05:25 (15984): Disabling USB Support for VM.
2019-01-16 16:05:25 (15984): Disabling COM Port Support for VM.
2019-01-16 16:05:26 (15984): Disabling LPT Port Support for VM.
2019-01-16 16:05:27 (15984): Disabling Audio Support for VM.
2019-01-16 16:05:27 (15984): Disabling Clipboard Support for VM.
2019-01-16 16:05:28 (15984): Disabling Drag and Drop Support for VM.
2019-01-16 16:05:28 (15984): Adding storage controller(s) to VM.
2019-01-16 16:05:29 (15984): Adding virtual disk drive to VM. (vm_image.vdi)
2019-01-16 16:05:30 (15984): Adding VirtualBox Guest Additions to VM.
2019-01-16 16:05:30 (15984): Adding network bandwidth throttle group to VM. (Defaulting to 1024GB)
2019-01-16 16:05:31 (15984): forwarding host port 64712 to guest port 80
2019-01-16 16:05:31 (15984): Enabling remote desktop for VM.
2019-01-16 16:05:32 (15984): Required extension pack not installed, remote desktop not enabled.
2019-01-16 16:05:32 (15984): Enabling shared directory for VM.
2019-01-16 16:05:37 (15984): 
    BOINC will be notified that it needs to clean up the environment.
    This is a temporary problem and so this job will be rescheduled for another time.

2019-01-16 16:08:13 (11020): vboxwrapper (7.7.26196): starting
2019-01-16 16:08:13 (11020): Error creating VirtualBox instance! rc = 0x80004002
2019-01-16 16:08:13 (11020): Feature: Checkpoint interval offset (72 seconds)
2019-01-16 16:08:13 (11020): Detected: VirtualBox VboxManage Interface (Version: 5.2.6)
2019-01-16 16:08:14 (11020): Detected: Minimum checkpoint interval (900.000000 seconds)
2019-01-16 16:08:14 (11020): Starting VM. (boinc_ed01d463bb2d3cb6, slot#1)
2019-01-16 16:08:24 (11020): Successfully started VM. (PID = '6304')
2019-01-16 16:08:24 (11020): Reporting VM Process ID to BOINC.
2019-01-16 16:08:34 (11020): Guest Log: BIOS: VirtualBox 5.2.6
2019-01-16 16:08:34 (11020): Guest Log: CPUID EDX: 0x178bfbff
2019-01-16 16:08:34 (11020): Guest Log: BIOS: ata0-0: PCHS=16383/16/63 LCHS=1024/255/63
2019-01-16 16:08:34 (11020): Guest Log: BIOS: Boot : bseqnr=1, bootseq=0032
2019-01-16 16:08:34 (11020): Guest Log: BIOS: Booting from Hard Disk...
2019-01-16 16:08:34 (11020): Guest Log: BIOS: KBD: unsupported int 16h function 03
2019-01-16 16:08:34 (11020): Guest Log: BIOS: AX=0305 BX=0000 CX=0000 DX=0000 
2019-01-16 16:08:35 (11020): VM state change detected. (old = 'poweroff', new = 'running')
2019-01-16 16:08:55 (11020): Preference change detected
2019-01-16 16:08:55 (11020): Setting CPU throttle for VM. (40%)
2019-01-16 16:08:55 (11020): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 180 seconds) or (Vbox_job.xml: 900 seconds))
2019-01-16 16:09:05 (11020): Guest Log: vboxguest: major 0, IRQ 20, I/O port d020, MMIO at 00000000f0400000 (size 0x400000)
2019-01-16 16:09:16 (11020): Guest Log: VBoxGuest: VBoxGuestCommonGuestCapsAcquire: pSession(0xffff880177039c10), OR(0x0), NOT(0xffffffff), flags(0x0)
2019-01-16 16:09:16 (11020): Guest Log: VBoxGuest: VBoxGuestCommonGuestCapsAcquire: pSession(0xffff8801753a2e10), OR(0x0), NOT(0xffffffff), flags(0x0)
2019-01-16 16:09:16 (11020): Guest Log: VBoxGuest: VBoxGuestCommonGuestCapsAcquire: pSession(0xffff880177039210), OR(0x0), NOT(0xffffffff), flags(0x0)
2019-01-16 16:09:16 (11020): Guest Log: VBoxGuest: VBoxGuestCommonGuestCapsAcquire: pSession(0xffff880177038e10), OR(0x0), NOT(0xffffffff), flags(0x0)
2019-01-16 16:09:27 (11020): VM state change detected. (old = 'running', new = 'paused')
2019-01-16 16:09:37 (11020): VM state change detected. (old = 'paused', new = 'running')
2019-01-16 16:11:09 (11020): Guest Log: Copying input files into RunAtlas.
2019-01-16 16:11:30 (11020): Guest Log: Copied input files into RunAtlas.
2019-01-16 16:13:23 (11020): Stopping VM.
2019-01-16 16:13:42 (11020): Successfully stopped VM.
2019-01-16 16:18:18 (5764): vboxwrapper (7.7.26196): starting
2019-01-16 16:18:18 (5764): Error creating VirtualBox instance! rc = 0x80004002
2019-01-16 16:18:18 (5764): Feature: Checkpoint interval offset (237 seconds)
2019-01-16 16:18:18 (5764): Detected: VirtualBox VboxManage Interface (Version: 5.2.6)
2019-01-16 16:18:19 (5764): Detected: Minimum checkpoint interval (900.000000 seconds)
2019-01-16 16:18:19 (5764): Starting VM. (boinc_ed01d463bb2d3cb6, slot#1)
2019-01-16 16:18:32 (5764): Successfully started VM. (PID = '15064')
2019-01-16 16:18:32 (5764): Reporting VM Process ID to BOINC.
2019-01-16 16:18:42 (5764): VM state change detected. (old = 'poweroff', new = 'running')
2019-01-16 16:18:52 (5764): Guest Log: copied the webapp to /var/www
2019-01-16 16:18:52 (5764): Guest Log: This vm does not need to setup http proxy
2019-01-16 16:18:52 (5764): Guest Log: ATHENA_PROC_NUMBER=3
2019-01-16 16:18:52 (5764): Guest Log: Starting ATLAS job. (PandaID=4211884901 taskID=16578977)
2019-01-16 16:19:02 (5764): Preference change detected
2019-01-16 16:19:02 (5764): Setting CPU throttle for VM. (40%)
2019-01-16 16:19:03 (5764): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 180 seconds) or (Vbox_job.xml: 900 seconds))
2019-01-16 16:20:56 (5764): Stopping VM.
2019-01-16 16:21:17 (5764): Successfully stopped VM.
2019-01-16 16:34:04 (11920): vboxwrapper (7.7.26196): starting
2019-01-16 16:34:04 (11920): Error creating VirtualBox instance! rc = 0x80004002
2019-01-16 16:34:05 (11920): Feature: Checkpoint interval offset (29 seconds)
2019-01-16 16:34:05 (11920): Detected: VirtualBox VboxManage Interface (Version: 5.2.6)
2019-01-16 16:34:05 (11920): Detected: Minimum checkpoint interval (900.000000 seconds)
2019-01-16 16:34:06 (11920): Starting VM. (boinc_ed01d463bb2d3cb6, slot#1)
2019-01-16 16:34:19 (11920): Successfully started VM. (PID = '17816')
2019-01-16 16:34:19 (11920): Reporting VM Process ID to BOINC.
2019-01-16 16:34:29 (11920): VM state change detected. (old = 'poweroff', new = 'running')
2019-01-16 16:34:49 (11920): Preference change detected
2019-01-16 16:34:49 (11920): Setting CPU throttle for VM. (40%)
2019-01-16 16:34:50 (11920): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 180 seconds) or (Vbox_job.xml: 900 seconds))
2019-01-16 16:37:56 (11920): VM state change detected. (old = 'running', new = 'paused')
2019-01-16 16:38:06 (11920): VM state change detected. (old = 'paused', new = 'running')
2019-01-16 16:39:07 (11920): Preference change detected
2019-01-16 16:39:07 (11920): Setting CPU throttle for VM. (40%)
2019-01-16 16:39:08 (11920): Setting checkpoint interval to 900 seconds. (Higher value of (Preference: 180 seconds) or (Vbox_job.xml: 900 seconds))
2019-01-16 16:52:59 (11920): Guest Log: log_extracts:
2019-01-16 16:52:59 (11920): Guest Log: - Last 10 lines from /home/atlas01/RunAtlas/Panda_Pilot_3492_1547648341/PandaJob/athena_stdout.txt -
2019-01-16 16:52:59 (11920): Guest Log: PyJobTransforms.trfExe.preExecute 2019-01-16 16:41:07,213 INFO Batch/grid running - command outputs will not be echoed. Logs for EVNTtoHITS are in log.EVNTtoHITS
2019-01-16 16:52:59 (11920): Guest Log: PyJobTransforms.trfExe.preExecute 2019-01-16 16:41:07,221 INFO Now writing wrapper for substep executor EVNTtoHITS
2019-01-16 16:52:59 (11920): Guest Log: PyJobTransforms.trfExe._writeAthenaWrapper 2019-01-16 16:41:07,222 INFO Valgrind not engaged
2019-01-16 16:52:59 (11920): Guest Log: PyJobTransforms.trfExe.preExecute 2019-01-16 16:41:07,223 INFO Athena will be executed in a subshell via ['./runwrapper.EVNTtoHITS.sh']
2019-01-16 16:52:59 (11920): Guest Log: PyJobTransforms.trfExe.execute 2019-01-16 16:41:07,223 INFO Starting execution of EVNTtoHITS (['./runwrapper.EVNTtoHITS.sh'])
2019-01-16 16:52:59 (11920): Guest Log: PyJobTransforms.trfExe.execute 2019-01-16 16:49:07,253 INFO EVNTtoHITS executor returns 33
2019-01-16 16:52:59 (11920): Guest Log: PyJobTransforms.trfExe.validate 2019-01-16 16:49:08,247 ERROR Validation of return code failed: Non-zero return code from EVNTtoHITS (33) (Error code 65)
2019-01-16 16:52:59 (11920): Guest Log: PyJobTransforms.trfExe.validate 2019-01-16 16:49:08,363 INFO Scanning logfile log.EVNTtoHITS for errors
2019-01-16 16:52:59 (11920): Guest Log: PyJobTransforms.transform.execute 2019-01-16 16:49:08,477 CRITICAL Transform executor raised TransformValidationException: Non-zero return code from EVNTtoHITS (33); Logfile error in log.EVNTtoHITS: "IOVDbSvc            FATAL Conditions database connection COOLOFL_TRT/OFLP200 cannot be opened - STOP"
2019-01-16 16:52:59 (11920): Guest Log: PyJobTransforms.transform.execute 2019-01-16 16:49:12,428 WARNING Transform now exiting early with exit code 65 (Non-zero return code from EVNTtoHITS (33); Logfile error in log.EVNTtoHITS: "IOVDbSvc            FATAL Conditions database connection COOLOFL_TRT/OFLP200 cannot be opened - STOP")
2019-01-16 16:52:59 (11920): Guest Log: - Walltime -
2019-01-16 16:52:59 (11920): Guest Log: JobRetrival=2, StageIn=134, Execution=776, StageOut=0, CleanUp=70
2019-01-16 16:52:59 (11920): Guest Log: The last 10 lines of the pilot log.
2019-01-16 16:52:59 (11920): Guest Log:       <lfn name="log.16578977._067668.job.log.tgz.1"/>
2019-01-16 16:52:59 (11920): Guest Log:     </logical>
2019-01-16 16:52:59 (11920): Guest Log:     <metadata att_name="surl" att_value="srm://srm.ndgf.org:8443/srm/managerv2?SFN=/atlas/disk/atlasdatadisk/rucio/mc16_13TeV/49/9e/log.16578977._067668.job.log.tgz.1"/>
2019-01-16 16:52:59 (11920): Guest Log:     <metadata att_name="fsize" att_value="69642"/>
2019-01-16 16:52:59 (11920): Guest Log:     <metadata att_name="adler32" att_value="d33a2061"/>
2019-01-16 16:52:59 (11920): Guest Log:   </File>
2019-01-16 16:52:59 (11920): Guest Log: </POOLFILECATALOG>
2019-01-16 16:52:59 (11920): Guest Log: ---------
2019-01-16 16:52:59 (11920): Guest Log: output list
2019-01-16 16:52:59 (11920): Guest Log: log.16578977._067668.job.log.tgz.1 srm://srm.ndgf.org:8443;autodir=no;spacetoken=ATLASDATADISK/srm/managerv2?SFN=/atlas/disk/atlasdatadisk/rucio/mc16_13TeV/49/9e/log.16578977._067668.job.log.tgz.1:checksumtype=adler32:checksumvalue=d33a2061
2019-01-16 16:52:59 (11920): Guest Log: No HITS file was produced
2019-01-16 16:52:59 (11920): Guest Log: total 402920
2019-01-16 16:52:59 (11920): Guest Log: -rw-r--r-- 1 atlas01 atlas01      4436 Jan 16 07:11 queuedata.pilot.json
2019-01-16 16:52:59 (11920): Guest Log: -rwx------ 1 atlas01 atlas01      2441 Jan 16 07:11 ARCpilot
2019-01-16 16:52:59 (11920): Guest Log: -rwxr-xr-x 1 atlas01 atlas01 397952062 Jan 16 16:10 EVNT.16513490._001443.pool.root.1
2019-01-16 16:52:59 (11920): Guest Log: -rwxr-xr-x 1 atlas01 atlas01      9698 Jan 16 16:10 init_data.xml
2019-01-16 16:52:59 (11920): Guest Log: -rwxr-xr-x 1 atlas01 atlas01   1088718 Jan 16 16:10 input.tar.gz
2019-01-16 16:52:59 (11920): Guest Log: -rwxr-xr-x 1 atlas01 atlas01       605 Jan 16 16:10 RTE.tar.gz
2019-01-16 16:52:59 (11920): Guest Log: -rwxr-xr-x 1 atlas01 atlas01     14291 Jan 16 16:10 start_atlas.sh
2019-01-16 16:52:59 (11920): Guest Log: drwxr-xr-x 3 atlas01 atlas01      4096 Jan 16 16:18 APPS
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01      2926 Jan 16 16:18 pandaJobData.out
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01        22 Jan 16 16:18 PILOT_INITDIR
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01        50 Jan 16 16:20 CURRENT_SITEWORKDIR
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01     11430 Jan 16 16:20 pilotlog.txt
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01         1 Jan 16 16:20 STATUSCODE
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01        11 Jan 16 16:20 pandaIDs.out
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01        19 Jan 16 16:20 START_TIME_4211884901
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01      3801 Jan 16 16:20 queuedata.json
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01      2926 Jan 16 16:20 pandaJobData_1.out
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01   7147327 Jan 16 16:36 agis_ddmendpoints.cvmfs.json
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01   5404870 Jan 16 16:36 agis_schedconf.cvmfs.json
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01       298 Jan 16 16:49 memory_monitor_summary.json
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01       203 Jan 16 16:49 pilot_error_report.json
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01        82 Jan 16 16:50 workdir_size-4211884901.json
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01     69642 Jan 16 16:50 log.16578977._067668.job.log.tgz.1
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01       241 Jan 16 16:51 output.list
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01      1757 Jan 16 16:51 log_extracts.txt
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01     12143 Jan 16 16:51 panda_node_struct.pickle
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01       137 Jan 16 16:52 pilotlog-last.txt
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01       598 Jan 16 16:52 metadata-surl.xml
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01    219063 Jan 16 16:52 log.16578977._067668.job.log.1
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01      4184 Jan 16 16:52 jobSmallFiles.tgz
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01       493 Jan 16 16:52 3msLDmwes3tnyYickojUe11pABFKDmABFKDmWFnWDmABFKDmBcldyn.diag
2019-01-16 16:52:59 (11920): Guest Log: -rw-r--r-- 1 atlas01 atlas01     10034 Jan 16 16:52 runtime_log.err
2019-01-16 16:52:59 (11920): Guest Log: -rw-r--r-- 1 atlas01 atlas01       604 Jan 16 16:52 runtime_log
2019-01-16 16:52:59 (11920): Guest Log: -rw------- 1 atlas01 atlas01    522240 Jan 16 16:52 result.tar.gz
2019-01-16 16:52:59 (11920): Guest Log: Successfully finished the ATLAS job!
2019-01-16 16:52:59 (11920): Guest Log: Copying the results back to the shared directory!
2019-01-16 16:52:59 (11920): Guest Log: Copied the result file back to the shared directory and created atlas_done file!
2019-01-16 16:52:59 (11920): Guest Log: Success! Shutting down the machine.
2019-01-16 16:52:59 (11920): VM Completion File Detected.
2019-01-16 16:52:59 (11920): Powering off VM.
2019-01-16 16:53:00 (11920): Successfully stopped VM.
2019-01-16 16:53:00 (11920): Deregistering VM. (boinc_ed01d463bb2d3cb6, slot#1)
2019-01-16 16:53:00 (11920): Removing network bandwidth throttle group from VM.
2019-01-16 16:53:00 (11920): Removing storage controller(s) from VM.
2019-01-16 16:53:00 (11920): Removing VM from VirtualBox.
2019-01-16 16:53:01 (11920): Removing virtual disk drive from VirtualBox.
16:53:06 (11920): called boinc_finish(0)

</stderr_txt>
]]>

©2025 CERN