Stderr output

<core_client_version>7.7.0</core_client_version>
<![CDATA[
<stderr_txt>
21:44:34 (2230278): wrapper (7.7.26015): starting
21:44:34 (2230278): wrapper: running run_atlas (--nthreads 9)
[2024-05-20 21:44:34] Arguments: --nthreads 9
[2024-05-20 21:44:34] Threads: 9
[2024-05-20 21:44:34] Checking for CVMFS
[2024-05-20 21:44:34] Probing /cvmfs/atlas.cern.ch... OK
[2024-05-20 21:44:35] Probing /cvmfs/atlas-condb.cern.ch... OK
[2024-05-20 21:44:35] Running cvmfs_config stat atlas.cern.ch
[2024-05-20 21:44:36] VERSION PID UPTIME(M) MEM(K) REVISION EXPIRES(M) NOCATALOGS CACHEUSE(K) CACHEMAX(K) NOFDUSE NOFDMAX NOIOERR NOOPEN HITRATE(%) RX(K) SPEED(K/S) HOST PROXY ONLINE
[2024-05-20 21:44:36] 2.11.2.0 3898804 999 55920 132969 0 55 14924628 18432000 910 130560 1 5867980 99.999 135542 40400 http://cvmfs-s1.hpc.swin.edu.au:8000/cvmfs/atlas.cern.ch http://192.41.231.237:6081 1
[2024-05-20 21:44:36] CVMFS is ok
[2024-05-20 21:44:36] Efficiency of ATLAS tasks can be improved by the following measure(s):
[2024-05-20 21:44:36] The CVMFS client on this computer should be configured to use Cloudflare's openhtc.io.
[2024-05-20 21:44:36] Further information can be found at the LHC@home message board.
[2024-05-20 21:44:36] Using apptainer image /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7
[2024-05-20 21:44:36] Checking for apptainer binary...
[2024-05-20 21:44:36] Using apptainer found in PATH at /usr/bin/apptainer
[2024-05-20 21:44:36] Running /usr/bin/apptainer --version
[2024-05-20 21:44:36] apptainer version 1.2.4-1.el7
[2024-05-20 21:44:36] Checking apptainer works with /usr/bin/apptainer exec -B /cvmfs /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 hostname
[2024-05-20 21:44:37] gc-9-36.aglt2.org
[2024-05-20 21:44:37] apptainer works
[2024-05-20 21:44:37] Set ATHENA_PROC_NUMBER=9
[2024-05-20 21:44:37] Set ATHENA_CORE_NUMBER=9
[2024-05-20 21:44:37] Starting ATLAS job with PandaID=6210893646
[2024-05-20 21:44:37] Running command: /usr/bin/apptainer exec -B /cvmfs,/data/boinchome/slots/3 /cvmfs/atlas.cern.ch/repo/containers/fs/singularity/x86_64-centos7 sh start_atlas.sh
[2024-05-20 22:08:27]  *** The last 200 lines of the pilot log: ***
[2024-05-20 22:08:27]     response = self._open(req, data)
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/urllib/request.py", line 534, in _open
[2024-05-20 22:08:27]     result = self._call_chain(self.handle_open, protocol, protocol +
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/urllib/request.py", line 494, in _call_chain
[2024-05-20 22:08:27]     result = func(*args)
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/urllib/request.py", line 1389, in https_open
[2024-05-20 22:08:27]     return self.do_open(http.client.HTTPSConnection, req,
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/urllib/request.py", line 1349, in do_open
[2024-05-20 22:08:27]     raise URLError(err)
[2024-05-20 22:08:27] urllib.error.URLError: <urlopen error [Errno -2] Name or service not known>
[2024-05-20 22:08:27] 
[2024-05-20 22:08:27] During handling of the above exception, another exception occurred:
[2024-05-20 22:08:27] 
[2024-05-20 22:08:27] Traceback (most recent call last):
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/logging/__init__.py", line 1083, in emit
[2024-05-20 22:08:27]     msg = self.format(record)
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/logging/__init__.py", line 927, in format
[2024-05-20 22:08:27]     return fmt.format(record)
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/logging/__init__.py", line 663, in format
[2024-05-20 22:08:27]     record.message = record.getMessage()
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/logging/__init__.py", line 367, in getMessage
[2024-05-20 22:08:27]     msg = msg % self.args
[2024-05-20 22:08:27] TypeError: not all arguments converted during string formatting
[2024-05-20 22:08:27] Call stack:
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/threading.py", line 937, in _bootstrap
[2024-05-20 22:08:27]     self._bootstrap_inner()
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/threading.py", line 980, in _bootstrap_inner
[2024-05-20 22:08:27]     self.run()
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/common/exception.py", line 450, in run
[2024-05-20 22:08:27]     self.target(**self.kwargs)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/control/job.py", line 2568, in queue_monitor
[2024-05-20 22:08:27]     update_server(job, args)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/control/job.py", line 2611, in update_server
[2024-05-20 22:08:27]     user.update_server(job)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/user/atlas/common.py", line 2692, in update_server
[2024-05-20 22:08:27]     status = upload_file(url, new_path)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/util/https.py", line 837, in upload_file
[2024-05-20 22:08:27]     logger.warning("URL Error:", e)
[2024-05-20 22:08:27] Message: 'URL Error:'
[2024-05-20 22:08:27] Arguments: (URLError(gaierror(-2, 'Name or service not known')),)
[2024-05-20 22:08:27] --- Logging error ---
[2024-05-20 22:08:27] Traceback (most recent call last):
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/urllib/request.py", line 1346, in do_open
[2024-05-20 22:08:27]     h.request(req.get_method(), req.selector, req.data, headers,
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/http/client.py", line 1285, in request
[2024-05-20 22:08:27]     self._send_request(method, url, body, headers, encode_chunked)
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/http/client.py", line 1331, in _send_request
[2024-05-20 22:08:27]     self.endheaders(body, encode_chunked=encode_chunked)
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/http/client.py", line 1280, in endheaders
[2024-05-20 22:08:27]     self._send_output(message_body, encode_chunked=encode_chunked)
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/http/client.py", line 1040, in _send_output
[2024-05-20 22:08:27]     self.send(msg)
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/http/client.py", line 980, in send
[2024-05-20 22:08:27]     self.connect()
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/http/client.py", line 1447, in connect
[2024-05-20 22:08:27]     super().connect()
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/http/client.py", line 946, in connect
[2024-05-20 22:08:27]     self.sock = self._create_connection(
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/socket.py", line 823, in create_connection
[2024-05-20 22:08:27]     for res in getaddrinfo(host, port, 0, SOCK_STREAM):
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/socket.py", line 954, in getaddrinfo
[2024-05-20 22:08:27]     for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
[2024-05-20 22:08:27] socket.gaierror: [Errno -2] Name or service not known
[2024-05-20 22:08:27] 
[2024-05-20 22:08:27] During handling of the above exception, another exception occurred:
[2024-05-20 22:08:27] 
[2024-05-20 22:08:27] Traceback (most recent call last):
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/util/https.py", line 831, in upload_file
[2024-05-20 22:08:27]     with urllib.request.urlopen(request) as response:
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/urllib/request.py", line 214, in urlopen
[2024-05-20 22:08:27]     return opener.open(url, data, timeout)
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/urllib/request.py", line 517, in open
[2024-05-20 22:08:27]     response = self._open(req, data)
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/urllib/request.py", line 534, in _open
[2024-05-20 22:08:27]     result = self._call_chain(self.handle_open, protocol, protocol +
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/urllib/request.py", line 494, in _call_chain
[2024-05-20 22:08:27]     result = func(*args)
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/urllib/request.py", line 1389, in https_open
[2024-05-20 22:08:27]     return self.do_open(http.client.HTTPSConnection, req,
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/urllib/request.py", line 1349, in do_open
[2024-05-20 22:08:27]     raise URLError(err)
[2024-05-20 22:08:27] urllib.error.URLError: <urlopen error [Errno -2] Name or service not known>
[2024-05-20 22:08:27] 
[2024-05-20 22:08:27] During handling of the above exception, another exception occurred:
[2024-05-20 22:08:27] 
[2024-05-20 22:08:27] Traceback (most recent call last):
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/logging/__init__.py", line 1083, in emit
[2024-05-20 22:08:27]     msg = self.format(record)
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/logging/__init__.py", line 927, in format
[2024-05-20 22:08:27]     return fmt.format(record)
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/logging/__init__.py", line 663, in format
[2024-05-20 22:08:27]     record.message = record.getMessage()
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/logging/__init__.py", line 367, in getMessage
[2024-05-20 22:08:27]     msg = msg % self.args
[2024-05-20 22:08:27] TypeError: not all arguments converted during string formatting
[2024-05-20 22:08:27] Call stack:
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/threading.py", line 937, in _bootstrap
[2024-05-20 22:08:27]     self._bootstrap_inner()
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/threading.py", line 980, in _bootstrap_inner
[2024-05-20 22:08:27]     self.run()
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/common/exception.py", line 450, in run
[2024-05-20 22:08:27]     self.target(**self.kwargs)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/control/job.py", line 2568, in queue_monitor
[2024-05-20 22:08:27]     update_server(job, args)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/control/job.py", line 2611, in update_server
[2024-05-20 22:08:27]     user.update_server(job)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/user/atlas/common.py", line 2692, in update_server
[2024-05-20 22:08:27]     status = upload_file(url, new_path)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/util/https.py", line 837, in upload_file
[2024-05-20 22:08:27]     logger.warning("URL Error:", e)
[2024-05-20 22:08:27] Message: 'URL Error:'
[2024-05-20 22:08:27] Arguments: (URLError(gaierror(-2, 'Name or service not known')),)
[2024-05-20 22:08:27] 2024-05-21 02:08:10,646 | WARNING  | failed to send data to https://pilot.atlas-ml.org: response=<urlopen error [Errno -2] Name or service not known>
[2024-05-20 22:08:27] 2024-05-21 02:08:10,646 | INFO     | executing command: curl --connect-timeout 20 --max-time 120 -H "Content-Type: application/json" -X POST --upload-file /data/boinchome/slots/3/PanDA_Pilot-621089364
[2024-05-20 22:08:27] 2024-05-21 02:08:10,661 | WARNING  | exception caught: [Errno 107] Transport endpoint is not connected: '/bin/bash'
[2024-05-20 22:08:27] 2024-05-21 02:08:10,661 | INFO     | this job has now completed (state=failed)
[2024-05-20 22:08:27] 2024-05-21 02:08:10,661 | INFO     | pilot will not update the server (heartbeat message will be written to file)
[2024-05-20 22:08:27] 2024-05-21 02:08:10,662 | INFO     | job 6210893646 has failed - writing final server update
[2024-05-20 22:08:27] 2024-05-21 02:08:10,662 | WARNING  | making sure that job.state is set to failed since a pilot error code is set
[2024-05-20 22:08:27] 2024-05-21 02:08:10,662 | INFO     | payload/TRF did not report the number of read events
[2024-05-20 22:08:27] 2024-05-21 02:08:10,665 | WARNING  | command=lscpu does not exist - cannot check number of available cores
[2024-05-20 22:08:27] 2024-05-21 02:08:10,665 | INFO     | executing command: grep -o 'avx2[^ ]*\|AVX2[^ ]*' /proc/cpuinfo
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/common/exception.py", line 450, in run
[2024-05-20 22:08:27]     self.target(**self.kwargs)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/control/job.py", line 2568, in queue_monitor
[2024-05-20 22:08:27]     update_server(job, args)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/control/job.py", line 2617, in update_server
[2024-05-20 22:08:27]     send_state(job, args, job.state, metadata=metadata)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/control/job.py", line 420, in send_state
[2024-05-20 22:08:27]     data = get_data_structure(job, state, args, xml=xml, metadata=metadata)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/control/job.py", line 751, in get_data_structure
[2024-05-20 22:08:27]     instruction_sets = has_instruction_sets(['AVX2'])
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/util/auxiliary.py", line 520, in has_instruction_sets
[2024-05-20 22:08:27]     exit_code, stdout, stderr = execute(cmd)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/util/container.py", line 94, in execute
[2024-05-20 22:08:27]     process = subprocess.Popen(exe,
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/subprocess.py", line 951, in __init__
[2024-05-20 22:08:27]     self._execute_child(args, executable, preexec_fn, close_fds,
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/subprocess.py", line 1837, in _execute_child
[2024-05-20 22:08:27]     raise child_exception_type(errno_num, err_msg, err_filename)
[2024-05-20 22:08:27] exception caught by thread run() function: (<class 'OSError'>, OSError(107, 'Transport endpoint is not connected'), <traceback object at 0x7f8fec18fb80>)
[2024-05-20 22:08:27] Traceback (most recent call last):
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/common/exception.py", line 450, in run
[2024-05-20 22:08:27]     self.target(**self.kwargs)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/control/job.py", line 2568, in queue_monitor
[2024-05-20 22:08:27]     update_server(job, args)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/control/job.py", line 2617, in update_server
[2024-05-20 22:08:27]     send_state(job, args, job.state, metadata=metadata)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/control/job.py", line 420, in send_state
[2024-05-20 22:08:27]     data = get_data_structure(job, state, args, xml=xml, metadata=metadata)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/control/job.py", line 751, in get_data_structure
[2024-05-20 22:08:27]     instruction_sets = has_instruction_sets(['AVX2'])
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/util/auxiliary.py", line 520, in has_instruction_sets
[2024-05-20 22:08:27]     exit_code, stdout, stderr = execute(cmd)
[2024-05-20 22:08:27]   File "/data/boinchome/slots/3/pilot3/pilot/util/container.py", line 94, in execute
[2024-05-20 22:08:27]     process = subprocess.Popen(exe,
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/subprocess.py", line 951, in __init__
[2024-05-20 22:08:27]     self._execute_child(args, executable, preexec_fn, close_fds,
[2024-05-20 22:08:27]   File "/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/python/3.9.18-x86_64-centos7/lib/python3.9/subprocess.py", line 1837, in _execute_child
[2024-05-20 22:08:27]     raise child_exception_type(errno_num, err_msg, err_filename)
[2024-05-20 22:08:27] OSError: [Errno 107] Transport endpoint is not connected: '/bin/bash'
[2024-05-20 22:08:27] 
[2024-05-20 22:08:27] None
[2024-05-20 22:08:27] exception has been put in bucket queue belonging to thread 'queue_monitor'
[2024-05-20 22:08:27] setting graceful stop in 10 s since there is no point in continuing
[2024-05-20 22:08:27] 2024-05-21 02:08:11,459 | INFO     | waiting for thread to finish: ['<_MainThread(MainThread, started 140256316618560)>', '<ExcThread(queue_monitor, started 140255378274048)>']
[2024-05-20 22:08:27] 2024-05-21 02:08:13,469 | INFO     | waiting for thread to finish: ['<_MainThread(MainThread, started 140256316618560)>', '<ExcThread(queue_monitor, started 140255378274048)>']
[2024-05-20 22:08:27] 2024-05-21 02:08:15,479 | INFO     | waiting for thread to finish: ['<_MainThread(MainThread, started 140256316618560)>', '<ExcThread(queue_monitor, started 140255378274048)>']
[2024-05-20 22:08:27] 2024-05-21 02:08:17,489 | INFO     | waiting for thread to finish: ['<_MainThread(MainThread, started 140256316618560)>', '<ExcThread(queue_monitor, started 140255378274048)>']
[2024-05-20 22:08:27] 2024-05-21 02:08:19,500 | INFO     | waiting for thread to finish: ['<_MainThread(MainThread, started 140256316618560)>', '<ExcThread(queue_monitor, started 140255378274048)>']
[2024-05-20 22:08:27] 2024-05-21 02:08:21,511 | INFO     | caller=run is remaining thread - safe to abort (names=['<_MainThread(MainThread, started 140256316618560)>'])
[2024-05-20 22:08:27] 2024-05-21 02:08:26,536 | INFO     | all workflow threads have been joined
[2024-05-20 22:08:27] 2024-05-21 02:08:26,536 | INFO     | end of generic workflow (traces error code: 0)
[2024-05-20 22:08:27] 2024-05-21 02:08:26,537 | INFO     | traces error code: 0
[2024-05-20 22:08:27] 2024-05-21 02:08:26,537 | INFO     | pilot has finished (exit code=0, shell exit code=0)
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 15: date: command not found
[2024-05-20 22:08:27]  ==== pilot stdout END ====
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 15: date: command not found
[2024-05-20 22:08:27]  ==== wrapper stdout RESUME ====
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 15: date: command not found
[2024-05-20 22:08:27]  pilotpid: 2242946
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 15: date: command not found
[2024-05-20 22:08:27]  Pilot exit status: 0
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 949: /usr/bin/cat: Transport endpoint is not connected
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 949: xargs: command not found
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 949: cut: command not found
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 15: date: command not found
[2024-05-20 22:08:27]  pandaids: 
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 501: ps: command not found
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 15: date: command not found
[2024-05-20 22:08:27]  No supervise_pilot CHILD process found
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 15: date: command not found
[2024-05-20 22:08:27]  Test setup, not cleaning
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 15: date: command not found
[2024-05-20 22:08:27]  ==== wrapper stdout END ====
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 10: date: command not found
[2024-05-20 22:08:27]  ==== wrapper stderr END ====
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 522: date: command not found
[2024-05-20 22:08:27] ./runpilot2-wrapper.sh: line 15: date: command not found
[2024-05-20 22:08:27]  apfmon messages muted
[2024-05-20 22:08:27]  *** Error codes and diagnostics ***
[2024-05-20 22:08:27]  *** Listing of results directory ***
[2024-05-20 22:08:27] total 592312
[2024-05-20 22:08:27] -rw-r--r-- 1 boincer umatlas    467845 May 20 18:44 pilot3.tar.gz
[2024-05-20 22:08:27] -rwx------ 1 boincer umatlas     32308 May 20 18:50 runpilot2-wrapper.sh
[2024-05-20 22:08:27] -rw-r--r-- 1 boincer umatlas      5633 May 20 18:50 queuedata.json
[2024-05-20 22:08:27] -rw-r--r-- 1 boincer umatlas       100 May 20 21:44 wrapper_26015_x86_64-pc-linux-gnu
[2024-05-20 22:08:27] -rwxr-xr-x 1 boincer umatlas      7986 May 20 21:44 run_atlas
[2024-05-20 22:08:27] -rw-r--r-- 1 boincer umatlas       105 May 20 21:44 job.xml
[2024-05-20 22:08:27] -rw-r--r-- 1 boincer umatlas      9212 May 20 21:44 init_data.xml
[2024-05-20 22:08:27] -rw-r--r-- 2 boincer umatlas 602686508 May 20 21:44 EVNT.38776100._000956.pool.root.1
[2024-05-20 22:08:27] -rw-r--r-- 2 boincer umatlas     17537 May 20 21:44 start_atlas.sh
[2024-05-20 22:08:27] drwxrwx--x 2 boincer umatlas      4096 May 20 21:44 shared
[2024-05-20 22:08:27] -rw-r--r-- 2 boincer umatlas    479993 May 20 21:44 input.tar.gz
[2024-05-20 22:08:27] -rw-r--r-- 1 boincer umatlas         0 May 20 21:44 boinc_lockfile
[2024-05-20 22:08:27] -rw-r--r-- 1 boincer umatlas      2643 May 20 21:44 pandaJob.out
[2024-05-20 22:08:27] -rw------- 1 boincer umatlas       461 May 20 21:44 setup.sh.local
[2024-05-20 22:08:27] -rw------- 1 boincer umatlas   1014363 May 20 21:46 agis_schedconf.cvmfs.json
[2024-05-20 22:08:27] -rw------- 1 boincer umatlas         0 May 20 21:46 agis_ddmendpoints.agis.ALL.json
[2024-05-20 22:08:27] -rw------- 1 boincer umatlas   1324701 May 20 21:46 cric_ddmendpoints.json
[2024-05-20 22:08:27] drwx------ 4 boincer umatlas      4096 May 20 21:46 pilot3
[2024-05-20 22:08:27] -rw------- 1 boincer umatlas       733 May 20 21:49 heartbeat.json
[2024-05-20 22:08:27] -rw------- 1 boincer umatlas        95 May 20 22:05 pilot_heartbeat.json
[2024-05-20 22:08:27] -rw------- 1 boincer umatlas      1031 May 20 22:05 memory_monitor_summary.json
[2024-05-20 22:08:27] -rw-r--r-- 1 boincer umatlas       528 May 20 22:05 boinc_task_state.xml
[2024-05-20 22:08:27] drwxrwx--- 2 boincer umatlas      4096 May 20 22:08 PanDA_Pilot-6210893646
[2024-05-20 22:08:27] -rw------- 1 boincer umatlas    136394 May 20 22:08 pilotlog.txt
[2024-05-20 22:08:27] -rw------- 1 boincer umatlas    201620 May 20 22:08 log.38776104._030752.job.log.1
[2024-05-20 22:08:27] -rw-r--r-- 1 boincer umatlas       428 May 20 22:08 runtime_log
[2024-05-20 22:08:27] -rw-r--r-- 1 boincer umatlas     11290 May 20 22:08 runtime_log.err
[2024-05-20 22:08:27] -rw------- 1 boincer umatlas       617 May 20 22:08 jdcNDmW1QT5n9Rq4apoT9bVoABFKDmABFKDmlqFKDmc7NKDmRutu3m.diag
[2024-05-20 22:08:27] -rw-r--r-- 1 boincer umatlas      8192 May 20 22:08 boinc_mmap_file
[2024-05-20 22:08:27] -rw-r--r-- 1 boincer umatlas        25 May 20 22:08 wrapper_checkpoint.txt
[2024-05-20 22:08:27] -rw-r--r-- 1 boincer umatlas     21644 May 20 22:08 stderr.txt
[2024-05-20 22:08:27] No HITS result produced
[2024-05-20 22:08:27]  *** Contents of shared directory: ***
[2024-05-20 22:08:27] total 589060
[2024-05-20 22:08:27] -rw-r--r-- 2 boincer umatlas 602686508 May 20 21:44 ATLAS.root_0
[2024-05-20 22:08:27] -rw-r--r-- 2 boincer umatlas     17537 May 20 21:44 start_atlas.sh
[2024-05-20 22:08:27] -rw-r--r-- 2 boincer umatlas    479993 May 20 21:44 input.tar.gz
22:08:29 (2230278): run_atlas exited; CPU time 178.882242
22:08:29 (2230278): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>jdcNDmW1QT5n9Rq4apoT9bVoABFKDmABFKDmlqFKDmc7NKDmRutu3m_0_r1034312408_ATLAS_result</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>

©2024 CERN