-
Notifications
You must be signed in to change notification settings - Fork 38
Open
Labels
Description
a spurios "failed to retrieve file" is generated when gfal_copy contains a line with the error
string
line.find("error") != -1 or line.find("Failed") != -1 or \ |
even if the message was harmless and transfer worked OK. E.g.
TLS: Unable to create TLS context; invalid private key.
TLS: 47882433451776:error:0B080074:x509 certificate routines:X509_check_private_key:key values mismatch:crypto/x509/x509_cmp.c:303:
It is better to rely on gfal-copy exit code first. And only parse stderr in case of failure so somehow translate known messages into more clear error categories.
relevant code is in
CRABClient/src/python/CRABClient/Commands/remote_copy.py
Lines 295 to 301 in d4b4151
error = simpleOutputCheck(stderr) | |
logger.debug("Finish executing for file %s" % fileid) | |
if returncode != 0 or len(error) > 0: | |
logger.info("%sWarning%s: Failed retrieving %s" % (colors.RED, colors.NORMAL, fileid)) | |
#logger.debug(colors.RED +"Stderr: %s " %stderr+ colors.NORMAL) |
def simpleOutputCheck(outlines): |