Task: 399840 (regular)

id (api)399840
typeregular
slurm jobs (api)jobs for task 399840 {'finished': 7}
priority 100
statusfinished
workflow 29 - aggregated_compress_pipeline
 inputs    outputs    metrics Quality  
filterlt10_010-aa-comp
source location (inputs)
target location (processing)srm.grid.sara.nl
projectlt10_010
activity (API) + status 657122, finished
specification (API) -
creationTime2025-04-15 11:43:01
purge_policyyes
cleanup_policydefining
resumeTrue
is_summaryFalse
stage_request_id788086
dataproducts3
size_to_process177.3 GB
size_processed49.0 GB
total_processing_time18336
qualitymoderate
calculated qualities{'per_task': ['poor']}
remarks{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

servicestepstatustimestampcpu_cycleswall_clock_timelog
ARCHIVERSuccessfinished05-02-2025, 09:43:29None79227
ARCHIVERcleaningfinishing05-02-2025, 09:43:08None79206
ARCHIVERSuccessarchived05-02-2025, 09:43:07None79205
ARCHIVERingestedarchiving05-02-2025, 09:42:50None79188
ARCHIVERsubmittingarchiving05-02-2025, 09:22:50None77988
ARCHIVERsubmittingarchiving05-02-2025, 09:22:48None77986
ARCHIVERsubmittingarchiving05-02-2025, 09:22:47None77985
ARCHIVERNAarchived_failed04-23-2025, 13:47:56None7494Task is too long in archiving state
ARCHIVERsubmittingarchiving04-23-2025, 13:28:35None6333
ARCHIVERsubmittingarchiving04-23-2025, 13:28:34None6332
ARCHIVERsubmittingarchiving04-23-2025, 13:28:33None6331
ARCHIVERauto_recoverypre_archived04-23-2025, 13:27:59None6297Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 13:27:58None6296Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 13:27:57None6295Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-23-2025, 13:07:23None5061
ARCHIVERsubmittingarchiving04-23-2025, 13:07:21None5059
ARCHIVERsubmittingarchiving04-23-2025, 13:07:19None5057
ARCHIVERauto_recoverypre_archived04-23-2025, 13:06:49None5027Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 13:06:48None5026Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 13:06:47None5025Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-22-2025, 16:34:31None17489
ARCHIVERsubmittingarchiving04-22-2025, 16:34:30None17488
ARCHIVERsubmittingarchiving04-22-2025, 16:34:29None17487
PREARCHIVERSIP createdpre_archived04-22-2025, 16:34:06None17464
PREARCHIVERsubmittingpre_archiving04-22-2025, 16:33:20None17418
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:22:29None85167HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:22:28None85166
STAGERSTAGERscrubbed04-22-2025, 11:11:53None84531
STAGERSTAGERscrubbing04-22-2025, 11:11:33None84511
DATAMANAGERcopy_finishedstored04-18-2025, 17:53:14None22212
DATAMANAGERcopy_issuedstoring04-18-2025, 17:49:55None22013
DATAMANAGERissuing_copyingstoring04-18-2025, 17:49:34None21992
AGGREGATORcollected H5processed04-18-2025, 17:48:57None21955
AGGREGATORcollect_h5aggregating04-18-2025, 17:48:56None21954
EXECUTORrunningprocessed04-18-2025, 17:48:47None18336None
EXECUTORrunningprocessing04-18-2025, 17:05:22None19340logfile
DATAMANAGERcopy_skippedfetched04-18-2025, 17:04:41None19299
STAGERSTAGERstaged04-18-2025, 17:04:21None19279None
STAGERSTAGERstaging04-18-2025, 08:57:48None76486None