Task: 399825 (regular)

id (api)399825
typeregular
slurm jobs (api)jobs for task 399825 {'finished': 7}
priority 100
statusfinished
workflow 29 - aggregated_compress_pipeline
 inputs    outputs    metrics Quality  
filterlt10_010-aa-comp
source location (inputs)
target location (processing)srm.grid.sara.nl
projectlt10_010
activity (API) + status 657122, finished
specification (API) -
creationTime2025-04-15 11:42:54
purge_policyyes
cleanup_policydefining
resumeTrue
is_summaryFalse
stage_request_id788074
dataproducts3
size_to_process177.3 GB
size_processed49.0 GB
total_processing_time27816
qualitymoderate
calculated qualities{'per_task': ['poor']}
remarks{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

servicestepstatustimestampcpu_cycleswall_clock_timelog
ARCHIVERSuccessfinished05-02-2025, 09:14:26None77491
ARCHIVERcleaningfinishing05-02-2025, 09:14:08None77473
ARCHIVERSuccessarchived05-02-2025, 09:14:07None77472
ARCHIVERingestedarchiving05-02-2025, 09:13:53None77458
ARCHIVERsubmittingarchiving05-02-2025, 09:12:44None77389
ARCHIVERsubmittingarchiving05-02-2025, 09:12:43None77388
ARCHIVERsubmittingarchiving05-02-2025, 09:12:42None77387
ARCHIVERauto_recoverypre_archived05-02-2025, 09:12:14None77359Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-02-2025, 09:12:13None77358Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-02-2025, 09:12:12None77357Force to retry due to status FAILED retrieved from FTS
ARCHIVERrestartingarchiving05-02-2025, 09:01:53None76738
ARCHIVERNAarchived_failed04-23-2025, 03:28:46None56751Task is too long in archiving state
ARCHIVERsubmittingarchiving04-23-2025, 03:28:44None56749
ARCHIVERsubmittingarchiving04-23-2025, 03:28:43None56748
ARCHIVERsubmittingarchiving04-23-2025, 03:28:42None56747
ARCHIVERauto_recoverypre_archived04-23-2025, 03:28:09None56714Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 03:28:07None56712Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 03:28:06None56711Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-23-2025, 03:07:37None55482
ARCHIVERsubmittingarchiving04-23-2025, 03:07:36None55481
ARCHIVERsubmittingarchiving04-23-2025, 03:07:34None55479
ARCHIVERauto_recoverypre_archived04-23-2025, 03:07:01None55446Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 03:06:59None55444Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 03:06:58None55443Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-23-2025, 02:46:15None54200
ARCHIVERsubmittingarchiving04-23-2025, 02:46:14None54199
ARCHIVERsubmittingarchiving04-23-2025, 02:46:12None54197
ARCHIVERauto_recoverypre_archived04-23-2025, 02:45:39None54164Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 02:45:38None54163Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived04-23-2025, 02:45:37None54162Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-22-2025, 16:19:18None16583
ARCHIVERsubmittingarchiving04-22-2025, 16:19:17None16582
ARCHIVERsubmittingarchiving04-22-2025, 16:19:15None16580
PREARCHIVERSIP createdpre_archived04-22-2025, 16:18:58None16563
PREARCHIVERsubmittingpre_archiving04-22-2025, 16:18:10None16515
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:19:08None84973HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:19:06None84971
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:13:26None84631HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:13:24None84629
STAGERSTAGERscrubbed04-22-2025, 11:10:04None84429
STAGERSTAGERscrubbing04-22-2025, 11:09:18None84383
DATAMANAGERcopy_finishedstored04-18-2025, 17:24:07None20472
DATAMANAGERcopy_issuedstoring04-18-2025, 17:20:52None20277
DATAMANAGERissuing_copyingstoring04-18-2025, 17:20:35None20260
AGGREGATORcollected H5processed04-18-2025, 17:20:10None20235
AGGREGATORcollect_h5aggregating04-18-2025, 17:20:08None20233
EXECUTORrunningprocessed04-18-2025, 17:19:56None27816None
EXECUTORrunningprocessing04-18-2025, 15:56:03None15188logfile
DATAMANAGERcopy_skippedfetched04-18-2025, 15:55:30None15155
STAGERSTAGERstaged04-18-2025, 15:55:28None15153None
STAGERSTAGERstaging04-18-2025, 08:57:35None76480None