Task: 399879 (regular)

id (api)399879
typeregular
slurm jobs (api)jobs for task 399879 {'finished': 7}
priority 100
statusfinished
workflow 29 - aggregated_compress_pipeline
 inputs    outputs    metrics Quality  
filterlt10_010-aa-comp
source location (inputs)
target location (processing)srm.grid.sara.nl
projectlt10_010
activity (API) + status 657122, finished
specification (API) -
creationTime2025-04-15 11:43:22
purge_policyyes
cleanup_policydefining
resumeTrue
is_summaryFalse
stage_request_id788124
dataproducts3
size_to_process177.3 GB
size_processed49.0 GB
total_processing_time30568
qualitymoderate
calculated qualities{'per_task': ['poor']}
remarks{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

servicestepstatustimestampcpu_cycleswall_clock_timelog
ARCHIVERSuccessfinished05-01-2025, 18:52:24None25741
ARCHIVERcleaningfinishing05-01-2025, 18:52:06None25723
ARCHIVERSuccessarchived05-01-2025, 18:52:05None25722
ARCHIVERingestedarchiving05-01-2025, 18:51:49None25706
ARCHIVERsubmittingarchiving05-01-2025, 18:50:28None25625
ARCHIVERsubmittingarchiving05-01-2025, 18:50:27None25624
ARCHIVERsubmittingarchiving05-01-2025, 18:50:26None25623
ARCHIVERauto_recoverypre_archived05-01-2025, 18:49:56None25593Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-01-2025, 18:49:55None25592Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-01-2025, 18:49:54None25591Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-22-2025, 17:13:27None19804
ARCHIVERsubmittingarchiving04-22-2025, 17:13:25None19802
ARCHIVERsubmittingarchiving04-22-2025, 17:13:24None19801
PREARCHIVERSIP createdpre_archived04-22-2025, 17:13:12None19789
PREARCHIVERsubmittingpre_archiving04-22-2025, 17:12:25None19742
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:31:07None85664HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:31:06None85663
STAGERSTAGERscrubbed04-22-2025, 11:12:00None84517
STAGERSTAGERscrubbing04-22-2025, 11:11:40None84497
DATAMANAGERcopy_finishedstored04-18-2025, 18:51:09None25666
DATAMANAGERcopy_issuedstoring04-18-2025, 18:48:25None25502
DATAMANAGERissuing_copyingstoring04-18-2025, 18:48:09None25486
AGGREGATORcollected H5processed04-18-2025, 18:47:28None25445
AGGREGATORcollect_h5aggregating04-18-2025, 18:47:26None25443
EXECUTORrunningprocessed04-18-2025, 18:47:16None30568None
EXECUTORrunningprocessing04-18-2025, 17:43:15None21592logfile
DATAMANAGERcopy_skippedfetched04-18-2025, 17:42:41None21558
STAGERSTAGERstaged04-18-2025, 17:42:23None21540None
STAGERSTAGERstaging04-18-2025, 08:58:38None76515None

Version 2 May 2025