Task: 399873 (regular)

id (api)399873
typeregular
slurm jobs (api)jobs for task 399873 {'finished': 7}
priority 100
statusfinished
workflow 29 - aggregated_compress_pipeline
 inputs    outputs    metrics Quality  
filterlt10_010-aa-comp
source location (inputs)
target location (processing)srm.grid.sara.nl
projectlt10_010
activity (API) + status 657122, finished
specification (API) -
creationTime2025-04-15 11:43:19
purge_policyyes
cleanup_policydefining
resumeTrue
is_summaryFalse
stage_request_id788118
dataproducts3
size_to_process177.3 GB
size_processed49.0 GB
total_processing_time27096
qualitymoderate
calculated qualities{'per_task': ['poor']}
remarks{'quality_sasid': 'One RS with 100% data loss. Busy RFI profile, especially at high frequencies. Validated moderate to look into further.'}

Log Entries

servicestepstatustimestampcpu_cycleswall_clock_timelog
ARCHIVERSuccessfinished05-01-2025, 18:46:20None25380
ARCHIVERcleaningfinishing05-01-2025, 18:46:01None25361
ARCHIVERSuccessarchived05-01-2025, 18:46:00None25360
ARCHIVERingestedarchiving05-01-2025, 18:45:45None25345
ARCHIVERsubmittingarchiving05-01-2025, 18:44:23None25263
ARCHIVERsubmittingarchiving05-01-2025, 18:44:22None25262
ARCHIVERsubmittingarchiving05-01-2025, 18:44:21None25261
ARCHIVERauto_recoverypre_archived05-01-2025, 18:43:52None25232Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-01-2025, 18:43:51None25231Force to retry due to status FAILED retrieved from FTS
ARCHIVERauto_recoverypre_archived05-01-2025, 18:43:50None25230Force to retry due to status FAILED retrieved from FTS
ARCHIVERsubmittingarchiving04-22-2025, 17:07:42None19462
ARCHIVERsubmittingarchiving04-22-2025, 17:07:40None19460
ARCHIVERsubmittingarchiving04-22-2025, 17:07:39None19459
PREARCHIVERSIP createdpre_archived04-22-2025, 17:07:09None19429
PREARCHIVERsubmittingpre_archiving04-22-2025, 17:06:23None19383
PREARCHIVERunknown errorpre_archived_failed04-22-2025, 11:29:49None85589HTTPSConnectionPool(host='lofar.astron.nl', port=443): Max retries exceeded with url: /useradministration/user/systemlogin.do (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has
PREARCHIVERsubmittingpre_archiving04-22-2025, 11:29:47None85587
STAGERSTAGERscrubbed04-22-2025, 11:11:56None84516
STAGERSTAGERscrubbing04-22-2025, 11:11:36None84496
DATAMANAGERcopy_finishedstored04-18-2025, 19:34:56None28296
DATAMANAGERcopy_issuedstoring04-18-2025, 19:32:09None28129
DATAMANAGERissuing_copyingstoring04-18-2025, 19:31:52None28112
AGGREGATORcollected H5processed04-18-2025, 19:31:25None28085
AGGREGATORcollect_h5aggregating04-18-2025, 19:31:23None28083
EXECUTORrunningprocessed04-18-2025, 19:30:55None27096None
EXECUTORrunningprocessing04-18-2025, 18:34:18None24658logfile
DATAMANAGERcopy_skippedfetched04-18-2025, 18:33:17None24597
STAGERSTAGERstaged04-18-2025, 18:33:15None24595None
STAGERSTAGERstaging04-18-2025, 08:58:31None76511None