Details
-
Sub-task
-
Resolution: Unresolved
-
None
-
None
-
High
-
Pipeline validation & management by steps and step-properties
-
Empty show more show less
Description
We need a better management of the (Extraction/Import)-Pipeline for a Bconf. It should be possible, to validate a Pipeline step by step and make sure, that the 3 mandatory steps (RawDocumentToFilterEventsStep, SegmentationStep, ExtractionStep) are present. Additional Steps should be allowed. The SegmentationStep and ExtractionStep should be additionally compared against a seperate Step-Properties-File (application/modules/editor/Plugins/Okapi/data/pipeline/step/translate5) that defines properties that must be set in the given way. These definitions are simply set or added if not present in the given way without error or feedback.
These validations should be done when importing a BCONF and uploading a pipeline. The mandatory Properties should also be set/updated if neccessary on a BCONF upgrade, due to an inceased version index (repackIfOutdated) or a general upgrade-script for the framework-version.
This should be implemented in a way (class naming), that we have the option to validate & update/upgrade export/merging pipelines as well if this becomes neccessary
- Classes for Steps in /Okapi/Bconf/Step/
- Step-Classnames equal step in Pipeline: net.sf.okapi.steps.rainbowkit.creation.ExtractionStep => ExtractionStep
- Validation per step: All steps valid -> Pipeline valid
- Integrate Pipeline into general "versioned upgrade" mechanism like SRX and FPRM
- [Perspectively: Frontend shall make steps editable & addable]