Details

    • Sub-task
    • Resolution: Unresolved
    • None
    • None
    • file format settings
    • High
    • Pipeline validation & management by steps and step-properties

    Description

      We need a better management of the (Extraction/Import)-Pipeline for a Bconf. It should be possible, to validate a Pipeline step by step and make sure, that the 3 mandatory steps (RawDocumentToFilterEventsStep, SegmentationStep, ExtractionStep) are present. Additional Steps should be allowed. The SegmentationStep and ExtractionStep should be additionally compared against a seperate Step-Properties-File (application/modules/editor/Plugins/Okapi/data/pipeline/step/translate5) that defines properties that must be set in the given way. These definitions are simply set or added if not present in the given way without error or feedback.

      These validations should be done when importing a BCONF and uploading a pipeline. The mandatory Properties should also be set/updated if neccessary on a BCONF upgrade, due to an inceased version index (repackIfOutdated) or a general upgrade-script for the framework-version.

      This should be implemented in a way (class naming), that we have the option to validate & update/upgrade export/merging pipelines as well if this becomes neccessary

      • Classes for Steps in /Okapi/Bconf/Step/
      • Step-Classnames equal step in Pipeline: net.sf.okapi.steps.rainbowkit.creation.ExtractionStep => ExtractionStep
      • Validation per step: All steps valid -> Pipeline valid
      • Integrate Pipeline into general "versioned upgrade" mechanism like SRX and FPRM
      • [Perspectively: Frontend shall make steps editable & addable]

      Attachments

        Activity

          People

            volodymyr@mittagqi.com Volodymyr Kyianenko
            axelbecher Axel Becher
            Axel Becher
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: