Uploaded image for project: 'translate5'
  1. translate5
  2. TRANSLATE-3058

Simplify termtagger and spellcheck workers

    XMLWordPrintable

Details

    • High
    • Hide
      translate5 - 6.0.0:
      Improvement: TermTagger Worker & SpellCheck Worker are not queued dynamically anymore but according to the configured slots & looping through segments. This reduces deadlocks & limits processes
      translate5 - 6.1.0:
      Improve behavior of Processing-State queries regarding deadlocks
      Show
      translate5 - 6.0.0: Improvement: TermTagger Worker & SpellCheck Worker are not queued dynamically anymore but according to the configured slots & looping through segments. This reduces deadlocks & limits processes translate5 - 6.1.0: Improve behavior of Processing-State queries regarding deadlocks

    Description

      problem

      currently on termtagging and spellchecking a lot of workers are produced (segment count / 5) * slotcount.

      This produces a lot of overhead and DB load in worker organization, also 5 task with 5 minutes per each import, will all be finished after 25 minutes.

      solution

      Change that, only one TermTagger/SpellCheck Worker per slot is created, and each worker loops over the available segments until all segments are done.

       

      Attachments

        There are no Sub-Tasks for this issue.

        Activity

          People

            axelbecher Axel Becher
            tlauria Thomas Lauria
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: