Uploaded image for project: 'translate5'
  1. translate5
  2. TRANSLATE-4205

Delayed worker leads to slow import for small tasks

    XMLWordPrintable

Details

    • Medium
    • Smaller tasks were running to long due delayed termtagger workers, this is fixed.

    Description

      problem

      With TRANSLATE-4056 the delayed worker state was introduced to solve the proper parallel running of spellcheck and termtagger and better handling of not responding external services (also spellcheck and termtagger).

      In conjunction with small tasks (segment count < batch size of spellcheck / termtagger) this leads to workers in status delayed - waiting to the next cron call and so preventing a fast import for such small tasks.

      solution

      Set the \MittagQI\Translate5\Segment\Processing\Looper::BLOCKED_DELAY value to a smaller one - so that worker is delayed to be called immediately.

      Additional we should only start multiple pooled workers of the same type if there are more segments as can be processed by one run.

      Attachments

        Issue Links

          Activity

            People

              tlauria Thomas Lauria
              marcmittag Marc Mittag [Administrator]
              Aleksandar Mitrev
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: