Details
-
Bug
-
Resolution: Fixed
-
None
-
Medium
-
Smaller tasks were running to long due delayed termtagger workers, this is fixed.
-
Empty show more show less
Description
problem
With TRANSLATE-4056 the delayed worker state was introduced to solve the proper parallel running of spellcheck and termtagger and better handling of not responding external services (also spellcheck and termtagger).
In conjunction with small tasks (segment count < batch size of spellcheck / termtagger) this leads to workers in status delayed - waiting to the next cron call and so preventing a fast import for such small tasks.
solution
Set the \MittagQI\Translate5\Segment\Processing\Looper::BLOCKED_DELAY value to a smaller one - so that worker is delayed to be called immediately.
Additional we should only start multiple pooled workers of the same type if there are more segments as can be processed by one run.
Attachments
Issue Links
- relates to
-
TRANSLATE-4056 Delayed Workers: Improve Termtagging & Spellchecking to not stop when Containers are busy
- Done