Add retry setting for failed LLM batch pre-translation requests

XMLWordPrintable

      Problem

      For TQE, we already have a setting to retry failed LLM requests:
      runtimeOptions->plugins->OpenAI->qualityScoreSegmentCheckMaxRetries
      We need the same behavior for batch pre-translation.

      Solution

      Add a system-level config that defines how many times a failed LLM request should be tried again during batch pre-translation.
      In the best case, this retry logic should be handled in the lower-level LLM client. Then both TQE and batch pre-translation can use the same retry logic for failed LLM requests.

            Assignee:
            Aleksandar Mitrev
            Reporter:
            Aleksandar Mitrev
            None
            None
            Aleksandar Mitrev
            Stephan Bergmann, Sylvia Schumacher
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              None
              None