We couldn't load all Actvitity tabs. Refresh the page to try again.
If the problem persists, contact your Jira admin.
Uploaded image for project: 'translate5'
  1. translate5
  2. TRANSLATE-4211

Quality estimation based on GPT and Llama3, integrated with InstantTranslate and translate5 editor

Details

    • New Feature
    • Resolution: Unresolved
    • None
    • None
    • AI

    Description

      Please ask Marc upfront, to enhance the issue description.

      So far it looks like:

      If active: All segments of a task or the InstantTranslate text field should be send to a quality estimation to the LLM in a way, that the LLM can respect the context of the segments.

      The LLM should estimate the quality of the all over text AND the quality of each segment.

      The overall quality should be displayed in the analysis of the task and in InstantTranslate below the text field and next to the file available for download.

      It should be configureable in translate5s config, at what quality level the values should be highlighted green, yellow and red.

      The segment based quality should be displayed in InstantTranslate text field in a mouse over tooltip of the segments including the colored highlight (if there are mulitple segments in the result). If there is only one segment, it should be displayed below the segment, again with the background color as defined in the config.

      In InstantTranslate text field it is important, that the quality estimation does not slow down the showing of the result. It should be requested in a separate request and as long as it did not respond, the place that will show the quality estimation result will show a turning wheel.

      In translate5's editor there will be a new column "Quality estimation" next to the match rate column. It is only available, if quality estimation is active for the task. If yes, it shows the estimation value colored by the above mentioned background color. If the user edits and saves the segment, the quality estimation of this segment is redone and afterwards the value for the segment is adjusted. It is send to the LLM including the context of the 3 previous and following segments.

      Attachments

        Issue Links

          Activity

            Loading...
            Uploaded image for project: 'translate5'
            1. translate5
            2. TRANSLATE-4211

            Quality estimation based on GPT and Llama3, integrated with InstantTranslate and translate5 editor

            Details

              • New Feature
              • Resolution: Unresolved
              • None
              • None
              • AI

              Description

                Please ask Marc upfront, to enhance the issue description.

                So far it looks like:

                If active: All segments of a task or the InstantTranslate text field should be send to a quality estimation to the LLM in a way, that the LLM can respect the context of the segments.

                The LLM should estimate the quality of the all over text AND the quality of each segment.

                The overall quality should be displayed in the analysis of the task and in InstantTranslate below the text field and next to the file available for download.

                It should be configureable in translate5s config, at what quality level the values should be highlighted green, yellow and red.

                The segment based quality should be displayed in InstantTranslate text field in a mouse over tooltip of the segments including the colored highlight (if there are mulitple segments in the result). If there is only one segment, it should be displayed below the segment, again with the background color as defined in the config.

                In InstantTranslate text field it is important, that the quality estimation does not slow down the showing of the result. It should be requested in a separate request and as long as it did not respond, the place that will show the quality estimation result will show a turning wheel.

                In translate5's editor there will be a new column "Quality estimation" next to the match rate column. It is only available, if quality estimation is active for the task. If yes, it shows the estimation value colored by the above mentioned background color. If the user edits and saves the segment, the quality estimation of this segment is redone and afterwards the value for the segment is adjusted. It is send to the LLM including the context of the 3 previous and following segments.

                Attachments

                  Issue Links

                    Activity

                      People

                        leonkiz Leon Kiz
                        marcmittag Marc Mittag [Administrator]
                        Axel Becher
                        Votes:
                        0 Vote for this issue
                        Watchers:
                        1 Start watching this issue

                        Dates

                          Created:
                          Updated:

                          People

                            leonkiz Leon Kiz
                            marcmittag Marc Mittag [Administrator]
                            Axel Becher
                            Votes:
                            0 Vote for this issue
                            Watchers:
                            1 Start watching this issue

                            Dates

                              Created:
                              Updated: