Uploaded image for project: 'translate5'
  1. translate5
  2. TRANSLATE-4815

MS Azure AI Foundry integeration: Allow passing of model deployment name on language resource creation

XMLWordPrintable

    • Icon: New Feature New Feature
    • Resolution: Fixed
    • translate5 - 7.29.0
    • None
    • AI
    • Medium
    • [🆕 Feature] Added capabilities to use Azure cloud as LLM without the necessary credentials to manage/deploy models. In this case, the models need to be deployed by the user

      Problem

      Some users of larger companies will want to use an existing LLM deployment in MS Azure AI Foundry instead of creating one through translate5 and train it.

      Reason: They might not get rights in Azure for model deployment and training. And for cost reasons they might want to use an existing deployment instead of training one. And go with the RAG approach for prompting instead of training.

      Solution

      Instead of selecting a model from a model list for Azure it should be possible to pass a deployment name. And in this case it should be enough to provide Azure credentials with access to use that model, but not to provide new deployments or train them.

      So configuration of Azure must be changed to allow the different usage scenarios and usage of Azure AI Foundry in language resource creation need to reflect that different usage scenarios as well.

      But even if you have rights to allow for model deployment through translate5 you should be able to pass the name of an existing deployment on language resource creation.

            axelbecher Axel Becher
            marcmittag Marc Mittag [Administrator]
            Aleksandar Mitrev, Leon Kiz
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: