Uploaded image for project: 'translate5'
  1. translate5
  2. TRANSLATE-3218

Hotfolder-based connector solution, that mimics Across hotfolder

    XMLWordPrintable

Details

    • Medium
    • Hide
      translate5 - 6.4.0
       - Several fixes, introducing an API endpoint to trigger the hotfolder check manually
      translate5 - 6.3.1
       - New AcrossHotfolder plugin that watches hotfolders for tasks, that should be created in translate5 - and re-exported to the hotfolder, once they are ready
      translate5 - 6.4.1
       - Code improvement
      Show
      translate5 - 6.4.0  - Several fixes, introducing an API endpoint to trigger the hotfolder check manually translate5 - 6.3.1  - New AcrossHotfolder plugin that watches hotfolders for tasks, that should be created in translate5 - and re-exported to the hotfolder, once they are ready translate5 - 6.4.1  - Code improvement

    Description

      General information

      A translate5 private plug-in should be able to watch a hotfolder for tasks, that should be created in translate5 - and reexported to the hotfolder, once they are ready.

      The hot-folder will be queried every 15 min with the usual translate5 cron job.

      The plug-in should be able to watch multiple hotfolders (for different connected systems each) at the same time. This is implemented by configuring one SFTP server per instance, overwritable on customerlevel. All tasks created out of files loaded via a customer specific config are associated to that customer.

      The hotfolders will be accessed via sftp by translate5.

      The instruction.xml is always the last file that is written to the folder. As soon as this is completely present, one can assume completeness.

      The list of files and reference files in the instruction.xml must be complete, otherwise there is a process error, which cannot be fixed by translate5, but must be fixed by the client. Therefore all files listed in the instruction xml must be processed by the connector - not more and not less.

      To put temporary flag files in the hotfolder by translate5 is no problem.

      There should be a config option to disable auto export if client for some cases may want to use plugin only for import

      Folder structure

      Each hotfolder contains three folders:

      • Import
        • Every folder beneath import contains the data of one project, that should be imported
        • In this project folder there is one instruction.xml file, that contains the meta-data for the project and is NOT to be translated
        • Also in this folder there may be one folder that should contain attachments. Its name is specified in the tag <attachmentfolder path="DocReferenceFiles" /> in the instruction.xml file. If this exists,
          • all contained PDF files should be used as sources for the visual of the project
          • all other files should be imported as reference files for the translate5 project
        • All other files and folders in the project folder should be imported as files, that need to be translated.
      • Export
        • Once a task of a project has finished its workflow, the translated files are exported to the export folder of the hotfolder, they came from
        • For each project a folder with the same name as the folder that was found in the import folder is created. For each task within this project folder a sub-folder with the rfc5646 short-cut of the target language is created and the translated files are placed there
      • Error
        • If an error happens on import, the project that did run into an error is moved to the folder error
      • Import-running
        • we move the project folder here during import
      •  Import-success
        • In case an import is successful, the imported folder beneath the import folder is moved to the import-success folder.

      Example structure of an import hotfolder, that containts a project to be imported:

      parentfolder

          |_Cosima

              |_Import

                  |_345993455098234875934570987234

                      |_instruction.xml

                      |_D_DFPD_INST_6_en_GB.xml

                      |_D_DFPD_INST_7_en_GB.xml

                      |_attachment

                          |_1.pdf

       

      How it looks after being moved to Import-success:

      parentfolder

          Cosima

              |_Import-success

                  |_345993455098234875934570987234

                      |_instruction.xml

                      |_D_DFPD_INST_6_en_GB.xml

                      |_D_DFPD_INST_7_en_GB.xml

                      |_attachment

                          |_1.pdf

       

      How it looks in Export Folder:

      parentfolder

          Cosima

              |_Export

                  |_345993455098234875934570987234

                                         |_ de_DE

                         |_D_DFPD_INST_6_en_GB.xml

                         |_D_DFPD_INST_7_en_GB.xml

                                         |_ ua_UA

                         |_D_DFPD_INST_6_en_GB.xml

                         |_D_DFPD_INST_7_en_GB.xml

       

      Instruction.xml

      The information in the instruction.xml is evaluated as explained in the attached instruction.xml file.

      All parameters that are mentioned there are set for the project like specified in the instruction.xml.

      In case a parameter that is optional in the instruction.xml is not present, the translate5 default is used.

      For all parameters that are not present in the instruction.xml also the translate5 default is used.

      translate5 default means system setting, client override of the system settings, file convertion settings of client or system level and same for workflow and user assignments.

      For some cases in the instruction.xml the current across-specific values need to stay for a while and therefore there needs to be a mapping configuration, that maps those across-specific values to their translate5 counterparts. Where this should be done is specified in the instruction.xml file.

      The attached instruction.xml file stems directly from an across hotfolder scenario. The only things added can be found behind [translate5-mapping] in the comments.

      Attachments

        Activity

          People

            oleksandrmikhliaiev Oleksandr Mikhliaiev
            marcmittag Marc Mittag [Administrator]
            Thomas Lauria
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: