Uploaded image for project: 'translate5'
  1. translate5
  2. TRANSLATE-1702

Multiple parallel export of the same task from the same session leads to errors

    XMLWordPrintable

Details

    • High

    Description

      problem

      Impatient users start multiple exports of the same task. This leads to multiple export workers to the same task, which wait on each other.

      This leads to non exportable other tasks and a lot of e-mails containing: 

      ZfExtended_Log on XXXX: Export folder not be found and therefore not zipped:

      reproduction

      1. Take a task where the export it self runs about 10 - 20 seconds.
      2. Start the export (original export format), should be opened in a new window in the browser
      3. go back to the translate5 tab (or press escape on the tab waiting for the download)
      4. press again export
      5. Multiple Export and Exported Workers are created

      solution

      Set the worker to defunct if the export dir does not exist.

      All other problems (possibility to start multiple exports for one session) should be handled with a redesign of the exports: provide a export window where the exports can be started. The window should contain a grid with all already done or running exports.

      reason

      For each queued export a ExportWorker and a ExportedWorker is created.

      Export request 1 created ExportWorker 1 and ExportedWorker 1

      The next Export request 2 creates ExportWorker 2 and ExportedWorker 2

      Now the ExportWorker 1 is running, all other ExportWorker for the same task has to wait until ExportWorker 1 is finished. If this is the case the ExportedWorker 1 and ExportWorker 2 are starting.

      If ExportedWorker 1 is finished, the zipped export data is send to the browser and deletes the folder where the data was exported, the ExportWorker 1 is now coming to an end, the ExportedWorker 2 tries to access the folder, but it does not exist anymore. That triggers the error emails, but the worker remains as waiting. On each next worker queue request the same email is triggered, all other exports are not started.

      Attachments

        Activity

          People

            tlauria Thomas Lauria
            tlauria Thomas Lauria
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: