1. 20 Jun, 2020 1 commit
  2. 18 Jun, 2020 1 commit
    • Fabien Viale's avatar
      Optimize JobData and TaskData queries · 4acab84c
      Fabien Viale authored
       - discontinue support of pa.scheduler.job.removeFromDataBase=false, which implied executing joined tables queries constantly (decreases performance and disallow some indexing)
       - add 3 indexes in JobData (submit_time, scheduled_time_for_removal, and job_id_status : composite index used to optimize scheduler portal default list jobs query)
       - getTaskCounts : avoid joined table query by considering only task statuses.
       - getFinishedTaskCount : fix incomplete list of finished task statuses
       - getPendingTaskCount : add in-error status (similar to pause)
       - adapt db tests
       - add owner column in TaskData to avoid join
       - initialize TaskData.owner using JobData.owner when recovering an existing database
       - TaskData : replace task.jobData.id by task.id.jobId to avoid implicit cross join
       - TaskDBUtils : supress removeTime usage and replace jobData.owner by taskData.owner
       - BaseServiceTest : add SQL debug info
       - MockSchedulingInfrastructure : print unexpected exceptions
      4acab84c
  3. 17 Jun, 2020 2 commits
  4. 15 Jun, 2020 2 commits
    • Fabien Viale's avatar
      Merge pull request #3771 from fviale/master · 2c18b2b2
      Fabien Viale authored
      MemoryLeak: do not keep finished jobs state in memory
      2c18b2b2
    • Fabien Viale's avatar
      MemoryLeak: do not keep finished jobs state in memory · 10d828e1
      Fabien Viale authored
       - SchedulerStateImpl : use a maximum size for finished jobs. As test is using the getState method a lot, it is necessary to keep some retro-compatibility. The default number of jobs kept in SchedulerStateImpl is 1000, but can be configured through a JVM property.
       - SchedulerFrontendState : delete job from jobsMap when the job is finished.
      10d828e1
  5. 11 Jun, 2020 2 commits
  6. 10 Jun, 2020 2 commits
  7. 08 Jun, 2020 1 commit
  8. 05 Jun, 2020 3 commits
  9. 03 Jun, 2020 2 commits
    • Fabien Viale's avatar
      Merge pull request #3764 from fviale/master · 194d9855
      Fabien Viale authored
      Remove and comment recursive algorithm in InternalJob
      194d9855
    • Fabien Viale's avatar
      Remove and comment recursive algorithm in InternalJob · 57b023c1
      Fabien Viale authored
      Replaced by a simple iterative search
      
      After analysis of the code, it tries to find an InternalTask based on its name, but to do so, it does a complex  potentially exponential recursive algorithm. This code hanged a task termination on a workflow containing a loop which had around 1400 tasks.
      
      For now I comment the previous code to keep its track.
      57b023c1
  10. 27 May, 2020 3 commits
  11. 20 May, 2020 3 commits
  12. 19 May, 2020 5 commits
  13. 17 May, 2020 2 commits
  14. 16 May, 2020 1 commit
    • Fabien Viale's avatar
      Fix dataspace warnings in task logs · aec7d64e
      Fabien Viale authored
      Warnings or errors when transferring files using dataspaces used to appear in task logs but these logs disappeared (regression).
      This commit fixes the issue.
      Addressed reviews
      aec7d64e
  15. 15 May, 2020 2 commits
  16. 14 May, 2020 1 commit
  17. 13 May, 2020 1 commit
  18. 12 May, 2020 3 commits
  19. 11 May, 2020 1 commit
  20. 07 May, 2020 1 commit
  21. 06 May, 2020 1 commit