Fix CLI script (#2562)

5 jobs for v2.0 in 9 minutes and 25 seconds (queued for 11 seconds)