We created a new "view" and specified that it should only sort on one or two columns (i.e. by name and/or date) instead of sorting on numerous columns. The results display much quicker and the screen jumps less. Basically there were too many sort criteria and consequently the system took too long to display all the results.
Issue is not entirely resolved, but at least it is manageable now.