Due to the increasing disparity between processor and main memory system cycle times, many computer systems are now incorporating two levels fo cache memory. Several studies have been done on the design and performance of second level caches, including 3 and 20. It certainly can and has been shown that the addition of a second level of cache enhances the performance of many systems.
/lp/association-for-computing-machinery/evaluating-performance-of-prefetching-second-level-caches-Jou0ntZIau