cache affects memory I/O reg. When using peripherals you want memory accesses to happen in a certain order (mostly because of hardware constraints) so you want to avoid reordering. This is exactly what you would expect cache to do; temporarily store instructions and perform optimizations by grouping/reordering. You might get unexpected errors because of this.