Why increasing VM doesn’t has any impact on performance?

I have changed the virtual memory of my system to 4GB. It was 2GB and it's 4GB now. I was expecting an increased performance but I didn't get that anyway. The performance of my core system is quite the same and so is the case with multimedia applications. Will there be a performance uplift if I increase the VM more?
