It looks game rendering engine have some memory leaks itself. So you can clean up quite a bit of memory space by just changing you resolution (even by one pixel) or just change to windowed mode and then go back - actually everything that causes rendering engine to reload and cleanup will do.
Found by accident and then proven. Have fun.