I don't think the RemoteAddressRecorder middleware is used anywhere. It doesn't seem to be used in templates or Python code. From what I can see, the only code that uses the user's remote address is the preferred currency middleware, but that doesn't use RemoteAddressRecorder.
It did get me confused when I tried to figure out why some exception occurred, so IMO it should be removed.