Issues with brightness settings in nexus 5

Hi everyone,
I am having Google Nexus 5 and it is working fine.
But one problem I am facing is with the auto brightness. When I am outside, it is reducing the screen brightness but during daytime when I go out I am not able to see anything if it reduce the brightness. Also, sometimes, when I switch off the lights, it is reducing the brightness. This is not correct. In fact it has to increase the brightness that time.
Is this the problem with all Nexus 5 phones or only I am facing the issue? How can I change the settings so that it corrects the brightness properly? Please kindly advise.
