Using Never remember history is equivalent to always being in Firefox Private Browsing mode.
Privacy Options (click the Firefox menu, choose Options and select the Privacy & Security panel).
For more information, see:
https://support.mozilla.org/en-US/kb/private-browsing-use-firefox-without-history