By default, app.config files are NOT transformed in the same way as web.config files.
But there's a fix... involving editing the project file (sigh).
Gunnar Peipmann covers the process in detail here:
http://gunnarpeipman.com/2013/11/using-web-config-transforms-with-app-config-files/