It's possible to show a file content preview in Windows Explorer:

This option is hidden behind Organize -> Layout -> Preview Pane. The preview not only works for image files, but for all files with a preview handler installed, e.g. for Office 2007 files.