When you use Quick Look from the Finder to preview files (mouse or arrow to the file, then press Space), a new “Open with Preview” button appears in its top toolbar for some files. Click it, and the Quick Look window morphs into the new Preview window that opens. Classy! The same happens with RTF files and, it seems, just about any files Preview supports.