At some point, Apple made TextEdit start with an Open dialog. This is annoying if you use TextEdit as a quick way to jot down notes (like I do).
The workaround for this is a simple Terminal command. Paste this into Terminal, hit enter, then restart TextEdit:
defaults write -g NSShowAppCentricOpenPanelInsteadOfUntitledFile -bool false