The posts display correctly in Permalink Settings is set to “Plain”. However there is a “Not Found The requested URL was not found on this server.” message is permalink setting is set to “Post name”.
Solution:
<Directory /path/to/wordpress/goes/here>
AllowOverride All
</Directory>