Featured Image Caption makes it simple to show a caption with the featured image of a post or page. It works seamlessly with most themes, with no coding required. If you like to mess about in the code, it supports that too. For full details about the plugin and usage documentation, check out the plugin wiki on GitHub.