Entering the Settings tab I upload an image for the category of contacts (see bl-1 attachment). But after I save the settings the image can not be displayed on the website (see bl-2 attachment).
That's because they were not implemented to be shown there. At least that it what I read in joomla documentation. You will have to ask joomla developers about the way how to extend contact category page to show images.