WordPress is not a multi-lingual platform. At least it was not designed to support more than one language at a time. The problem was solved by developing plugins that will translate the website or the content into another language.
There are few different plugins for making a WordPress site multi-lingual. They work in different ways and some are better suited to specific needs than others.
From CPOThemes a useful guide to a multilingual WordPress.