You can now translate Wikipedia articles from Spanish into Basque, thanks to an open source machine learning tool

Translate This Post

The Comb of the Wind is a collection of sculptures integrated in the coastal landscape of the Basque country. “Present” is seen here. Sculpture by Eduardo Chillida, arranged by Luis Peña Ganchegui; Photo by Turismo Gipuzkoa, CC BY-SA 2.0.

The content translation tool makes it easier for Wikipedia editors to translate articles. It has been used to create more than 280,000 translations across Wikipedias in dozens of languages.
For some languages, the tool automatically translates articles for editors, who then can improve the content. These automatic translations are provided by machine translation services. You may have used some of these services from your browser or as translation apps when trying to make sense of a foreign sign, translating a social media comment, or trying to access a website that is not available in your language.
Machine translation services use software to automatically translate a text into another language, in this complex process they may use information about the language structure and vocabulary, a large set of examples of sentences in those languages, machine learning techniques or some combination of these and other approaches.
We recently added support to automatically translate articles from Spanish to Basque using Matxin, an open source translation engine created at the University of the Basque Country. We believe that the integration of Matxin will increase the quality and quantity of material available in the Basque Wikipedia: before Matxin was integrated, about one thousand articles were translated into Basque with the content translation tool. Half of these articles were translated from into Basque from Spanish. Now that the tool is available, editors can automatically translate material from Spanish into Basque using Matxin, which will make it easier for them to add new material to the Basque Wikipedia.
Content translation showing the automatic translation option card (“Itzulpen automatikoa” in Basque) with the Matxin option.

How we partnered with the Matxin team

The content translation tool was designed so that new extensions could be integrated as they became available, allowing the platform to support more automatic translations between languages.
The Matxin integration is one such example, and has been a great partnership between the Matxin team and the Language team from the Wikimedia Foundation. The Matxin team from the University of the Basque Country and Elhuyar Foundation developed a client to integrate their machine translation service in content translation, and contacted the Language team for further guidance. After several iterations of code review, legal review of licenses, and testing, the client was ready for deployment. With this integration, the constant effort of the Matxin team to improve their translation service will be immediately available to Wikipedia editors.
The integration of Matxin respects user privacy and content license: no user data is shared with external services, and the translated content is generated under a free license to enable its integration into Wikipedia. In addition, the results of the translations obtained and the corrections that users made are exposed publicly through our APIs for researchers and developers working on improving these translation services or creating new ones. You can learn more details about the integration of Matxin in content translation.
We are excited by this partnership, and by the idea that our translation platform can be improved and expanded by local communities. Improving translation tools such as content translation helps reduce the language barriers for users to access vital knowledge.

Do you work in the machine translation community? Join us.

We are always open to collaborations with others in the machine translation community. If you are working on a translation service, you can check the documentation on how to integrate new translation services into content translation and contact us on the project’s discussion page.
Pau Giner, Senior User Experience Designer, Audiences Design
Wikimedia Foundation

Archive notice: This is an archived post from blog.wikimedia.org, which operated under different editorial and content guidelines than Diff.

Can you help us translate this article?

In order for this article to reach as many people as possible we would like your help. Can you translate this article to get the message out?

1 Comment
Inline Feedbacks
View all comments

it has expanded my mind to an idea, I do not know how fancy my thought is, but I believe that if in the future it is possible to write the wikipedia articles in a universal language (I am not referring to english,latin or something like that, but something for computer), and any change made in any language was visible to all, I believe there would be less shortage of pages in language exchange, such as: fr.wikipedia.org/wiki/Programmation_neuro-linguistique en.wikipedia.org/wiki/Ciencia hu.wikipedia.org/wiki/Isaac_Asimov ru.wikipedia.org/wiki/Chief_Executive_Officer […] (I already have the habit of using the chrome translator to read multilingual wikipedia articles) after automatic translation, local… Read more »