In March, the team worked on the major new features that will be added in the coming months. The objective is for VisualEditor to be the default editor for all users, capable of letting them edit the majority of content without needing to use the wikitext editor, in July 2013. This will mean adding support for references, (at least) basic templates, categories and images, each of which is a very large piece of work. This month the primary focus was editing of categories and templates, with draft designs created and initial code developed. The team undertook its first ever “Quarterly Review
“, whose slides
detail these designs, the work done to date and expectations for the near future. The alpha version of VisualEditor on mediawiki.org and the English Wikipedia was updated twice (1.21-wmf11
), adding better input and selection support, fixing a number of bugs, and restructuring the back-end so that the new features will be simpler to create.
In March, the Parsoid team continued with improvements to internationalization, serialization, and extension handling.
The parser test framework now supports language-specific tests, which required support for loading language-specific default setting in Parsoid.
The serializer is now fully DOM-based and uses constraint-based newline / white-space separator handling, which will make the serializer less sensitive to newlines and whitespace in HTML. Round-trip test results of 82% (pages without any diffs) and 98% (pages without semantic diffs) indicates that the new serializer is on par with the old serializer currently deployed on production.
Extension content is now parsed all the way to DOM, which enforces proper nesting. The generic support for balanced fragment parsing will later also be applied to templates. Parsing of transclusion directives (includeonly and friends) has also been improved and simplified.
The DOM specification for images and templated / extension content was fleshed out in preparation for full editing support.
Late in March, C. Scott Ananian joined us as a contractor. Welcome!
Editor engagement features
In March, the team continued to deploy new features for the Notifications project (code-named Echo
) on mediawiki.org. Ryan Kaldari developed a new Thanks notification
that lets you express your gratitude to users who make constructive edits by notifying them that they have been thanked (this feature was designed to give positive feedback to new editors during their first steps on Wikipedia). Benny Situ built the User rights notification
, which is sent when your user rights are changed (this feature was requested by power users on the English Wikipedia). Luke Welling developed new code to send HTML email notifications
, based on designs from Vibha Bamba. Fabrice Florin led discussions about these new features to serve the needs of both new and current users, then updated their feature requirements
; he also co-wrote this metrics plan
with Dario Taraborelli, as well as a socialization plan and new project pages
with Oliver Keyes. We are now completing these final features and are aiming for a first release on the English Wikipedia later this month; in the meantime, you can help us test the current version
on mediawiki.org. To learn more, read this project update
on the Wikimedia blog.
This month, we released an updated version of Article Feedback v5
(AFT5) on the French
and German Wikipedia
, for evaluation by their communities. Developer Matthias Mullie completed final features for this release, including a new feedback link
and a tool that lets you discuss useful feedback on article talk pages
, based on designs from Pau Giner and suggestions from Oliver Keyes. Product manager Fabrice Florin worked with Denis Barthel and Sebastian Peisker on the German release
and Benoît Evelin on the French release
, and we are very grateful to them and many other community members for their invaluable contributions. A German community vote is expected in May on the German Wikipedia, and in September on the French Wikipedia, when they will decide whether or not to deploy the tool across their entire sites. Due to data caching issues, the tool was temporarily turned off on the English Wikipedia, where we expect to re-deploy it on an opt-in basis as soon as practical, as described on this talk page
. After the English Wikipedia re-deployment in April, we plan to monitor community feedback on all three pilots before making any more updates, but other projects interested in the tool are invited to read this this 2013 release plan
and contact us if they would like Article Feedback on their sites later this year.
Design work continued on Flow. We continued creating a “Portal” that will engage discussion about Flow at three locations (mediawiki.org
, meta, and the English Wikipedia), and performing research
Editor engagement experiments
Editor engagement experiments
In March, the Editor Engagement Experiments team largely placed other projects – such as guided tours
, and others – on hold to focus on two key initiatives: the “Getting Started
” process for onboarding new Wikipedians
, and on making the redesign of account creation and login
a permanent, internationalized part of MediaWiki core.
For the Getting Started project, the team launched a new version on English Wikipedia, which included a new landing page with additional types of tasks suggested for brand new editors to try. The list of tasks is now generated by a basic recommender system built by Ori Livneh, which gathers, filters, and delivered a fresh list of tasks automatically for every editor. This new backend paves the way for releasing the “getting started” feature on other projects, after we’ve completed data analysis and testing to understand which kinds of tasks are ideal for first time editors. Additionally, Matt Flaschen collaborated with the Editor Engagement Features team to build notifications to welcome new editors and invite them to contribute via the Getting Started.
For the account creation and login work, S Page, Munaf Assaf, and the rest of the team rebuilt our design to work with MediaWiki core, and solicited reviews from outside the team. We currently plan to launch both interface redesigns on an opt-in basis in April, to have editors test the localization and other functional aspects of the forms via a URL parameter, before we enable them as default.
2012 Wikimedia fundraiser
In March, we wrapped up our 2012/13 non-English international fundraising efforts, making approximately 5 million USD over the course of the month. Originally, we had planned to run the non-English international fundraiser continuously until June, but were forced to accelerate our plans due to some potential instability at the beginning of April with one of our crucial payment gateways. At the very end of March, we started publishing aggregate public fundraising data to samarium.wikimedia.org
Initial version of Commons photo uploader app for Android is available for download in Google Play. iOS version is still in beta, but should be available in the store next month.
In March we added new telecom partners (such as Axiata Group Berhad
) and fixed some bugs, and brought new staff online. We also won an SXSW Interactive “Activism” award
for Wikipedia Zero. In April we aim to start improving the code and the IP detection.
Max Semenik, Arthur Richards and Faidon Liambotis held an OSM mini-hackathon
at Open Source Days 2013 in Copenhagen. During the event, they agreed on an implementation strategy for the WMF mapping cluster.
Mobile Web Photo Upload
In March, we added the ability to easily upload
a lead image
to articles that lack one in the stable version of the mobile site. We also deployed a workaround for an issue we discovered with heightened security features in some newer browsers that make logging in to all the projects via CentralAuth impossible in certain circumstances; that had prevented a number of users from being able to upload photos via the mobile site. We are now well on our way to reach our goal of 1000 unique uploaders/month by the end of the fiscal year. Check out the mobile app dashboard
to see mobile contributions via the website and via apps. Also of note: we’ve added thumbnails of lead images from articles in the mobile watchlist view, as well as a “last modified” timestamp on articles in the stable version of the mobile site. We are currently focusing on some performance enhancements for the mobile site. In April we will graduate the “uploads dashboard” feature from beta to stable, will further refine our photo upload features, and will expose a feature to identify articles on subjects near your current location to the beta version of the site.
were deployed to Wikimedia sites in March. We created the REL1_21 branch on March 25, with the goal of a release candidate at the end of the month.
We launched Lua scripting
on all wikis, wrote about the launch’s wider significance
, and held IRC office hours
. In March we also added
, improved CPU time accounting, and allowed argument expansion to be excluded. We have patches outstanding for “text” module including unstrip functionality, as well as improved debug output. We’ve also made significant improvements to templates since the launch.
This activity kicked off on March 26. We’re planning a minimal OpenID implementation and OAuth implementation in the coming months. Very tentative target date is end of May.
Search deployed to Beta Cluster. Search code instrumented for better troubleshooting and identification of issues, and work is underway to add PoolCounter support. Plan for April to make search updates more robust.
Phase II deployment will complete on March 27 to several wikis, including Italian, Hebrew and Hungarian Wikipedias. This phase includes a new Lua interface to Wikidata so as to make infobox population from Wikidata possible. The Wikidata section of the monthly report has more details.
Mostly bugfixing this month, as well as hiring for the two multimedia positions. Jan Gerber finished work on an API to rotate images (bug 33186
), which needs a little site configuration work to get deployed. Transcoded videos have been moved to their own container in the Swift filesystem in anticipation of video-specific optimizations (bug 43343
). Jan also improved the user interface in cases where an embedded media player is too small to display credits and player controls. TimedMediaHandler
was extended so that other MediaWiki extensions can render player elements using PHP. The Score extension
can now use TimedMediaHandler or OggHandler to render the audio player (see bug 43388
), which puts the Score extension one step closer to deployment and music staves one step closer to generation and display in wiki pages (see bug 189
Site performance and architecture
merged and deployed. These improvements to the jobqueue should help site performance (see Tech Operations section of the monthly report).
Admin tools development
We’ve implemented improved support for blocking users coming in through proxies with GlobalBlocking. Continuing work on identifying accounts that have not been merged with Single User Login, with the goal of merging those accounts starting in April.
Security auditing and response
The fundraising code base review is done. A MediaWiki security release, 1.20.3, was published
on March 4. A review is underway for user metrics API
Finalizing details for new-user features volunteer test event
with Weekend Testers on April 6. Tested AFTv5 release to German Wikipedia, French Wikipedia pending. Testing upcoming new features for Echo
“Phase 1” support on beta for Mobile is complete and Mobile is using the beta cluster for testing now. We added search to beta, including Mobile. Lucene instances have been set up to provide search suggestion and … search capabilities, but it’s a rough base which still needs to be improved. More automated tests are now targeting beta cluster, and targeting the test2wiki/production cluster is underway. Jenkins is now upgrading the database schemas on an hourly basis and deploying changes to the MediaWiki configuration just after they have been merged. If you are curious, have a look at the Jenkins dashboard for the beta project
The continuous integration site has been moved from integration.mediawiki.org to integration.wikimedia.org and is now always on HTTPS. The index page has been rewritten based on Twitter Bootstrap (see integration.wikimedia.org).
Antoine Musso has given our Zuul status page an overhaul. It features live reloading through ajax and contains direct links to the Gerrit changesets and Jenkins jobs. A big improvement over the plain text version.
We’ve packaged various Python modules for the Debian project, which will in turn let us simplify deployment. Meanwhile, we’re experimenting with having our Debian/Ubuntu packages built by Jenkins directly.
This month we’ve continued to extend Jenkins coverage for Gerrit repositories. We’re happy to announce that almost all repositories for MediaWiki extensions in Gerrit now have Jenkins integration.
We held an exercise to build the test backlog using Search as an example
which did build the test backlog for search; it now contains wide variety of regression tests for automation. But the exercise didn’t attract as many volunteers as we’d like; we’re looking
for ways to address that in future exercises. Browser tests continue to identify significant regression issues, with new features in particular. We are extending browser test coverage to move-page functions, PDFs, and Search with a volunteer from the March exercise.
Visualization, Reporting & Applications
- In order to support mobile initiatives–including the Mobile Website, Mobile Apps, and Wikipedia Zero–we focused our attention on providing data extracts and visualizations with this focus. New visualizations include the Mobile app dashboard.
- In addition, we updated the report card for the March Metrics Meeting, improved the robustness of the reportcard infrastructure, added target bars and added links to the metric definitions.
- We are currently working on a new mobile pageview report.
Services & Access Points
- In March, we saw the launch of the User Metrics API, a service that allows researchers to perform cohort analysis on various data sets, making it easier to measure the effects of programs and platform experiments among discrete sets of users. We are currently working on improving the web-based user interface to make it available for use outside of Wikimedia Foundation staff in the coming months.
- Our big-data cluster known as Kraken has been undergone no major changes in capability, but we have been working to make it more robust and improve security. Our udp2log monitoring has become more accurate, and Limn can be installed on both production and Labs instances.
Misc: Defects Closed
- Fixed the Space characters in pagecounts-raw titles bug.
Misc: Management & Communication
- The Analytics team has started to use Mingle to manage its work more effectively day-to-day. Bugzilla remains our primary interface for managing defects with respect to communicating their priority and status.
- Finally, we had our Analytics Reboot meeting, where all internal WMF Analytics stakeholders convened and we surveyed what customer opportunities were out there, what Analytics models are currently available, and how to improve inter-team communication.
In Bugzilla, a way to mark bugfixes to copy from the development branch to stable branches
was introduced to easier identify important bugfixes to include in tarball releases.
Two bugdays took place as part of the QA Weekly Goals: cleaning up and retesting General MediaWiki reports and a bugday concentrating on the LiquidThreads extension. For the latter, 76 out of 218 open reports received updates. Valerie analyzed which important Wikimedia feedback channels link to each other and Bugzilla, and created a diagram of the current situation. Valerie also published two blogposts explaining how to create a good first bug report and how to help Wikimedia squash software bugs. Andre improved the Bugzilla Weekly Report email to the wikitech mailing list. On most open bug reports with a target milestone set to future MediaWiki version 1.21.0, reminder comments were added for developers. Andre and Valerie also held the first IRC Office Hour on Bugzilla and Bug management for those interested in discussing problems and improvements with Wikimedia’s bug management. In Bugzilla’s internal product and component taxonomy, several Mobile application products were merged into a single “Wikipedia App” product and two Search components were merged, to simplify finding information for developers and reporters.
Also, the bug management task list received a major cleanup, making it clearer what is being worked on and what you can help with.
reviewed, published and advertised several tech blog posts, and did communications support for the deployment of Extension:Scribunto
; this included reviewing blog posts, organizing IRC office hours, and announcing the deployment on wikis and lists
. He modified a template
so that events from the MediaWiki calendar
show as bulleted items
on the home page
. He continued to investigate SugarCRM, and expanded Product development
to facilitate the involvement of contributors, and redesigned, reorganized and simplified the How to contribute
landing page. He added “Open tasks” sections to pages of activities in need of Product help, and linked to them from the Product hub. He also met with Quim Gil to discuss his contributors plan
, and followed up on the gerrit tagging proposal
. He researched ways to create and maintain translations of the Wikimedia Glossary
, and started a discussion on the lists
about the best way to move forward with glossaries scattered across wikis. Last, he started to plan for the centralization of mobile documentation
, and drafted thoughts about a consolidation of technical communities
Volunteer coordination and outreach