Wikimedia Enterprise API Documentation

Introduction

Welcome to the Wikimedia Enterprise API Documentation and Reference guide. Wikimedia Enterprise provides a suite of APIs designed for high-volume access to Wikimedia project data; including Wikipedia and many others.

Here are a few examples of what you can do with Wikimedia Enterprise APIs:

Download and import all of the Wikimedia project data you desire:

  • Call the Snapshot API to receive a packaged tarball file containing every single article in a specific project; example being English Wikipedia or German Wiktionary.

Look up the latest public version of a single article (page):

  • Query the On-demand API by article name, like “Albert_Einstein” or “SpaceX”, to receive the most recent article version in all projects. You an also use filters for language and/or project of choice.

Stream real-time updates (firehose) from Wikimedia Enterprise projects into your system:

  • Connect to the Realtime API stream to have new article revisions (updates) pushed directly to your system as they happen.
  • Use Realtime Batch to download new updates in a packaged tarball file format. These are updated on the hour with the last day of updates available.

Getting Started – First Steps

Accessing Wikimedia Enterprise APIs requires authentication credentials, known as JWT tokens, that you must pass with each request. If you do not already have an account, signup for free and get started immediately after. If you’re already signed up, let’s jump into it.

Getting your API Keys

Wikimedia Enterprise APIs use JWT authentication passed via the header for access control. Now that you’ve setup and verified your account, use your username and password on the /login endpoint to receive your tokens.

All API requests must be made over HTTPS. Calls without authentication in the header will fail.

curl -L https://auth.enterprise.wikimedia.com/v1/login -H "Content-Type: application/json" -d '{"username": "janedoe","password":"secret"}'

Refresh token expires in 90 days, Access and ID tokens expire in 1 day. Use your Refresh token to obtain a new access token after it expires.

An important reminder: Your credentials carry many privileges related to your account, so be careful to keep them secure. Do not share your credentials in publicly accessible areas such as GitHub, client-side code, etc.

{
  "id_token": "...id token goes here...",
  "access_token": "...access token goes here...",
  "refresh_token": "...refresh token goes here...",
  "expires_in": 86400
}

Making your first calls

Now you are ready to make your first call. Start by running this cURL command using your access_token to fetch the list of supported projects in Wikimedia Enterprise APIs.

You should receive a list of all supported Wikimedia projects, including the project name, identifier, language, and more. If not, check your credentials, and try again. Note the project identifier (e.g. “enwiki” for English Wikipedia) as that is the identifier you will use to identify that project in other calls and responses.

curl -H "Authorization: Bearer ACCESS_TOKEN" -L https://api.enterprise.wikimedia.com/v2/projects

Next, try using the Snapshot API. Run this cURL command to download the Afrikaans Wikipedia snapshot to your machine.

Open the downloaded file to see NDJSON with a line representing each article in the project. To learn about the data provided for each article, visit the data dictionary.

curl -H "Authorization: Bearer ACCESS_TOKEN" -L https://api.enterprise.wikimedia.com/v2/snapshots/afwiki_namespace_0/download --output afwiki.tar.gz

Next, try calling the On-demand API to get a specific article of interest. Let’s use Douglas Adams in English Wikipedia as an example, with this cURL command.

You should have received a JSON response containing the same data as an article represented in the Snapshot API’s English Wikipedia file. The main difference here (besides being able to query individually) is that this response returns the live version of the article that is actively on the project today, whereas the Snapshot updates daily (for paid users) or monthly (for free users). If you don’t have and are interested in daily access, contact us.

curl -X 'GET' \
  'https://api.enterprise.wikimedia.com/v2/articles/Douglas%20Adams' \
  -H 'accept: application/json' \
  -H 'Authorization: Bearer ACCESS_TOKEN' \
  -H 'Content-Type: application/json' \
  -d '{
  "filters": [
    {
      "field": "is_part_of.identifier",
      "value": "enwiki"
    }
  ],
  "limit": 1
}'

There you have it! You’ve made your first calls with Wikimedia Enterprise. Please explore the API reference, the data dictionary, or FAQs to find more ways you can use these APIs for your work.