Google releases 'Wikilinks' corpus to interpret human language

Google announces release of extremely large dataset known as the Wikilinks Corpus that will help developers to build software that is able to understand human language.

The collection contains a total of 40 million disambiguated 'mentions' over 10 million web pages, which is 100 times bigger than the previous large corpus.

The mentions are found by searching for links through Wikipedia pages and anchoring text that closely matches the title of the page.

A post on Google's official research blog says when it comes to deciding which term an ambiguous word relates to, "humans are amazingly good at it (when was the last time you confused a fruit and a giant tech company?), computers need help."

The software is a step in the right direction for developers to create programs using Wikilinks Corpus, that will be able to distinguish meanings.

With help from researchers at the University of Massachusetts Amherst, Google have produced a signifcantly larger dataset than its predecessors, and it's free.

Although for copyright reasons the actual annotated web pages won't be made available, an index of URLS, and the tools to recreate it will be provided.

Source: Google Research Blog

Comments

Be the first to comment…

Back to top
Close
T3 Newsletter
Sign up to recieve the T3 newsletters by entering your details below

Your Details

As you're registering with us. we'd like to think that you'd enjoy receiving the following emails; if you'd rather not receive them, please untick the boxes:

I would like to receive other emails from T3, Future Publishing Limited and it's group companies containing news, special offers and product information
I agree to the terms of use and privacy policy and confirm that I am over 16 years of age *
Close
Log in or Join

By clicking below you agree to our terms and conditions and our privacy policy

Log in to T3.com with your preferred social network

Log in with your T3.com account

CloseJoinPlease complete these additional details

Join T3.com with your preferred social network

OR

Join T3.com

Please tick this box to confirm you are 16 years old or over

Just so we know you're human

Newsletters

I would like to receive T3 email newsletters, packed full of the latest tech news, competitions and exclusive offers.

I would like to receive other emails from T3, Future Publishing Limited and its group companies containing news, special offers and product information.

I would like to receive offers from carefully selected third Parties. We will not share your data with the third party.

Close Edit your profile

Change your password

Newsletters

I would like to receive T3 email newsletters, packed full of the latest tech news, competitions and exclusive offers.

I would like to receive other emails from T3, Future Publishing Limited and its group companies containing news, special offers and product information.

I would like to receive offers from carefully selected third Parties. We will not share your data with the third party.

Social networks

You have authorised these social networks to interact with your T3.com account.

Please ensure you deactivate or revoke access to this website from within your social networks settings to ensure all permissions are removed.

Close Forgotten your password

Forgotten your password?

Please enter the email address that you used to sign up and we'll send you a new password

Close
Forgotten password
Don't have a T3 Account? Join now