Amnesty International India says 95 female politicians received nearly 1 million hateful mentions on Twitter. PHOTO: REUTERS

Twitter opens up data for researchers to study Covid-19 tweets

Twitter said it would allow researchers to access data of daily public tweets about pandemic

Reuters April 30, 2020
Twitter will grant researchers and software developers access to a real-time data stream of tens of millions of daily public tweets about Covid-19, which they can use to study the spread of the disease or track misinformation, the company said in a blog post on Wednesday.

Twitter said that this access could also be used by approved applicants working on crisis management, emergency response, or communication within communities, as well as those developing machine learning and data tools to help the scientific community understand Covid-19.

Scientists say new antiviral coating can protect surfaces for 90 days

Social media platforms have both introduced new policies to curb Covid-19 misinformation and warned that there may be errors due to their reliance on more automated moderation systems during the pandemic. Researchers studying the platforms have argued that the companies must collect data about this period.

Vera Jourova, European Commissioner called Twitter’s move “a good step in the right direction.”

“Our cooperation and regular contacts with online platforms to fight disinformation are bearing fruit. I have constantly underlined the importance for researchers to have better access to useful non-personal data and tools,” she said.

Last week, 75 groups and individuals, including digital rights and free speech organisations, wrote an open letter to social media platforms asking them to preserve and publish their content moderation data.

However, Twitter said that once tweets were taken down, they would have to be removed from this Covid-19 data set.

Currently, Twitter’s free, public API access offers a small percentage of its full stream of tweets, although the company does provide greater levels of access to paying clients.

Twitter said it had never offered a full stream on a particular topic before, and that it represented tens of thousands of dollars per month in data.

Researchers will be able to access tweets created from the moment they connect to the data set, but it will not provide historical data.

Microsoft wants to track your brain waves to mine cryptocurrency

In the blog post, it said that any developer or researcher with an approved Twitter developer account can apply for access to the Covid-19 stream endpoint, but they must meet a set of requirements, including that the use case supports “the public good.”

Applicants will also have to explain how they will protect the privacy and safety of people represented in the data.

Twitter said that researchers would be bound by its usual rules projects analysing health-related topics, for example, not deriving or inferring information about a Twitter user’s health and not storing any personal data about such sensitive information.


Replying to X

Comments are moderated and generally will be posted if they are on-topic and not abusive.

For more information, please see our Comments FAQ