Last week, the technology site Rest of World published a story on the apparent failings of WhatsApp misinformation “tip lines” in India. These are services that allow Indians to forward potential fake news and get information on its veracity. (We linked to it in our daily newsletter on Tuesday.) Here’s an excerpt:
At one level, it shouldn’t be surprising that something as complicated as automated AI fact-checking — in up to 10 different languages! in a country with nearly 1 billion eligible voters! — is far from perfect. And in Rest of World’s count, the tip lines generated more correct (16) than incorrect (4) responses; the real problems were the 145 times when they generated no response at all.Nearly a billion Indians are expected to vote in the ongoing elections, where misinformation and disinformation are among the biggest threats to the country’s political and social fabric, according to the World Economic Forum.To combat this challenge, several fact-checkers, journalists, and even social media companies have launched or rebooted dozens of fact-checking helplines over WhatsApp, locally called tip lines. A user can verify content including audio, videos, and photos by sending it to the tip line’s WhatsApp number…
Rest of World tested 11 prominent tip lines by running 15 pieces of content through them. The content included 10 viral AI-generated videos — known to carry election-related misinformation — and five real videos that had been edited to mislead voters. Most of the tip lines struggled to provide a conclusive answer. Those that did were often inconsistent in their responses to local language content. Some tip lines took up to two days to generate an answer.
Nearly all the tip lines first sent automated bot responses saying “no fact-checks found” and passed on the query to human fact-checkers. The tip lines did not provide a follow-up response 85% of the time.
But it didn’t take long for people involved in the tip lines to raise questions about the reporting. The Misinformation Combat Alliance (“a cross-industry alliance bringing companies, organizations, institutions, industry associations and government entities together to combat misinformation and fake news”) said the story was “riddled with inaccuracies and mischaracterizations” and published a lengthy response, signed by representatives of 13 organizations. Among the concerns they raised:
Ruby Dhingra, the managing editor of Newschecker (a member of The Misinformation Combat Alliance and signee of its blog post), wrote in a separate post that Rest of World also misunderstood what the tiplines are meant to do: “While some automation is used, it was never intended for users to receive automated and immediate replies for all queries, a point emphasized by the experts in the article but ignored by the RoW team.”
A story by @restofworld on WhatsApp tiplines including @dau_mca is riddled with inaccuracies and mischaracterisations. Efforts to seek corrections have been in vain. Here is our response: https://t.co/OcXyYH1wNY
— Misinformation Combat Alliance (@india_mca) May 29, 2024
One of the MCA’s initiatives, the Deepfakes Analysis Unit, offered additional detail in a thread.
We want to correct the record on the egregious errors in this story published by @restofworld on May 24 about tiplines operating in India. https://t.co/VW0LHrLOZU
— Deepfakes Analysis Unit (@dau_mca) May 29, 2024
The story mentions that the DAU did not respond to 10 of the 15 media files sent to the DAU tipline, that is not true. The DAU has a record of all the responses that were sent out and when.
— Deepfakes Analysis Unit (@dau_mca) May 29, 2024
They mention in the story that we got 2 “incorrect” responses. We are not sure what they are referring to because we cross-checked each response that was sent out and it was the right response.
— Deepfakes Analysis Unit (@dau_mca) May 29, 2024
Yesterday, Rest of World retracted the article, saying it had “determined that the piece did not meet our editorial standards for accuracy and journalistic integrity.” Here’s Anup Kaphle, Rest of World’s editor-in-chief:
As part of our reporting for this story, Rest of World ran an experiment by sending AI content through a number of verification tools built by fact-checking organizations, and called out repeated failures to identify “fake” material. Rest of World failed to reach out to all of the organizations named in the story to account for, or respond to, perceived lapses in their fact-checking systems. As a result, we failed to identify potential flaws in our own reporting methodology. After publication, a number of the fact-checking organizations featured in the story noted that our queries were flagged as spam by their tip lines. Our story also contained inaccuracies about the number of queries sent to the tip lines, the number of accurate responses, and the response time from the tip lines.We deeply regret any harm that our reporting has caused. Rest of World is dedicated to upholding the highest editorial standards, and we take full responsibility for the oversight. Our commitment to our readers is to provide accurate, reliable, and thoroughly verified news. We fell short of this commitment.
For the curious, you can still read the original version in the Wayback Machine.
150 comments:
One of MoneyMutual’s great features is that it permits users to examine lenders’ offers and consider them
earlier than accepting them.
However, keep in mind you’d be repaying that loan with money
that has been taxed (while the funds invested in a 401k
are pre-tax dollars).
Do you have the capacity to take on new clients right now?
According to Dr. Rivers, a former NASA neuroscientist, a quick 7-second brain exercise can activate your “Superbrain” instantly.
This method works by connecting key regions of your brain, which is why my wife said, “It’s like a magic wand gave me a superbrain!” She’s now recalling things from 20 years ago and experiencing daily lucky breaks.
If you want to quickly boost your brainpower and tap into a genius-level IQ, check out this short presentation.
https://bit.ly/4b0dzXJ
SIGN OFF
Getting a payday mortgage may be deceptively straightforward.
However, lender platforms on this list require you to have a bank account to be
eligible for the loan.
Payday lenders don’t do exhausting credit score checks.
Behind each stunning bouquet there’s an excellent florist.
Know how the charge is calculated before you
are taking out a cash advance, so you received’t be caught off guard.
Historical Mortgage Rates A collection of day-by-day rates and analysis.
Our installment loans are repayable inside a period of 6 months.
When the client cannot pay back the second payday loan, the client takes out a third, and so on and so on.
Furthermore, these sort of loans cost exorbitant fees and permit
you access to moderate-higher loan quantity with decrease rate of interest.
Once you’ve been approved for a loan, you’ll have your funds inside 24 hours.
The course of took longer than anticipated and in the end the
loan did not come through.
Is someone you know feeling down?
Clinical issues for monkeypox in people who discover themselves pregnant or breastfeeding.
I was wondering if you ever considered changing the page layout of your website?
Its very well written; I love what youve got to say. But maybe you could a little more in the way of content so
people could connect with it better. Youve got an awful lot of text for
only having 1 or 2 images. Maybe you could space it out better?
Also visit my webpage; สาระน่ารู้ทั่วไป
It’s potential to get a private loan with below-average credit.
Quick payday loans are very quick and easy to request.
Payday lenders do not do onerous credit checks.
As an alternative she acquired a vase of beautiful flowers.
Ferns N Petals was established in 1994 and flower bouquet delivery was the first and
solely factor that we were doing.
Please take care and really feel better.
My associates flowers were delivered as promised.
We provide identical day flower delivery Toronto.
The reward of recent flowers may be healing.
Using portable vapes can be extra discrete and simpler to make use of than smoking but may have much less taste.
Payday loans ought to solely be used as a last resort.
Same day supply to a school or house available.
Cash advances might have greater interest rates than typical credit card purchases do.
3. Apply for a personal mortgage online.
Next, you’ll need to have an energetic checking account in good standing.
Browse our web site and store our assortment of contemporary flower arrangements and customised present baskets.
These loans will help you to spice up the credit
score score.
In a market where that is considerably uncommon, it is
good to see that some corporations nonetheless stick with their
guns.
While you are at it, make positive to take away yellow,
brown, or withered leaves.
That is why we settle for IDNYC as a main form of ID for account
opening or loan processing.
In ancient instances, Greeks and Romans put flowers on graves as a logo of
honor.
White roses typically are the wedding bouquet flowers.
You really make it appear really easy along with your presentation but I find this matter to be actually something which I feel I’d by no means understand.
It kind of feels too complex and extremely broad for me.
I’m looking ahead to your subsequent submit, I will attempt to
get the hold of it!
You may even skip or pause your subscription for
so lengthy as you like.
Being sick isn’t ever straightforward.
The colors will add life to an extraordinary bleak
day.
With dramatic striped and twisting sword-like leaves, this plant is
the right showstopper on a side table or sitting neatly in a corner.
We provide delivery of flowers to any of these schools.
Available to 80% of households in additional than 5,000 U.S.
cities, Shipt provides private buying and delivery throughout distributed locations.
I beloved the flowers I acquired from my boyfriend.
Applicants should be over the age of 18, have
a sound ID, lively checking account and can’t be a member of the military.
Daisies, either white or extra colorful, are a well-liked choice for bulking up
funeral arrangements that includes different flowers.
Trackbacks:
Leave a comment