While Google has long been synonymous with search, people are increasingly seeking information directly through video platforms such as YouTube. Videos can be dense with information: text, audio, and image after image. Yet each of these layers presents a potential source of error or deceit. And when people search for videos directly on a site like YouTube, sussing out which videos are credible sources can be tricky.

To help people vet videos, 天美影视传媒 researchers created and tested Viblio, a browser extension that lets viewers and creators add Wikipedia-like citations to YouTube videos. The prototype offers users an alternate timeline, studded with notes and links to sources that support, refute or expand on the information presented in the video. Those links also appear in a list view, like the 鈥溾�� section at the end of Wikipedia articles. In tests, 12 participants found the tool useful for gauging the credibility of videos on topics ranging from biology to political news to COVID-19 vaccines.

The team will present May 14 in Honolulu at the ACM CHI Conference on Human Factors in Computing Systems. Viblio is not available to the public.

鈥淲e wanted to come up with a method to encourage people watching videos to do what鈥檚 called 鈥榣ateral reading,鈥� which is that you go look at other places on the web to establish whether something is credible or true, as opposed to diving deep into the thing itself,鈥� said senior author , an assistant professor in the Paul G. Allen School of Computer Science & Engineering. 鈥淚n previous research, I鈥檇 worked with the people at X鈥檚 and with Wikipedia and seen that crowdsourcing citations and judgments can be a useful way to call out misinformation on platforms.鈥�

To inform Viblio鈥檚 design, the team studied how 12 participants 鈥� mostly college students under 30 鈥� gauged the credibility of YouTube videos when searching for them on the platform and while watching them. All said familiarity with the video鈥檚 source and the name of the channel were important. But many cited signs of a video鈥檚 potentially faulty credibility: the quality of the video, the user鈥檚 degree of interest in it, its ranking in search results, its length and the number of views or subscribers.

The team also found that in one case a participant misinterpreted a YouTube information panel as an endorsement of the video from the Centers for Disease Control and Prevention. But these panels are actually links to supplemental information that the site attaches to videos on 鈥渢opics prone to misinformation.鈥�

鈥淭he trouble is that a lot of YouTube videos, especially more educational ones, don鈥檛 offer a great way for people to prove they鈥檙e presenting good information,鈥� said , a doctoral student at University of Notre Dame who completed this research as a UW undergraduate student in the Information School. 鈥淚’ve stumbled across a couple of YouTubers who were coming up with their own ways to cite sources within videos. There鈥檚 also not a great way to fight bad information. People can report a whole video, but that鈥檚 a pretty extreme measure when someone makes one or two mistakes.鈥�

The researchers designed Viblio so users can better understand videos鈥� content while also avoiding things like users misinterpreting the additional information. To add a citation, users click a button on the extension. They can then add a link, select the timespan their citation references and add optional comments. They can also select the type of citation, which marks it with a colored dot in the timeline: 鈥渞efutes the video clip鈥檚 claim鈥� (red), 鈥渟upports the video clip鈥檚 claim鈥� (green) or 鈥減rovides further explanation鈥� (blue dot).

To test the system, the team had the study participants use Viblio for two weeks on a range of videos, including clips from Good Morning America, Fox News and ASAPScience. Participants could add citations as well as watch videos with other participants鈥� citations. For many, the added citations changed their opinion of certain videos鈥� credibility. But the participants also highlighted potential difficulties with deploying Viblio at a larger scale, such as the conflicts that arise in highly political videos or those on controversial topics that don鈥檛 fall into true-false binaries.

鈥淲hat happens when people with different value systems add conflicting citations?鈥� said co-author , a UW assistant professor in the Information School. 鈥淲e of course have the issue with bad actors potentially adding misinformation and incorrect citations, but even when the users are acting in good faith, but have conflicting options, whose citation should be prioritized? Or should we be showing both conflicting citations? These are big challenges at scale.鈥�

The researchers highlight a few areas for further study, such as expanding Viblio to other video platforms such as TikTok or Instagram; studying its useability at a greater scale to see whether users are motivated enough to continue adding citations; and exploring ways to create citations for videos that don鈥檛 get as much traffic and thus have fewer citations.

鈥淥nce we get past this initial question of how to add citations to videos, then the community vetting question remains very challenging,鈥� Zhang said. 鈥淚t can work. At X, Community Notes is working on ways to prevent people from 鈥榞aming鈥� voting by looking at whether someone always takes the same political side. And Wikipedia has standards for what should be considered a good citation. So it鈥檚 possible. It just takes resources.鈥�

Additional co-authors on the paper include , who completed this work as an undergraduate at the UW and is now at Microsoft; , who completed this research as a UW doctoral student in the iSchool and is now an assistant professor at Seattle University; and , who completed this work as a UW graduate student in human centered design and engineering and is now a doctoral student at University of California San Diego. This research was funded by the WikiCred Grants Initiative.

For more information, contact Zhang at axz@cs.uw.edu, Hughes at ehughes8@nd.edu, and Mitra at tmitra@uw.edu.

Three separate 天美影视传媒 research teams have been awarded $750,000 each by the National Science Foundation to advance studies in misinformation and the ocean economy.

The for phase 1 of the Convergence Accelerator program鈥檚 2021 cohort. The federal agency hopes to build upon basic research and discovery to accelerate solutions in two critical areas: the 鈥溾�� and 鈥�.鈥�

One team, from the UW Applied Physics Laboratory, was selected for the 鈥淣etworked Blue Economy鈥� track topic, and two UW teams 鈥� one from the UW Information School and another from the APL 鈥� were selected for the 鈥淭rust and Authenticity in Communications Systems鈥� track.

Designed to transition basic research and discovery into practice, the Convergence Accelerator uses innovation processes like human-centered design, user discovery, team science, and integration of multidisciplinary research and partnerships. The Convergence Accelerator, now in its third year, aims to solve high-risk societal challenges through use-inspired convergence research, according to NSF.

The three projects that teams from the UW will lead include:

• The 鈥溾�� project, from the APL and industry partners, will produce a flexible proof-of-concept technology to help people evaluate the source of information and its reliability. Drawing on the fields of technology development, law, business, policy, curriculum development, community management, interdisciplinary research and finance, the team will develop tools and components to generate and communicate digital 鈥渢rust signals鈥� in various settings. The result will be a proof-of-concept for a verified information exchange that would support tools that users can deploy to assess the trustworthiness and authenticity of digital information. Workstreams are anticipated to include food system safety and security, bank and financial information systems, public health information systems, academic publication and supply chains. , a principal research scientist at the APL, is the lead investigator.
• The 鈥溾�� project team, composed of a multidisciplinary set of researchers from the UW, the University of Texas at Austin, Washington State University, Seattle Central College and Black Brilliance Research, will plan, facilitate and assess a series of seven workshops focusing on critical reasoning skills, the psychological and emotional aspects of information, and broader sociocultural dimensions of trust in information ecosystems. The workshop series will be hosted in collaboration with a diverse group of local stakeholders in Washington state and Texas, including urban and rural libraries, news outlets, civic organizations, and underrepresented communities. , an Information School associate professor and UW co-founder, is the principal investigator on the project.
• In the 鈥溾�� project, three new community-run ocean sensors will provide Indigenous coastal communities with real-time data on the changing ocean environment. The floating systems, anchored to the seafloor, will be deployed in collaboration with coastal communities in Alaska, the Pacific Northwest and the Pacific Islands. Sofar Ocean鈥檚 existing buoy systems 鈥� designed to be affordable and convenient 鈥� can measure waves, sea surface temperature, cloudiness of the water, and water depth, and come equipped with solar power, satellite communication and potential for expansion. The project housed under will be done through the UW-based as well as its counterparts in Alaska and the Pacific Islands, which have long-standing, trusted relationships with Indigenous and coastal communities. , an oceanographer at the APL and the director of NANOOS, is the lead investigator.

Additionally, Assistant Professor and Associate Professor , both in the UW Paul G. Allen School of Computer Science & Engineering, are co-principal investigators on a team, led by the international grassroots community . That team aims to develop practical interventions to help individuals and community moderators analyze information quality, including misinformation, to build trust and address vaccine hesitancy. Zhang also is on another , based at the University of Michigan, that will help media platforms determine how to flag articles that contain misinformation.

During phase 1, each UW team will engage with the other members of their cohort in a fast-paced, nine-month hands-on journey, which includes the program鈥檚 innovation curriculum, formal pitch and phase 2 proposal evaluation. The program鈥檚 team-based approach creates a 鈥渃o-opetition鈥� environment, stimulating the sharing of innovative ideas toward solving complex challenges together, while in a competitive environment to try and progress to phase 2.

At the end of phase 1, each team participates in a formal pitch and proposal evaluation. Selected teams from phase 1 will proceed to phase 2, with potential funding up to $5 million for 24 months. Phase 2 teams will continue to apply Convergence Accelerator fundamentals to develop solution prototypes and to build a sustainability model to continue impact beyond NSF support.聽 By the end of phase 2, teams are expected to provide high-impact solutions that address societal needs at scale.

Launched in 2019, the NSF Convergence Accelerator program builds upon basic research and discovery to accelerate solutions toward societal impact. Using convergence research fundamentals and integration of innovation processes, it brings together multiple disciplines, expertise and cross-cutting partnerships to solve national-scale societal challenges.