Squashing 'fantastic bugs' hidden in AI benchmarks
After reviewing thousands of benchmarks used in AI development, a Stanford team found that 5% could have serious flaws with far-reaching ramifications.
Dec 11, 2025
0
41
Large language models are high-capacity neural sequence models trained on massive text and multimodal corpora to perform language understanding, generation, and reasoning. Current work examines their internal representations, cognitive and social behavior analogies to humans, and limitations in mathematical, causal, and strategic reasoning. Research also addresses alignment with human values and brain activity, safety and security vulnerabilities, privacy and de-anonymization risks, cross-lingual and sociocultural biases, scaling and efficiency laws, and frameworks for tool use, multi-agent interaction, and domain-specific deployment.
Artificial Intelligence
After reviewing thousands of benchmarks used in AI development, a Stanford team found that 5% could have serious flaws with far-reaching ramifications.
Dec 11, 2025
0
41
Artificial Intelligence
A much faster, more efficient training method developed at the University of Waterloo could help put powerful artificial intelligence (AI) tools in the hands of many more people by reducing the cost and environmental impact ...
Dec 9, 2025
0
60
Artificial Intelligence
In a striking leap toward safer self-driving cars, researchers at Texas A&M University College of Engineering and the Korea Advanced Institute of Science and Technology have unveiled a new artificial intelligence (AI) system ...
Dec 8, 2025
0
36
Artificial Intelligence
A paper co-authored by Prof. Alex Lew has been selected as one of four "Outstanding Papers" at this year's Conference on Language Modeling (COLM 2025), held in Montreal in October.
Dec 4, 2025
0
39
Artificial Intelligence
To make large language models (LLMs) more accurate when answering harder questions, researchers can let the model spend more time thinking about potential solutions.
Dec 4, 2025
0
64
Computing & Networks
Developers can now integrate large language models directly into their existing software using a single line of code, with no manual prompt engineering required. The open-source framework, known as byLLM, automatically generates ...
Dec 3, 2025
0
552
Artificial Intelligence
Vision-language model (VLM) is a core technology of modern artificial intelligence (AI), and it can be used to represent different forms of expression or learning, such as photographs, illustrations, and sketches.
Dec 2, 2025
0
20
Artificial Intelligence
Microsoft just released its latest small language model that can operate directly on the user's computer. If you haven't followed the AI industry closely, you might be asking: what exactly is a small language model (SLM)?
Dec 2, 2025
0
26
Artificial Intelligence
When large language models (LLMs) make decisions about networking and friendship, the models tend to act like people, across both synthetic simulations and real-world network contexts.
Dec 2, 2025
0
43
Artificial Intelligence
Researchers from Saarland University and the Max Planck Institute for Software Systems have, for the first time, shown that the reactions of humans and large language models (LLMs) to complex or misleading program code significantly ...
Nov 28, 2025
0
68