NO/FOMO

每天一次，过滤 AI 噪音

值得打开的
AI 日报。

发布日期2026-05-12中文版本
本期阅读
—
累计阅读
—

Hacker News

6 stories
01

FairyFuse: Multiplication-Free LLM Inference on CPUs via Fused Ternary Kernels

FairyFuse introduces a novel approach to significantly optimize Large Language Model (LLM) inference specifically for CPU architectures. The technique aims to achieve "multiplication-free" LLM computations by leveraging fused ternary kernels. This innovation targets a crucial bottleneck in deploying sophisticated LLMs on commodity hardware, which typically relies on CPUs and lacks the specialized tensor processing units found in GPUs. By eliminating complex multiplication operations, FairyFuse seeks to drastically reduce computational overhead and power consumption, making LLM inference more efficient and accessible for a wider range of applications and devices. The use of "fused ternary kernels" implies a strategic combination of simplified, low-precision arithmetic operations, possibly quantizing model weights or activations to ternary values (-1, 0, 1) and integrating these operations into highly optimized, single-pass kernels. This not only speeds up computation but also enhances cache utilization and minimizes data movement, which are critical factors for performance on CPU-based systems. The proposed method represents a significant step towards enabling broader adoption and real-time execution of LLMs without requiring specialized hardware accelerators, thereby democratizing access to powerful AI capabilities.

LLM InferenceCPU OptimizationTernary KernelsMultiplication-FreeDeep LearningArtificial IntelligenceLarge Language ModelDeep Learning
02

Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model

Cactus has open-sourced Needle, a compact 26-million-parameter model designed for efficient function-calling, also known as tool use. This innovation addresses the challenge of deploying agentic AI capabilities on budget consumer devices, such as phones, smartwatches, and smart glasses. Needle achieves impressive performance metrics, processing 6000 tokens per second during prefill and 1200 tokens per second during decoding on standard consumer hardware. The developers at Cactus argue that tool calling is primarily a task of retrieval and assembly—matching queries to tool names, extracting arguments, and emitting JSON—rather than complex reasoning, making massive models unnecessarily large for this specific function. Their design leverages Simple Attention Networks, relying solely on attention and gating mechanisms without traditional Multi-Layer Perceptrons (MLPs), optimizing for cross-attention as the core primitive. This experimental model, pretrained on an extensive dataset of 200 billion tokens, represents a significant step towards democratizing agentic AI by enabling powerful, on-device single-shot function calling.

Function CallingTool UseSmall Language ModelEdge AIAttention NetworksArtificial IntelligenceAI AgentDeep Learning
03

Show HN: Statewright – Visual state machines that make AI agents reliable

Statewright, a new project by Ben Cochran (formerly of NVIDIA and AMD), addresses the inherent brittleness of current AI agentic problem-solving approaches. Cochran, a Distinguished Engineer with two decades in full-stack engineering, DevOps, HPC, and ML, argues that brute-forcing reliability with larger models and extensive context windows is an inefficient solution. Instead, Statewright proposes an alternative strategy: making the problem space smaller. This is achieved by utilizing smaller language models, specifically in the 13-20 billion parameter range, combined with formal state machines. These visual state machines are designed to constrain the tool and solution spaces available to AI agents, thereby enhancing their reliability when tackling complex tasks, such as real-world SWE-bench problems.

AI AgentsState MachinesReliability EngineeringLarge Language ModelsSoftware Engineering AutomationArtificial IntelligenceAI AgentMachine Learning
04

Claude Platform on AWS

Anthropic has officially announced the availability of its advanced artificial intelligence platform, Claude, on Amazon Web Services (AWS), marking a significant milestone in making its powerful large language models more accessible to a global enterprise audience. This strategic collaboration allows developers and businesses already operating within the AWS ecosystem to seamlessly integrate Claude's sophisticated conversational AI capabilities into their applications and workflows. By leveraging AWS's secure, scalable, and reliable cloud infrastructure, users can now deploy and manage Claude with enhanced efficiency, benefiting from the robust suite of tools and services provided by Amazon. This integration is designed to accelerate the adoption of cutting-edge AI technologies in diverse sectors, facilitating the development of innovative solutions in areas such as customer service, content generation, and data analysis. The availability on AWS underscores Anthropic's commitment to broad accessibility and robust deployment options, positioning Claude as a leading solution for enterprise-grade AI applications seeking powerful natural language processing and understanding.

ClaudeAWSLarge Language ModelAI PlatformCloud ComputingArtificial IntelligenceLarge Language ModelNatural Language Processing
05

Launch HN: Voker (YC S24) – Analytics for AI Agents

Voker.ai, founded by Alex and Tyler, has launched its analytics platform specifically designed for AI product teams to gain comprehensive visibility into AI agent performance. The platform addresses a critical challenge faced by agent engineers and AI product teams: the lack of adequate monitoring in production environments, which often leads to suboptimal user experiences, customer churn, and extensive manual debugging efforts. Voker's core offering is a lightweight, LLM stack-agnostic SDK that integrates seamlessly with agent products. This SDK provides real-time insights into user interactions with agents and evaluates the agents' ability to deliver effective responses, eliminating the need for tedious log analysis. By streamlining the monitoring and debugging process, Voker aims to enhance agent reliability and optimize overall AI product performance.

AI AgentsAgent AnalyticsLLM Stack AgnosticSDKProduction MonitoringArtificial IntelligenceAI AgentLarge Language Model
06

Reimagining the mouse pointer for the AI era

Google DeepMind has introduced a forward-thinking concept to revolutionize human-computer interaction by proposing a reimagined mouse pointer designed for the artificial intelligence era. This initiative aims to evolve the traditional cursor from a passive selection tool into an intelligent, context-aware assistant. The envisioned 'AI pointer' would leverage advanced AI capabilities, including machine learning and predictive algorithms, to anticipate user intent and significantly enhance efficiency within digital environments. By understanding the context of on-screen elements and user behavior, this next-generation pointer could intelligently highlight relevant options, suggest optimal actions, or even execute minor tasks autonomously. This approach moves beyond conventional UI design, suggesting a more intuitive and responsive interface where the pointer actively assists in navigation and interaction, representing a notable step towards more symbiotic human-AI collaboration in digital workspaces.

AI PointerHuman-Computer InteractionAI AgentContextual AIAssistive TechnologyArtificial IntelligenceAI AgentMachine Learning

huggingface

6 stories
01

A Single Neuron Is Sufficient to Bypass Safety Alignment in Large Language Models

Safety alignment in language models operates through two mechanistically distinct systems: refusal neurons that gate whether harmful knowledge is expressed, and concept neurons that encode the harmful knowledge itself. By targeting a single neuron in each system, we demonstrate both directions of failure -- bypassing safety on explicit harmful requests via suppression, and inducing harmful content from innocent prompts via amplification -- across seven models spanning two families and 1.7B to 70B parameters, without any training or prompt engineering. Our findings suggest that safety alignment is not robustly distributed across model weights but is mediated by individual neurons that are each causally sufficient to gate refusal behavior -- suppressing any one of the identified refusal neurons bypasses safety alignment across diverse harmful requests.

Safety AlignmentLarge Language ModelsRefusal NeuronsConcept NeuronsBypassing SafetyLarge Language ModelDeep LearningNatural Language Processing
02

Qwen-Image-2.0 Technical Report

We present Qwen-Image-2.0, an omni-capable image generation foundation model that unifies high-fidelity generation and precise image editing within a single framework. Despite recent progress, existing models still struggle with ultra-long text rendering, multilingual typography, high-resolution photorealism, robust instruction following, and efficient deployment, especially in text-rich and compositionally complex scenarios. Qwen-Image-2.0 addresses these challenges by coupling Qwen3-VL as the condition encoder with a Multimodal Diffusion Transformer for joint condition-target modeling, supported by large-scale data curation and a customized multi-stage training pipeline. This enables strong multimodal understanding while preserving flexible generation and editing capabilities. The model supports instructions of up to 1K tokens for generating text-rich content such as slides, posters, infographics, and comics, while significantly improving multilingual text fidelity and typography. It also enhances photorealistic generation with richer details, more realistic textures, and coherent lighting, and follows complex prompts more reliably across diverse styles. Extensive human evaluations show that Qwen-Image-2.0 substantially outperforms previous Qwen-Image models in both generation and editing, marking a step toward more general, reliable, and practical image generation foundation models.

Qwen-Image-2.0Image GenerationImage EditingMultimodal Diffusion TransformerFoundation ModelGenerative AIMultimodalComputer Vision
03

Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs

Following the recent achievement of gold-medal performance on the IMO by frontier LLMs, the community is searching for the next meaningful and challenging target for measuring LLM reasoning. Whereas olympiad-style problems measure step-by-step reasoning alone, research-level problems use such reasoning to advance the frontier of mathematical knowledge itself, emerging as a compelling alternative. Yet research-level math benchmarks remain scarce because such problems are difficult to source (e.g., Riemann Bench and FrontierMath-Tier 4 contain 25 and 50 problems, respectively). To support reliable evaluation of next-generation frontier models, we introduce Soohak, a 439-problem benchmark newly authored from scratch by 64 mathematicians. Soohak comprises two subsets. On the Challenge subset, frontier models including Gemini-3-Pro, GPT-5, and Claude-Opus-4.5 reach 30.4%, 26.4%, and 10.4% respectively, leaving substantial headroom, while leading open-weight models such as Qwen3-235B, GPT-OSS-120B, and Kimi-2.5 remain below 15%. Notably, beyond standard problem solving, Soohak introduces a refusal subset that probes a capability intrinsic to research mathematics: recognizing ill-posed problems and pausing rather than producing confident but unjustified answers. On this subset, no model exceeds 50%, identifying refusal as a new optimization target that current models do not directly address. To prevent contamination, the dataset will be publicly released in late 2026, with model evaluations available upon request in the interim.

LLMsMath CapabilitiesResearch-level MathBenchmarkSoohakLarge Language ModelArtificial IntelligenceMachine Learning
04

CollabVR: Collaborative Video Reasoning with Vision-Language and Video Generation Models

Recent "Thinking with Video" approaches use Video Generation Models (VGMs) for visual reasoning by producing temporally coherent Chain-of-Frames as reasoning artifacts. Even strong VGMs, however, exhibit two recurring failure modes on goal-directed tasks: long-horizon drift on multi-step tasks and mid-clip simulation errors that compound. Both stem from the absence of explicit reasoning built upon the VGM's short-horizon visual prior, a role naturally filled by Vision-Language Models (VLMs), but where to place the VLM is non-trivial: upfront plans commit before any frame is generated and post-hoc critiques over whole videos intervene too late. We propose VLM-VGM Collaborative Video Reasoning (CollabVR), a closed-loop framework that couples the VLM with the VGM at step-level granularity: the VLM plans the immediate next action, inspects the clip the VGM generates, and folds the verifier's diagnosis directly into the next action prompt to repair detected failures. On Gen-ViRe and VBVR-Bench, CollabVR improves both open-source and closed-source VGMs over single-inference, Pass@k, and prior test-time scaling baselines at matched compute, with the largest gains on the hardest tasks. It also yields further improvements on top of a reasoning-fine-tuned VGM, indicating that step-level VLM supervision is orthogonal to and stackable with reasoning-oriented fine-tuning. We provide video samples and additional qualitative results at our project page: https://joow0n-kim.github.io/collabvr-project-page.

Video ReasoningVideo Generation ModelsVision-Language ModelsCollaborative AIClosed-loop SystemMultimodalVideo UnderstandingAI Agent
05

AgentForesight: Online Auditing for Early Failure Prediction in Multi-Agent Systems

LLM-based multi-agent systems are increasingly deployed on long-horizon tasks, but a single decisive error is often accepted by downstream agents and cascades into trajectory-level failure. Existing work frames this as post-hoc failure attribution, diagnosing the responsible agent and step after the trajectory has ended. However, this paradigm forfeits any opportunity to intervene while trajectory is still unfolding. In this work, we introduce AgentForesight, a framework that reframes this problem as online auditing: at each step of an unfolding trajectory, an auditor observes only the current prefix and must either continue the run or alarm at the earliest decisive error, without access to future steps. To this end, we curate AFTraj-2K, a corpus of agentic trajectories across Coding, Math, and Agentic domains, in which safe trajectories are retained under a strict curation pipeline and unsafe trajectories are annotated at the step of their decisive error via consensus among multiple LLM judges. Built on that, we develop AgentForesight-7B, a compact online auditor trained with a coarse-to-fine reinforcement learning recipe that first equips it with a risk-anticipation prior at the failure boundary on adjacent safe/unsafe prefix pairs, then sharpens this prior into precise step-level localization under a three-axis reward jointly targeting the what, where, and who of an audit verdict. Across AFTraj-2K and an external Who&When benchmark, AgentForesight-7B outperforms leading proprietary models, including GPT-4.1 and DeepSeek-V4-Pro, achieving up to +19.9% performance gain and 3times lower step localization error, opening the loop from post-hoc failures detection to enabling deployment-time intervention. Project page: https://zbox1005.github.io/agent-foresight/.

multi-agent systemsonline auditingfailure predictionLLM-based systemsreinforcement learningArtificial IntelligenceLarge Language ModelAI Agent
06

SEIF: Self-Evolving Reinforcement Learning for Instruction Following

Instruction following is a fundamental capability of large language models (LLMs), yet continuously improving this capability remains challenging. Existing methods typically rely either on costly external supervision from humans or strong teacher models, or on self-play training with static-difficulty instructions that cannot evolve as the model's capabilities improve. To address these limitations, we propose SEIF (Self-Evolving Reinforcement Learning for Instruction Following), a self-evolving framework for enhancing the instruction-following ability of LLMs. SEIF forms a closed self-evolution loop that improves the model's instruction-following ability, where instruction difficulty evolution and model capability evolution reinforce each other. SEIF consists of four roles: an Instructor that generates increasingly challenging instructions, a Filter that removes conflicting or invalid instructions to ensure data quality, a Follower that learns to follow evolved instructions, and a Judger that provides reward signals for reinforcement learning. The Instructor and Follower are alternately trained and co-evolve throughout the process. Experiments across multiple model scales and architectures show that SEIF consistently improves instruction-following performance, suggesting strong generality. Further analyses reveal the sources of improvement and identify an effective training strategy for self-evolution on open-ended tasks: sufficient early-stage training to build a solid foundation, followed by moderate late-stage training to mitigate overfitting and achieve better final performance. The code and data are publicly available at https://github.com/Rainier-rq1/SEIF.

Self-Evolving Reinforcement LearningInstruction FollowingLarge Language ModelsSelf-EvolutionReinforcement LearningLarge Language ModelNatural Language ProcessingAI Agent