From 53 items, 16 important content pieces were selected
- vLLM v0.22.0 Released with DeepSeek V4 Maturity and Rust Frontend ⭐️ 9.0/10
- Probe-Targeted Fine-Tuning Makes LLMs Express True Confidence ⭐️ 9.0/10
- Hacker finds critical flaws in CBSE online exam grading system ⭐️ 9.0/10
- California Assembly Passes ‘Protect Our Games Act’ ⭐️ 8.0/10
- Is AI repeating frontend’s ‘lost decade’? ⭐️ 8.0/10
- Anthropic run-rate revenue reaches $47 billion ⭐️ 8.0/10
- Loadable Crypto Module Proposed for FIPS Certification ⭐️ 8.0/10
- Protestware targets AI coding agents via jqwik library ⭐️ 8.0/10
- Monokernel achieves 3,300 tokens/s on AMD MI300X ⭐️ 8.0/10
- Qwen3.6-27B Quantization Benchmark by User ⭐️ 8.0/10
- Multi-Token Prediction speeds up inference up to 3.34x ⭐️ 8.0/10
- Nvidia teases N1X laptop chip with 20 ARM cores, 6144 CUDA cores for Computex ⭐️ 8.0/10
- StepFun Releases Step 3.7 Flash, a 196B MoE Model ⭐️ 8.0/10
- BYD offers one-year accident liability coverage for city NOA ⭐️ 8.0/10
- China Certifies Nine Domestic AI Chips for Gov Procurement ⭐️ 8.0/10
- Blue Origin’s New Glenn Rocket Explodes in Static Fire Test ⭐️ 8.0/10
vLLM v0.22.0 Released with DeepSeek V4 Maturity and Rust Frontend ⭐️ 9.0/10
vLLM released version 0.22.0 with 459 commits from 230 contributors, featuring major hardening for DeepSeek V4, progress on Model Runner V2 toward default, and an experimental Rust frontend. Key improvements include NVFP4 fused MoE support, piecewise CUDA graphs, MTP speculative decoding, and multi-tier KV cache offloading. This release significantly enhances the inference efficiency and model support for DeepSeek V4, a state-of-the-art MoE model, while pushing Model Runner V2 towards broader adoption. The experimental Rust frontend also signals vLLM’s exploration of performance-critical paths in a safer systems language. DeepSeek V4 now has a dedicated package, NVFP4 fused MoE, full and piecewise CUDA graph support, and MTP speculative decoding. Model Runner V2 gains an oracle to select it for Qwen3 dense models and automatic fallback to MRv1 when a KV connector is present.
github · khluu · May 29, 10:28
Background: vLLM is a high-throughput LLM inference engine with PagedAttention for efficient memory management. DeepSeek V4 is a Mixture-of-Experts (MoE) model that requires specialized kernel optimizations. NVFP4 fused MoE uses 4-bit floating point for faster expert computation, piecewise CUDA graphs reduce graph compilation overhead, and MTP speculative decoding uses Multi-Token Prediction drafters to speed up generation.
References
Tags: #vllm, #LLM inference, #DeepSeek, #Rust, #open source
Probe-Targeted Fine-Tuning Makes LLMs Express True Confidence ⭐️ 9.0/10
Researchers developed probe-targeted fine-tuning (LoRA) that uses internal probe signals to teach LLMs to verbalize their actual confidence in answers, achieving causal shifts verified by activation patching. This addresses the key problem of LLM miscalibration where models often express overconfident responses (99% confidence) despite internally distinguishing correct from incorrect answers with high AUROC (0.76-0.88), providing a simple, efficient method to improve trustworthiness. The method uses LoRA fine-tuning with only a few hundred examples and trains in under 10 minutes on an M3 Ultra. Activation patching experiments show a correlation of ρ=0.976 between swapped hidden states at confidence positions and expressed confidence, confirming causality.
reddit · r/MachineLearning · /u/Synthium- · May 29, 05:15
Background: Large language models often suffer from poor calibration: they can internally detect whether they know an answer (probe AUROC up to 0.88), but their verbalized confidence is stuck at nearly 100% for all responses. Probe-targeted fine-tuning leverages this internal signal by using the probe’s output as training targets for the model’s own confidence output. Activation patching is a technique that swaps model activations between runs to test whether specific activations causally influence outputs.
References
Tags: #LLM, #confidence calibration, #fine-tuning, #probe, #LoRA
Hacker finds critical flaws in CBSE online exam grading system ⭐️ 9.0/10
A researcher disclosed multiple critical security vulnerabilities in India’s CBSE online exam grading system, including hardcoded master passwords, client-side OTP validation, and SQL injection, potentially allowing grade manipulation. These vulnerabilities affect a high-stakes national examination system used by millions of students, and if exploited, could allow unauthorized grade changes, undermining the integrity of the entire examination process. The researcher found that the system used a hardcoded master password, validated OTPs entirely on the client side, allowed bypassing login pages, and had an SQL injection vulnerability; he reported to CERT-In in February 2026 but CBSE initially denied the flaws.
telegram · zaihuapd · May 29, 05:52
Background: A hardcoded password is a fixed credential embedded in source code that attackers can easily extract and use to bypass authentication. Client-side OTP validation means the one-time password is verified in the user’s browser, which can be bypassed using browser dev tools. SQL injection allows an attacker to execute arbitrary SQL commands on the database, potentially reading or modifying sensitive data.
References
Tags: #security vulnerability, #CBSE, #online exam system, #India, #cybersecurity
California Assembly Passes ‘Protect Our Games Act’ ⭐️ 8.0/10
The California State Assembly has passed the ‘Protect Our Games Act’, a bill that requires game publishers to keep digitally sold games functional or face penalties. The bill now moves to the State Senate for consideration. This legislation is a significant step for digital consumer rights and game preservation, potentially setting a precedent for other states and countries. It would force publishers to ensure that games remain playable even after server shutdowns, addressing a long-standing issue in the gaming industry. The bill excludes games provided via subscription services, free-to-play games, and games that are inherently playable offline indefinitely. It also prohibits the continued sale or distribution of games that have become unusable due to service termination.
hackernews · TechTechTech · May 29, 19:55 · Discussion
Background: Many modern games incorporate always-online DRM or require persistent server connections to function, even for single-player modes. When publishers decide to shut down these servers, the games become unplayable, leaving consumers with non-functional purchases. The Protect Our Games Act aims to require publishers to release patches or provide alternative means to keep games functional, such as removing server checks, thereby preserving consumer access.
References
Discussion: Commenters are generally supportive of the bill, but they raise concerns about potential loopholes such as publishers creating shell companies to avoid liability. Some worry that the exemptions for subscription and free-to-play games could incentivize a shift toward those models, while others wish the bill covered subscription games as well to ensure broader preservation.
Tags: #gaming, #legislation, #consumer rights, #digital preservation
Is AI repeating frontend’s ‘lost decade’? ⭐️ 8.0/10
A blog post argues that AI tools are causing a decline in frontend expertise and code quality, reminiscent of the ‘lost decade’ when frameworks like jQuery and React abstracted away fundamental web skills. This debate matters because it highlights a critical tension between AI-driven productivity gains and the erosion of deep frontend craftsmanship, potentially affecting web accessibility, performance, and overall software quality. The post references a past era where developers lost low-level skills to framework abstractions, and now AI code generation may accelerate that trend. Community comments counter that earlier shifts were largely beneficial and that AI similarly reduces accidental complexity.
hackernews · xyzal · May 29, 11:09 · Discussion
Background: The ‘lost decade’ in frontend development refers to the late 2000s when jQuery and then React, Vue, and Angular abstracted away direct DOM manipulation, leading to a generation of developers less familiar with vanilla HTML, CSS, and JavaScript. This pattern is now repeating with AI code assistants that generate entire components, further distancing developers from foundational knowledge.
References
Discussion: Comments show mixed sentiment: some agree that AI is lowering quality, while others argue that the previous era’s ‘expertise’ was often dealing with unnecessary complexity. Several commenters note that the past industry was not filled with skilled artisans, and that tradeoffs are acceptable as long as more people can build things.
Tags: #AI, #frontend development, #software engineering, #quality, #community debate
Anthropic run-rate revenue reaches $47 billion ⭐️ 8.0/10
Anthropic disclosed in its $65 billion Series H funding announcement that its run-rate revenue crossed $47 billion earlier in May 2026, up from $9 billion at the end of 2025. This rapid revenue growth—from $9B to $47B in under six months—demonstrates extraordinary enterprise adoption of AI, positioning Anthropic as one of the fastest-scaling companies in any industry and surpassing OpenAI in valuation. The run-rate is an annualized projection based on the most recent month’s revenue multiplied by 12, not to be confused with annual recurring revenue (ARR). Previous milestones include $14B in February 2026 and $30B in April 2026.
rss · Simon Willison · May 29, 01:23
Background: Run-rate revenue is a common metric for fast-growing startups, calculated by extrapolating recent monthly revenue to a full year. It gives a forward-looking estimate but can be volatile. Anthropic, the developer of the Claude AI model family, has been raising large funding rounds to scale compute, model training, and commercial expansion.
Tags: #Anthropic, #AI industry, #revenue, #funding, #business milestone
Loadable Crypto Module Proposed for FIPS Certification ⭐️ 8.0/10
A patch series by Amazon engineer Jay Wang proposes decoupling the Linux kernel crypto subsystem into a standalone loadable module, enabling a FIPS-certified module to be reused across multiple kernel versions without requiring full recertification. This proposal addresses a major pain point for organizations requiring FIPS compliance, as kernel updates currently invalidate certification and force lengthy recertification cycles, reducing the cost and delay of maintaining FIPS-certified Linux deployments. The proposal must overcome three obstacles: the build system cannot easily collect built-in objects into a module, the kernel’s one-way symbol resolution prevents modules from exporting symbols to the main kernel, and the crypto subsystem must be available early in boot before the root filesystem is mounted.
rss · LWN.net · May 29, 14:29
Background: FIPS (Federal Information Processing Standards) 140-3 certification is a rigorous validation process for cryptographic modules required by US government agencies and regulated industries. The certification is tied to the exact binary, so any kernel change invalidates it. Currently, Linux crypto is built into the main kernel, causing lengthy recertification after every update. This proposal aims to isolate the crypto code into a loadable module that can be certified once and reused across kernel versions.
References
Tags: #Linux kernel, #crypto, #FIPS, #kernel modules, #security
Protestware targets AI coding agents via jqwik library ⭐️ 8.0/10
On May 25, 2026, the jqwik property-based testing library version 1.10.0 was released with code that instructs AI coding agents to delete jqwik tests and source code, marking a novel protestware attack that evades traditional security scanners. This incident highlights a new class of supply-chain attack specifically targeting AI-assisted development workflows, where malicious instructions embedded in plain text can bypass current software composition analysis tools. It raises urgent concerns about trust in AI coding agents and the need for new detection mechanisms. The attack uses a simple System.out.print statement of 68 bytes of ASCII, making it invisible to scanners that look for install hooks, network calls, or filesystem writes. The change was committed and released by the legitimate maintainer through the normal build process, so it passes SLSA provenance checks.
rss · LWN.net · May 29, 14:09
Background: jqwik is a Java library for property-based testing, which automatically generates test cases based on properties the code should satisfy. Protestware refers to software that protests against a policy or action, often by introducing harmful behavior into the supply chain. Traditional supply-chain security tools focus on detecting network calls, file writes, or obfuscated code, but they are not designed to catch instructions embedded in plain ASCII text that target AI agents.
References
Tags: #supply-chain security, #AI agents, #protestware, #Java, #vulnerability
Monokernel achieves 3,300 tokens/s on AMD MI300X ⭐️ 8.0/10
Researchers built a monokernel that runs the entire LLM decode sequence as a single GPU program on AMD MI300X, achieving up to 3,300 output tokens per second per request without speculative decoding or quantization. This demonstrates that optimizing for hardware topology can dramatically reduce LLM inference latency on AMD GPUs, potentially closing the gap with NVIDIA H100 in low-latency serving. The work currently runs on a small 2B parameter coding model with batch size 1 on 8x MI300X GPUs, and the authors plan to extend it to large frontier mixture-of-experts (MoE) models.
reddit · r/MachineLearning · /u/averne_ · May 29, 08:54
Background: A monokernel is a single GPU kernel that fuses all operations of a model’s forward pass, reducing launch overhead and improving memory efficiency. The AMD MI300X GPU has a unique chiplet architecture with I/O dies (IODs) that connect compute units; mapping memory access patterns to the physical die layout is key to achieving peak performance.
References
Tags: #LLM inference, #GPU optimization, #AMD MI300X, #monokernel, #deep learning systems
Qwen3.6-27B Quantization Benchmark by User ⭐️ 8.0/10
A user benchmarked multiple quantizations of the Qwen3.6-27B model using Kullback-Leibler Divergence (KLD) and Same Top P metrics, comparing Unsloth, mradermacher, and other quantized versions from Q8 down to Q2. This benchmark provides practical guidance for practitioners deploying Qwen3.6-27B locally, helping them choose quantization levels with optimal quality-VRAM trade-offs based on objective metrics rather than anecdotal reports. The tests used llama.cpp’s llama-perplexity with a context length of 8192 tokens and KV cache quantized to q8_0 to fit the model in GPU. Results show Unsloth’s Q4_K_XL offers a good quality compromise, while mradermacher’s Q6_K outperforms Unsloth’s Q6_K in KLD and token selection match.
reddit · r/LocalLLaMA · /u/bobaburger · May 29, 17:53
Background: Quantization reduces the precision of a model’s weights to lower bit widths (e.g., from FP16 to 4-bit), decreasing memory usage and increasing inference speed at the cost of some accuracy. KLD measures how much the output probability distribution of a quantized model deviates from the original, while Same Top P tracks how often the quantized model chooses the same top token as the base model.
References
Tags: #LLM, #quantization, #benchmark, #Qwen, #local LLM
Multi-Token Prediction speeds up inference up to 3.34x ⭐️ 8.0/10
A Reddit user benchmarked Multi-Token Prediction (MTP) on Gemma 4 31B and Qwen 3.6 27B using vLLM and llama.cpp, achieving up to 132.52 tok/s (3.34x faster) on an RTX PRO 6000 Blackwell GPU. MTP is a speculative decoding technique that dramatically improves inference throughput without significant quality loss, making large dense models more practical for real-time applications and local deployment. The best result was vLLM with Gemma 4 at n=5 speculative tokens achieving 132.52 tok/s vs 39.69 tok/s baseline; llama.cpp with Qwen 3.6 peaked at 117.70 tok/s with n=3. The draft model is tiny (76M parameters for Gemma 4) and VRAM overhead appeared negligible.
reddit · r/LocalLLaMA · /u/FantasticNature7590 · May 29, 20:42
Background: Multi-Token Prediction (MTP) is a speculative decoding technique where a lightweight draft model predicts multiple future tokens, and the target model verifies them in a single forward pass. This amortizes memory bandwidth costs and speeds up autoregressive decoding. vLLM and llama.cpp are popular open-source inference engines that have recently added MTP support. GGUF is a quantization format for efficient local deployment.
References
Tags: #Multi-Token Prediction, #vLLM, #llama.cpp, #LLM inference, #benchmarking
Nvidia teases N1X laptop chip with 20 ARM cores, 6144 CUDA cores for Computex ⭐️ 8.0/10
Nvidia has teased a new ARM-based laptop processor, the N1X, featuring 20 ARM cores and 6144 CUDA cores based on the Blackwell architecture. The chip is expected to be officially announced at Computex on June 2, 2026, and is essentially a lower-power version of the DGX Spark superchip. This marks Nvidia’s major push into the PC laptop market with its own ARM CPU, potentially challenging AMD’s Strix Halo and Qualcomm’s Snapdragon X. The chip’s high CUDA core count could make it exceptionally powerful for local LLM inference on laptops. The N1X is expected to be a variant of the GB10 Grace Blackwell Superchip used in the DGX Spark, but optimized for lower-power laptop systems. Early leaks suggest a heterogeneous ‘big-little’ architecture and support for up to 128GB of unified memory, though software support and pricing remain key concerns.
reddit · r/LocalLLaMA · /u/Terminator857 · May 29, 18:07
Background: Nvidia has traditionally focused on discrete GPUs for gaming and professional use, while leaving CPU design to partners like Intel and AMD. The N1X represents Nvidia’s first serious attempt at creating its own Arm-based CPU for laptops, developed in collaboration with MediaTek. This follows similar efforts by Apple with its M-series chips and Qualcomm with the Snapdragon X series. The DGX Spark is a desktop AI supercomputer priced around $4,700, aimed at developers and researchers.
References
Discussion: Reddit commenters are excited about the hardware specs but remain skeptical about software support, especially for Windows on ARM and gaming compatibility. Many note that Nvidia must address the poor market reception of previous ARM laptop efforts by Microsoft and Qualcomm. Pricing is a major point of discussion, with hopes that the N1X laptops will be significantly cheaper than the $4,700 DGX Spark.
Tags: #Nvidia, #ARM, #Laptop Chip, #LLM, #Computex
StepFun Releases Step 3.7 Flash, a 196B MoE Model ⭐️ 8.0/10
StepFun has released Step 3.7 Flash, a multimodal Mixture-of-Experts model with 196B total parameters (11B active), capable of running locally on 128GB RAM and achieving strong benchmark results on coding and agentic tasks. This model provides a compelling local deployment option that rivals larger models on agentic and coding benchmarks, which is particularly relevant for the local LLM community and agent workflow development. The model includes a built-in 1.8B ViT for vision, and its benchmarks include SWE-Bench Pro 56.26% (beating DeepSeek V4 Flash and matching Gemini 3.5 Flash), DeepSearchQA F1 92.82%, and HLE with tools 47.2%. It is available on OpenRouter and NVIDIA NIM for those who prefer not to self-host.
reddit · r/LocalLLaMA · /u/Everlier · May 29, 00:32
Background: MoE (Mixture of Experts) models activate only a subset of parameters per token, enabling large total capacity with lower computational cost. SWE-Bench Pro is a challenging benchmark for real-world software engineering tasks, and DeepSearchQA evaluates multi-step information-seeking ability. StepFun is a Chinese AI company focused on developing efficient large language models.
Tags: #LLM, #MoE, #Local LLM, #Multimodal, #Model Release
BYD offers one-year accident liability coverage for city NOA ⭐️ 8.0/10
BYD announced that it will provide one-year accident liability coverage for its City Navigation Assisted Driving (city NOA) system, covering all economic losses for the vehicle involved in accidents caused by assisted driving, with no upper limit. This policy could set a precedent in the automotive industry, boosting consumer confidence in assisted driving technology and potentially accelerating adoption of autonomous driving features. The coverage applies to new car buyers of DiPilot A and B systems for one year from delivery, and also to existing owners who upgrade to DiPilot 5.0. The DiPilot C system is priced at 12,000 yuan for new car selection.
telegram · zaihuapd · May 29, 01:03
Background: City Navigation Assisted Driving (city NOA) is an advanced driver-assistance system that enables autonomous navigation on urban roads, including lane changes, turns, and traffic light response. BYD’s DiPilot (Tianshen Zhiyan) is its suite of assisted driving systems, with variants A, B, and C offering different levels of capability. Liability for accidents during assisted driving has been a key concern for consumers and regulators.
Tags: #Autonomous driving, #Automotive, #BYD, #Assisted driving, #Liability
China Certifies Nine Domestic AI Chips for Gov Procurement ⭐️ 8.0/10
China’s Information Security Evaluation Center for the first time added an ‘AI training and inference chip’ category to its security certification framework, certifying nine domestic AI processors for government procurement. The certified chips include products from Huawei (Ascend), Alibaba (Pingtouge Zhenwu), Biren Technology, and Hygon, while Cambricon and Baidu’s Kunlun Core were not listed. This marks a significant policy shift by officially endorsing domestic AI chips for government use, potentially accelerating the replacement of foreign chips (like NVIDIA) in China’s public sector and boosting the domestic AI hardware ecosystem. The certification is valid for three years and serves as the procurement basis for government agencies and state-owned enterprises. The nine chips cover a range of AI acceleration capabilities, but specific performance benchmarks were not disclosed.
telegram · zaihuapd · May 29, 08:41
Background: The ‘Anke’ security procurement catalog is a list of approved hardware and software for Chinese government use, focusing on information security and self-reliance. Previously, it mainly covered CPUs and other components; this is the first time AI accelerators have been included. Huawei’s Ascend series, for example, is designed for AI training and inference using a proprietary architecture.
Tags: #AI chips, #China, #government procurement, #security certification, #technology policy
Blue Origin’s New Glenn Rocket Explodes in Static Fire Test ⭐️ 8.0/10
On May 28, 2026, Blue Origin’s New Glenn rocket exploded during a static fire test at Cape Canaveral, destroying the vehicle and damaging launch infrastructure, with no injuries reported. This explosion severely delays Blue Origin’s launch schedule and impacts NASA’s Artemis lunar landing plans, as Blue Origin is contracted for lander and rover deliveries, and also disrupts Amazon’s Project Kuiper satellite deployment. The explosion occurred during a static fire test of seven BE-4 methane engines on the first stage; the vehicle was lost and the launch pad’s lightning protection tower collapsed. The NG-4 mission was to launch 48 Project Kuiper satellites.
telegram · zaihuapd · May 29, 11:08
Background: New Glenn is Blue Origin’s heavy-lift reusable rocket powered by seven BE-4 engines burning liquid methane and oxygen. Static fire tests are routine pre-launch checks where engines are briefly ignited while the rocket is held down. This explosion is a major setback for Blue Origin, which has yet to achieve orbital flight with New Glenn.
References
Tags: #space, #Blue Origin, #New Glenn, #NASA, #rocket explosion