Inference Brew

Anthropic's Cheaper Opus 5 Overtakes Fable 5 in Corporate Spending

00:00 / --:--

← Back to home

Anthropic's Cheaper Opus 5 Overtakes Fable 5 in Corporate Spending

1. Anthropic's Cheaper Opus 5 Overtakes Fable 5 in Corporate Spending

Within a month of its launch, Anthropic's Opus 5 has overtaken Fable 5 in corporate spending, driven by its 50% lower price point. While Fable 5 is designed for long, autonomous projects requiring multi-step coherence, businesses are leveraging low switching costs to route routine tasks to the more economical Opus 5, even though it may require more attempts or human review.

  • • Opus 5 surpassed Fable 5 in corporate model spending within one month of its launch.
  • • Opus 5 is priced at half the rate of Fable 5.
  • • Low switching costs allow businesses to dynamically route routine work to the cheaper model.
  • • Fable 5 remains positioned for long autonomous projects requiring coherence across connected steps.
  • • Opus 5 may require more attempts, longer prompts, or more human review than Fable 5.

Developers can optimize operational costs by using the cheaper Opus 5 for routine tasks and reserving premium models for complex autonomous projects.

SOURCES

2. Meta Releases MobileMoE On-Device Mixture-of-Experts Models

Meta has introduced MobileMoE, a family of on-device Mixture-of-Experts language models optimized for mobile hardware. Available in three scales (0.3B, 0.5B, and 0.9B active parameters), the models are designed to keep their INT4 quantized footprint under 3 GB to prevent memory exhaustion on consumer devices. The largest variant, MobileMoE-L-Base, utilizes 60 routed experts with 4 active experts per token alongside a shared expert, supporting an 8,192-token context window.

  • • MobileMoE is a family of on-device MoE models with 0.3B, 0.5B, and 0.9B active parameters.
  • • Each model scale is designed with a weight footprint of less than 3 GB in INT4 precision to fit in mobile DRAM.
  • • The MobileMoE-L-Base model features 922 million active parameters and 5.3 billion total parameters.
  • • The architecture includes 60 routed experts with 4 active experts per token and one shared expert.
  • • The models support an 8,192-token context length and were released under a FAIR NC license.

Developers can deploy highly efficient, open-weights MoE models directly on mobile devices to minimize memory usage.

SOURCES

3. Fastino Releases GLiNER2.5 for Boundary-Prediction Information Extraction

Fastino has launched GLiNER2.5, a new information extraction model that shifts from traditional span enumeration to a boundary-prediction architecture. This change removes maximum entity width restrictions and enables advanced features like joint entity-relation decoding and per-span attributes. Released under the Apache 2.0 license, the model is available in three lightweight checkpoints (74M, 194M, and 287M parameters) optimized for local self-hosting on CPU, CUDA, or MPS.

  • • Fastino released GLiNER2.5, replacing span enumeration with boundary prediction to remove entity width limits.
  • • The model supports a 4,096-word context, joint entity-relation decoding, and cross-task label constraints.
  • • Three checkpoints (74M, 194M, and 287M parameters) are available on Hugging Face under the Apache 2.0 license.
  • • The multilingual checkpoint achieved a 56.17 overall macro F1 score across 16 zero-shot benchmarks.
  • • The model is designed for self-hosting and supports CPU, CUDA, or MPS inference using Python 3.10+.

Developers can self-host a highly efficient information extraction model that supports a 4,096-word context and removes entity width restrictions.

SOURCES

4. SHADOW-250M Released as Ultra-Lightweight Local Language Model

SHADOW-250M offers an ultra-lightweight option for local inference, packing 250 million parameters into a 60 MB footprint via sub-2-bit quantization. Running on an MIT-licensed compiled runtime, the model achieves 400 tokens per second on standard laptop CPUs. Its unique architecture maintains a 2,048-token fp16 KV cache while compressing older history to 1 bit on disk, allowing developers to retrieve context from up to 100 million tokens of historical data.

  • • SHADOW-250M is a 250-million parameter model trained from scratch on 30 billion tokens of Fineweb data.
  • • The model is quantized to under 2 bits, requiring a 60 MB deployment size and 80 MB of RAM.
  • • It runs at approximately 400 tokens per second on a standard laptop CPU without a GPU.
  • • The architecture stores the most recent 2,048 tokens in an fp16 KV cache and compresses older tokens to 1 bit on disk, enabling retrieval from up to 100 million tokens of history.
  • • The model uses an MIT-licensed compiled runtime supporting Windows and Linux, and is available on GitHub and Hugging Face.

Developers can deploy an extremely fast, low-memory language model locally on standard laptop CPUs without requiring GPU acceleration.

SOURCES

5. TielCoder 35B MoE Released as High-Performance Local Coding Model

TielCoder is a new 35B-A3B Mixture of Experts model designed specifically for solving real-world codebase issues. Built on the Ornith-1.5 fine-tune, the model uses a code-weighted imatrix for dynamic quantization and an optimized chat template to maximize token efficiency during agentic execution. GGUF and MLX versions are now available on Hugging Face, offering a fast and consistent local alternative to proprietary APIs.

  • • TielCoder is a 35B-A3B Mixture of Experts-coder model built upon the Ornith-1.5 fine-tune.
  • • The model matches Opus 4.6 medium on recent real-life coding issues in its 22 GB 4-bit quantized format.
  • • It utilizes a code-weighted imatrix for dynamic quantization and a chat template optimized for token-efficient agentic coding.
  • • GGUF and MLX versions of the model are available on Hugging Face under the user peculiar-ragdoll.

Developers can run a highly efficient, 4-bit quantized local coding model that matches the performance of Opus 4.6 medium on real-world codebase issues.

SOURCES

6. Nvidia's Groq 3 LPU Rack Systems Achieve 3,400 Tokens per Second

Independent benchmarking by Artificial Analysis has revealed that Nvidia's LPX rack systems, which integrate Groq 3 LPUs, achieved 3,400 tokens per second running Google's Gemma 4 31B model. This heterogeneous architecture splits the workload, routing the compute-heavy prefill phase to GPUs and the memory-bandwidth-intensive decode phase to Groq 3 LPUs. The LPUs leverage 500 MB of onboard SRAM to deliver 150 TB/s of memory bandwidth, outperforming Cerebras's nearest alternative by four times in the benchmark.

  • • Nvidia's LPX rack systems, powered by Groq 3 LPUs, achieved 3,400 tok/s running Gemma 4 31B in independent benchmarks.
  • • The benchmarked system is reported to be 4x faster than Cerebras's platform, which recorded 882 tok/s.
  • • Groq 3 LPUs utilize an SRAM-heavy architecture providing 150 TB/s of memory bandwidth.
  • • Nvidia's heterogeneous architecture offloads the compute-heavy prefill phase to GPUs and the decode phase to Groq 3 LPUs.
  • • Each Groq 3 LPU contains 500 MB of SRAM, requiring Ethernet distribution across up to 256 LPUs per rack.

Developers running high-throughput inference can leverage new heterogeneous hardware configurations to achieve ultra-low latency.

SOURCES

7. Critical vLLM Vulnerability CVE-2025-9141 Allows Arbitrary Code Execution

Security researchers have warned that malicious LLMs can exploit vulnerabilities in modern inference engines like vLLM and SGLang to gain control of host machines. A prime example is CVE-2025-9141, an arbitrary-code execution vulnerability in vLLM's XML-based tool parser for Qwen3 Coder that allowed code execution via an unsafe eval() call. Because complex chat parsers and multimodal decoders expand the attack surface, developers are advised to isolate GPU hosts from token parsers and restrict host permissions.

  • • CVE-2025-9141 was an arbitrary-code execution bug in vLLM's XML-based tool parser for Qwen3 Coder.
  • • The vulnerability allowed the execution of arbitrary code via an unsafe eval() call.
  • • Despite critical security flags from Gemini, the lead maintainer of vLLM force-merged the changes.
  • • Multimodal architectures and complex chat format parsers increase the attack surface of modern inference engines.
  • • Proposed mitigations include separating GPU hosts from token parsers and restricting GPU host permissions.

Developers running self-hosted vLLM or SGLang instances must secure their environments, as malicious token sequences can exploit parser vulnerabilities to gain host control.

SOURCES

8. Microsoft Expands Agent Lightning with New Optimization Skill

Building on the Agent Lightning v1.0 reinforcement learning framework released on August 20, Microsoft has introduced Agent Lightning v1.0.1. This new command-line skill allows developers to systematically optimize prompts, tools, and workflows for coding agents including Claude Code, Codex, and GitHub Copilot. Developers can now integrate the optimization capabilities of the Agent Lightning ecosystem directly into their agentic pipelines to balance accuracy, cost, and latency.

  • • Agent Lightning v1.0.1 is a command-line skill that extends the Agent Lightning ecosystem.
  • • It automates the optimization of prompts, tools, and reasoning settings for coding agents.
  • • Compatible with Claude Code, Codex, and GitHub Copilot.
  • • Installation is available via the GitHub CLI: gh skill install microsoft/agent-lightning agent-lightning --agent <agent>.
  • • Includes automated benchmark reporting to track improvements in accuracy, cost, and reliability.

This release provides a practical interface for developers to apply the Agent Lightning framework's optimization logic to their active coding agents, automating improvements to prompts and reasoning settings.

SOURCES

9. Anthropic Enhances Claude Tag Slack Agent with Full Conversation Context

Building on the initial launch of the Claude Tag agent, Anthropic has updated the tool to evaluate full conversation context rather than individual messages. This enhancement improves the agent's ability to proactively intervene in team discussions by 30%. The update leverages the Model Context Protocol (MCP) to maintain secure data access, ensuring the agent's visibility remains aligned with individual user permissions.

  • • Claude Tag now evaluates full conversation history instead of isolated messages.
  • • The update improves the agent's unprompted intervention accuracy by 30%.
  • • The agent continues to use the Model Context Protocol (MCP) for secure, permission-aware data access.
  • • There is currently no additional charge for the expanded channel context feature.

This update improves the reliability of Claude Tag as a proactive team member, allowing developers to deploy more context-aware agents within Slack.

SOURCES

10. Liquid AI and Artificial Analysis Standardize Mobile Inference Benchmarking for LFM2.5 Models

Liquid AI and Artificial Analysis have introduced a mobile device inference benchmarking harness powered by the open-source Pipette app. This initiative provides standardized performance and memory metrics for the LFM2.5 model family, including the 2.6B model released earlier this month. Testing on the iPhone 17 Pro and Galaxy S26 Ultra revealed that Nanbeige4.2-3B and LFM2.5-2.6B lead the intelligence rankings with a score of 63, while highlighting the memory constraints of larger 9B models on standard 12GB devices.

  • • The benchmarking partnership uses Liquid AI's free, open-source 'Pipette' app on iOS and Android.
  • • Evaluations are conducted on the iPhone 17 Pro and Galaxy S26 Ultra under a 16K context limit.
  • • Nanbeige4.2-3B and LFM2.5-2.6B tied for the top average evaluation score of 63.
  • • LFM2.5-2.6B demonstrated higher efficiency, processing a 1,024-token prompt in 8.0 seconds using 2.3 GB of memory on an iPhone 17 Pro.
  • • Peak memory usage at 4K context ranges from 0.4GB for LFM2.5-230M to 6.9GB for Qwen3.5 9B, which heavily constrains 12GB RAM devices.

Developers can now use standardized benchmarks to evaluate the efficiency and memory footprint of Liquid AI's models on mobile hardware, facilitating better model selection for on-device applications.

SOURCES

11. OpenAI Introduces Temporary 20% Price Cut for GPT-5.6 Sol API

Following the pricing updates for the GPT-5.6 Sol model on August 17 and August 21, OpenAI has announced a further temporary price reduction of over 20% for the API, valid through at least November 21, 2026. The update also introduces a 10% price premium for regional processing endpoints on models released after March 5, 2026, and confirms the wind-down of the company's fine-tuning platform.

  • • OpenAI is offering a temporary 20% price reduction for GPT-5.6 Sol API usage through November 21, 2026.
  • • Regional processing endpoints for models released after March 5, 2026, now carry a 10% price premium.
  • • OpenAI is winding down its fine-tuning platform, blocking new signups while maintaining existing models.
  • • The API continues to support priority and fast service tiers.

Developers can further reduce their API costs for GPT-5.6 Sol workloads during this three-month promotional window.

SOURCES

12. GPU Neocloud Rate Cards Reveal B200 and B300 Pricing

A market analysis of specialized GPU neoclouds has revealed key pricing and hardware differentiators for developers scaling AI infrastructure. Lambda currently leads on-demand affordability for the NVIDIA B200 at $6.69 per GPU-hour, while Nebius stands out as the only provider publishing on-demand rates for the newer B300. For developers looking for AMD alternatives, Crusoe is the exclusive provider listing the MI300X and MI355X on its standard rate card.

  • • Lambda offers the lowest published on-demand NVIDIA B200 rate at $6.69 per GPU-hour.
  • • Nebius is the only provider in the group that publishes on-demand pricing for the NVIDIA B300.
  • • Crusoe is the only provider among the top five listing AMD MI300X and MI355X on its rate card.
  • • CoreWeave completed the industry's first bring-up and validation of the NVIDIA Vera Rubin NVL72 system in Q2 2026.
  • • CoreWeave is the sole provider rated as Platinum in the SemiAnalysis ClusterMAX 2.0 assessment.

Developers can optimize their training and inference budgets by comparing on-demand rates and hardware availability across specialized cloud providers.

SOURCES

Inference Brew in your inbox

5 minutes a day. Free, unsubscribe anytime.

Inference Brew in your inbox

5 minutes a day. Free, unsubscribe anytime.