AIO APEX

AI inference startup borrows $400 million against chips instead of GPUs

TechCrunch
Share:
AI inference startup borrows $400 million against chips instead of GPUs

General Compute, an AI inference cloud startup, has secured a $400 million loan from tech investment firm Upper90 using its inference chips as collateral, marking the first known instance of non-Nvidia AI chips backing a financing deal at this scale, as first reported by TechCrunch. The chips in question are SambaNova SN50 processors, hardware built by the Intel-backed chipmaker specifically to run already-trained AI models rather than train new ones.

Why inference chips, not GPUs

Training a large language model and running it in production are fundamentally different computational jobs. Training requires the raw parallel processing power Nvidia's GPUs are built for; inference — the actual work of answering a user's prompt once a model exists — has different bottlenecks, and specialized inference chips like SambaNova's SN50 are optimized specifically for that job. General Compute says its SN50-based infrastructure delivers inference roughly 16 times faster than comparable GPU-based cloud services, while requiring no water cooling, which lowers both operating costs and data center buildout complexity.

General Compute, led by CEO Finn Puklowski, previously raised $15 million in a May 2026 funding round. The jump from a $15 million equity raise to a $400 million debt facility in roughly two months reflects both rapid customer growth and a financing structure — chip-backed lending — that venture debt firms have historically reserved almost exclusively for Nvidia hardware, which retains predictable resale value on a well-established secondary market.

What makes this financing structure new

Upper90, led by CEO Billy Libby, a former Goldman Sachs quantitative trader, is betting that SambaNova's inference chips hold enough resale and utility value to serve as loan collateral the way GPUs typically do. That's a meaningful underwriting decision: GPU-backed lending works because Nvidia hardware has deep secondary market liquidity and near-guaranteed demand. Extending the same collateral logic to a competitor's chips is a bet that inference-specific silicon is becoming similarly bankable — which, if it holds, opens a new financing channel for AI infrastructure companies that don't want to build exclusively on Nvidia.

The bigger signal: Nvidia's monopoly narrative is being tested

Puklowski described the deal as an early signal of "capital organizing itself" around alternatives to Nvidia's dominant position in AI compute. Nvidia's GPUs remain the default choice for both training and much of production inference today, commanding pricing power that reflects near-total market control. A $400 million debt deal doesn't change that dominance overnight, but it demonstrates that institutional capital is now willing to underwrite non-Nvidia AI infrastructure at meaningful scale — a prerequisite for any real diversification of the AI compute supply chain.

Why this matters for the broader AI infrastructure market

Inference costs, not training costs, increasingly dominate AI companies' long-term operating expenses once a model ships and scales to millions of users. Cheaper, purpose-built inference infrastructure directly affects the unit economics of every AI product built on top of it. If chip-backed lending against non-Nvidia hardware becomes a repeatable financing pattern rather than a one-off deal, it could accelerate investment in inference-specialized chipmakers — SambaNova, Groq, and others — by giving their infrastructure customers a debt financing path that was previously available only to companies running on Nvidia GPUs.

Originally reported by TechCrunch. Read the original article for additional details.

View original source
Share: