Secondhand Compute as Inference Infrastructure

I. TL;DR + Edge Summary

Sellers on Carousell, Xianyu, and eBay list RTX 3090s as gaming cards and used Mac Studios as consumer electronics. They are actually selling AI inference nodes. The information gap is real: secondhand sellers price by consumer electronics comps, not by AI infrastructure comps. The structural gap is also real: institutional buyers cannot purchase Mac Studios on Carousell — they buy new, in volume, from Apple. Individual buyers access a market that institutions structurally cannot.

The One-Line Edge

Bandwidth is the only metric that matters for autoregressive LLM inference. Every token generated requires loading all model weights through memory once. GB/s beats TFLOPS. Secondhand sellers price by TFLOPS (gaming benchmarks). We buy by GB/s (inference throughput). That is the entire thesis.

II. Investment Thesis

The Core Claim

Second-hand consumer compute hardware is systematically mispriced relative to its value as AI inference nodes. The mispricing arises from two structural conditions: (1) sellers use consumer electronics pricing frameworks (gaming GPU benchmarks, consumer laptop resale comps) rather than infrastructure pricing frameworks (GB/s of memory bandwidth, GB of VRAM, token throughput), and (2) the buyers who would correctly price this hardware — hyperscalers, AI companies, data centers — are structurally excluded from the secondhand consumer market. They buy new, in bulk, via enterprise contracts. A Mac Studio M2 Ultra 192GB cannot be procured on Carousell at any price by an institution. An individual can buy it there for $1,800–2,200.

Critical Assessment: Hidden Assumptions

Before treating this as an investment, six hidden assumptions must be surfaced and stress-tested.

Adversarial Challenges

III. Consensus Map

Understanding where consensus sits determines where edge exists. Consensus-priced assets have no alpha. Below-consensus assets where our model disagrees have edge.

Practitioner Sentiment Breakdown

RTX 3090 — Sentiment: Neutral/Mixed (+10). Threads: “RTX 3090 in 2026” and “Talk me out of buying RTX 3090 just for local AI.” The practitioner consensus is ambivalent: 24GB is tight for 70B models, the card is aging, and the RTX 4090 exists. This ambivalence is the edge — the market has not bid up RTX 3090 prices to reflect its actual inference throughput. Our thesis: CONTRARIAN. Neutral sentiment on a card with 936 GB/s bandwidth at $600–900 is the signal.

Mac mini M4 Pro 64GB — Sentiment: Bullish (+30). Thread “Mac Mini looks compelling now... Cheaper than a 5090 and near double the VRAM” had 911 upvotes. This is forming consensus. When r/LocalLLaMA is bullish at +30, the edge is shrinking. Our thesis: ALIGNED but edge is narrowing. The M4 Pro is correctly valued. Wait for M5 release to drop M4 prices, or focus on M2 Ultra used instead.

IV. Edge Model

Why Bandwidth Is the Only Metric That Matters

Autoregressive LLM inference is memory bandwidth-bound, not compute-bound. Every token generated requires loading all model weights through memory exactly once. A 70B parameter model at Q4 quantization occupies approximately 40GB. Generating one token requires moving 40GB of data through the memory system. At 936 GB/s (RTX 3090), that is 40GB ÷ 936 GB/s = 42.7ms latency per token, or approximately 23 tokens/second, ignoring other bottlenecks. TFLOPS determine how fast you compute the attention mechanism — which adds roughly 10–20% to total latency on large batches but is negligible at batch size 1 (single-user inference). Therefore: GB/s is what you buy. TFLOPS are marketing.

The No-Lose Price Formula

No-lose price = (inference value generated × P(thesis holds))
              + (resale value as consumer electronics × P(thesis breaks))
              - electricity cost over holding period
              - time cost (acquisition + management + exit)

The formula reveals the key insight: when the consumer electronics resale floor is high enough, you do not need the thesis to hold to avoid losing money. The inference value is pure upside on top of an already-safe resale position.

Per-SKU Value Analysis

RTX 3090 — Core Buy

A40 48GB — The Passive Cooler Discount

The A40 is a 48GB GDDR6 workstation card at 696 GB/s. It runs 70B models comfortably and 405B at aggressive quantization. It is cheap not because it underperforms, but because its passive cooler requires a server chassis or DIY open-air cooling. Workstation builders avoid it. The play: add $50 in fans to an open-air rig and unlock 48GB at 696 GB/s for $1,800–2,200. The A6000 Ampere (identical VRAM, better bandwidth) costs $2,200–3,500. The A40 is the same capacity at a slight bandwidth penalty and $400–1,700 cheaper. If you can handle the passive cooler friction, this is exceptional value per GB.

M2 Ultra 192GB — Highest Conviction

This is the highest-conviction position in the entire universe. The M2 Ultra Mac Studio with 192GB unified memory launched at $6,000–7,000+. Used it trades at $1,800–2,200 because buyers treat it as a consumer Mac desktop. It is not. It is 192GB of unified memory at 800 GB/s — the memory bandwidth of an A100 40GB ($8,000–14,000 used), at one-fifth the cost, running Llama 3.1 405B at Q4, DeepSeek 67B comfortably, and Llama 3.3 70B at full precision. The structural edge: Apple does not sell 192GB Mac Studios at used prices in volume. An AI lab cannot procure 100 of these from Carousell. You can procure one.

V100 32GB PCIe — HBM2 at Consumer Pricing

The V100 PCIe 32GB offers 897 GB/s of HBM2 bandwidth at $600–1,200 used. HBM2 is the memory architecture used in data center GPUs; its bandwidth-per-dollar ratio at these prices is exceptional. The caveats are real: PCIe 3.0 limitation, aging Volta architecture with driver quirks, and model scale may outpace 32GB faster than 48GB+ options. This is a speculative position for buyers comfortable with the operational overhead of legacy data center hardware in consumer settings.

RTX 3090 Ti — The Overlooked Bandwidth Leader

The RTX 3090 Ti offers 1,008 GB/s — equal to the RTX 4090 — at $700–1,100. The Ti suffix causes buyers to anchor on gaming benchmarks (“overkill”) rather than inference throughput (“bandwidth leader”). The RTX 4090 at the same bandwidth costs $1,600–2,000 and draws 50W more power. At $700–900, the 3090 Ti is systematically underpriced for inference relative to its bandwidth spec. It often appears in listings beside regular 3090s with only a 10–15% price premium despite 7.7% higher bandwidth. This is a pricing anomaly driven by naming convention confusion.

V. Investment Universe

Bandwidth per Dollar (Inference Efficiency)

Note: M2 Ultra scores lower on GB/s per dollar but uniquely enables 192GB unified address space for models that cannot be quantized onto smaller VRAM without significant quality loss. The metric above does not capture the “model fits or does not fit” binary — where M2 Ultra is the only consumer option that runs 405B-class models at all.

VI. Risk Factors

Risk Scenario Matrix

VII. Monitoring Dashboard

These are the signals to track on a monthly basis to confirm or invalidate the thesis.

Thesis Confirmation Signals

Exit Triggers

• EXIT RTX 3090/Ti: r/LocalLLaMA sentiment exceeds +25, OR eBay median price exceeds $1,100, OR Llama 4 requires 48GB+ for practical 70B-class inference
• EXIT M2 Ultra: Secondhand price exceeds $3,000 (profit-take), OR Apple releases M4 Ultra Mac Studio dropping M2 Ultra below $1,200 (reassess position)
• EXIT all positions: Commodity API blended price falls below $0.15/M tokens (electricity breakeven at heavy use)
• DO NOT EXIT on news alone: Wait for actual price signals, not announcements. Model release speculation does not move secondhand prices reliably

VIII. Sensor Network

Sensors Currently Active

Signal Gaps

Recommended Sensor Build

Priority sensor to build: a hardware price alert monitor for specific SKUs on Carousell SG/HK and Xianyu. Target implementation: a lightweight Python scraper that runs daily, extracts listings for RTX 3090, RTX 3090 Ti, A40 48GB, and M2 Ultra 192GB, and writes to a time-series store. Alert on: median price crossing the buy threshold upward (edge is closing) or downward (buying opportunity).

# Sensor spec: secondhand_compute_price_monitor
SKUs = [
    "RTX 3090",           # buy_threshold: $800
    "RTX 3090 Ti",        # buy_threshold: $900
    "A40 48GB",           # buy_threshold: $2,200
    "Mac Studio M2 Ultra 192GB",  # buy_threshold: $2,000
    "V100 32GB",          # buy_threshold: $800
]

Sources = ["carousell_sg", "carousell_hk", "xianyu", "ebay_sold"]

Alerts = {
    "below_threshold": "BUY SIGNAL — price below no-lose threshold",
    "above_exit":      "EXIT SIGNAL — price above model price, edge closing",
    "volume_spike":    "SUPPLY SIGNAL — unusual listing volume (impending oversupply)"
}