Startup Diligence
Diligence report AI inference infrastructure Late-stage private (Series F) 2026-10-12

Baseten

AI inference infrastructure with strong growth but thin disclosure

Baseten combines elite AI inference growth with meaningful disclosure and capital-intensity gaps, keeping the latest call at track/research more despite a strong operating story.

Coverage and disclosure

Public disclosure remains incomplete for audited revenue, margins, burn, runway, retention, customer concentration, and full governance terms. The valuation view reflects the latest public tranche range rather than a verified fair-value estimate.

Cover facts

Enterprise customers 04
100+ accounts [CI007, CO011]
Headcount 05
147 employees [CO012]

Company profile

Baseten is a late-stage private AI inference infrastructure company that serves production model workloads for AI-native startups and regulated enterprises through Truss packaging, multi-cloud orchestration, dedicated clusters, and self-hosted VPC deployments. The company reports strong customer adoption and rapid run-rate growth, but public diligence still depends on limited financial disclosure, retention data, and governance transparency.

Website
www.baseten.co
Founded
2019-01-01
Founders
Tuhin Srivastava, Amir Haghighat, Philip Howes, Pankaj Gupta
Founding location
San Francisco, California
Headquarters
San Francisco, California
Product
Baseten provides AI inference infrastructure for deploying, optimizing, and serving machine learning models in production across managed, hybrid, and self-hosted environments.
Customers
AI-native startups and regulated enterprises
Business model
Usage-based and capacity-driven enterprise infrastructure
Stage
Late-stage private (Series F)
Funding status
Series F announced in June 2026 at a $11B-$13B tranche range, with more than $2.08B raised cumulatively across prior rounds.
[CO001, CO002, CO004, CO005, CO006, CO007, CO011, CO012, CV001, CV003, CV004, CI003, CI004, CI005, CI007, CI010]

Executive summary

Top strengths

  • Strong reported scale in production inference and multi-cloud serving
  • Named enterprise and AI-native customer adoption across multiple verticals
  • Large capital base that supports continued infrastructure expansion

Top risks

  • Audited financials, margin, burn, and retention data remain undisclosed
  • GPU supply, compute economics, and capital intensity can compress returns
  • Hyperscaler bundling and specialized competitors can pressure pricing

Open gaps

  • Audited revenue, gross margin, burn, runway, and customer-concentration data are not public
  • No public evidence resolves retention metrics such as NRR, churn, or contract duration
  • Governance visibility remains limited for board composition, committees, and voting control
  • Contract-level SLA, BAA, DPA, and incident-history evidence is still incomplete

Contents

Chapter 01

01Company Overview

1.1 Corporate Identity and Model Inference Architecture

Baseten (legal entity BaseTen Labs, Inc.) was founded in 2019 and is headquartered in San Francisco, California, operating in the AI inference infrastructure sector. The company provides a high-performance software platform designed to solve the critical operational bottleneck between trained machine learning models and real-time production serving. Its offering encompasses containerization via the open-source Truss framework, automated compilation using engines like TensorRT-LLM and vLLM, custom model runtimes, and cross-cloud GPU scheduling across managed and self-hosted environments. Rather than focusing on model training or raw GPU reselling, Baseten specializes exclusively in production inference execution, offering enterprise-grade security including SOC-2 Type II certification and HIPAA compliance.[CO001, CO002, CO006, CO007]

Snapshot KPI Table
MetricValue or StatusAs of DateConfidenceNotes and Evidence Gaps
Valuation$5,000M (Series E) to $13,000M (Series F reported)2026-06MediumSeries E $5.0B verified via official release; Series F up to $13.0B reported by press and investors.
Total Capital Raised$585M (verified Series E) / $2,080M (reported Series F)2026-06High$585M lifetime through Series E officially confirmed; Series F adds $1.5B.
Annualized Revenue / Run-Rate$35M–$60M (Series C estimate) / $600M run-rate reported2026-03MediumCompany does not publish audited GAAP revenue or ARR; numbers represent market estimates and media reports.
Enterprise CustomersOver 100 enterprise organizations2026-07MediumIncludes named anchor accounts such as Cursor, Abridge, Notion, Clay, and OpenEvidence.
HeadcountApproximately 147 to 258 employees2026-10MediumGrown from ~60 in early 2025; hiring aggressively across engineering and GTM.
Headquarters & OfficesSan Francisco, CA (HQ); Manhattan, NY; global remote2026-10HighFounded and headquartered in San Francisco with distributed engineering presence.

Data compiled from official corporate press releases, investor announcements, and tech industry financial reporting. Baseten does not publicly disclose audited financial statements; unconfirmed metrics are flagged as diligence gaps.

[CO001, CO004, CO005, CO010, CO011, CO012]
FO001: Company Milestone Timeline

Chronological progression of Baseten from 2019 founding through major financing rounds, open-source Truss adoption, and multi-cloud scaling to 2026.

All funding dates and milestone timing correspond to corporate announcements and official press reporting; product launch dates represent approximate calendar periods.

Company Incorporation [CO001, CO002]

Seed Financing [CO004]

Series A Financing [CO004]

Inference Infrastructure Pivot & Truss [CO001, CO007]

Series B Financing [CO004]

Series C Financing ($825M Valuation) [CO004, CO010]

Series D Financing ($2.15B Valuation) [CO004]

Acquisition of Parsed [CO007]

Series E Financing ($5.0B Valuation) [CO004, CO009]

Series F Financing (Up to $13.0B Valuation) [CO005, CO010]

[CO001, CO004, CO005, CO007, CO009, CO010]

1.2 Executive Leadership, Founder Backgrounds, and Governance

Baseten was co-founded by CEO Tuhin Srivastava, CTO Amir Haghighat, Chief Scientist Philip Howes, and Pankaj Gupta. Srivastava and Howes previously co-founded HR analytics startup Shape (acquired by Reflektive in 2018) after working as machine learning engineers at Gumroad, where Haghighat served as Head of Engineering. Gupta contributed deep distributed systems expertise from his tenure at Uber. The founding team combines technical fluency in machine learning workflows with systems-engineering background. Key-person dependency is concentrated across the core technical leadership, particularly given the specialized performance engineering required to operate low-latency inference runtimes. Comprehensive public disclosure regarding board committee structures, independent directors, and founder equity voting control remains unavailable.[CO002, CO003, CO008]

Leadership and Founder Table
PersonRoleBackgroundFounder-Market Fit & Domain FocusKey-Person Dependency
Tuhin SrivastavaChief Executive Officer & Co-FounderFormer co-founder of Shape (acquired by Reflektive in 2018); former ML engineer at Gumroad; educated in Australia.Executive leadership, strategic compute procurement, enterprise customer partnerships, and vision for the Inference Cloud.High: primary spokesperson, key commercial strategist, and driving force behind infrastructure capital deals.
Amir HaghighatChief Technology Officer & Co-FounderFormer Head of Engineering at Gumroad (2012); engineering manager at Clover Health.Core systems engineering, multi-cloud Kubernetes orchestration, low-latency API architecture, and platform reliability.High: architect of the distributed inference engine, multi-cloud scheduler, and production reliability frameworks.
Philip HowesChief Scientist & Co-FounderFormer co-founder of Shape; machine learning engineer at Gumroad; machine learning researcher.Model optimization research, runtime compiler integrations (TensorRT-LLM, vLLM), quantization, and kernel performance.High: leads fundamental inference acceleration research and AI model optimization methodologies.
Pankaj GuptaCo-FounderFormer software engineer at Uber specializing in scalable distributed backend infrastructure.Infrastructure scalability, distributed storage, platform stability, and enterprise tooling integrations.Medium: foundational architectural contributor to early platform scalability and containerized workflows.

Profiles assembled from verified corporate history, team communications, and public career records. All four co-founders remain actively engaged with Baseten.

[CO002, CO003]

1.3 Capitalization History, Lead Investors, and Valuation Trajectory

Baseten's financing trajectory illustrates an extraordinary acceleration in private valuation and institutional backing. Following an initial seed investment from Greylock Partners in 2019 and a $12 million Series A in 2022, the company completed a $40 million Series B in March 2024. In February 2025, Baseten raised a $75 million Series C at an $825 million post-money valuation. Momentum surged further with a $150 million Series D led by BOND in September 2025 at $2.15 billion, culminating in a $300 million Series E in January 2026 at a $5.0 billion valuation co-led by IVP and CapitalG with a $150 million strategic investment from NVIDIA. Later reporting in June 2026 indicated an oversubscribed $1.5 billion Series F led by Altimeter Capital at up to a $13.0 billion headline valuation, bringing cumulative capital raised to $2.08 billion.[CO004, CO005, CO009, CO010]

Stakeholder or Investor Map
StakeholderRoleControl or Economic ImportanceDiligence Ask
IVP (Institutional Venture Partners)Lead Investor (Series B, Series C, Series E co-lead)Major economic stake across consecutive growth rounds; influential governance voice.Confirm formal board representative, voting agreements, and information rights across preferred share classes.
CapitalG (Alphabet)Co-Lead Investor (Series E)Strategic growth sponsor with enterprise scaling expertise and hyperscaler relationships.Review contractual governance provisions and assess whether ties to Google Cloud influence compute routing.
NVIDIAStrategic Anchor Investor ($150M in Series E)Critical hardware partner; formal validation of Baseten as premier inference distribution layer.Verify hardware allocation commitments, Blackwell B200 early-access guarantees, and any co-marketing exclusivity.
Altimeter CapitalLead Investor (Series F)Lead for massive $1.5B late-stage growth round; substantial economic ownership at $13B valuation.Inspect liquidation preferences, valuation ratchets, and anti-dilution protections attached to the dual-tranche round.
BONDLead Investor (Series D)Anchored $150M Series D at $2.15B valuation; growth-stage governance participant.Examine Series D protective provisions and voting alignment with early venture syndicate.
Spark CapitalCo-Lead Investor (Series B, Series C, Series F)Longstanding venture backer from early growth through multi-billion-dollar scale.Evaluate cumulative equity share, pro-rata exercise patterns, and secondary liquidity participation.
Greylock PartnersEarly Lead Investor (Seed, Series A)Foundational venture partner from inception through initial product pivot.Assess original founding governance covenants and current board representation.

Enumerates major institutional and strategic investors leading equity rounds in Baseten. Minor angel and non-lead participants are excluded from detailed profiling.

[CO004, CO005, CO009]

1.4 Commercial Scale, Utilization Pressures, and Operational Constraints

Baseten serves mission-critical workloads for leading AI-native businesses including Cursor, Abridge, Clay, OpenEvidence, Lovable, and Notion. Platform usage expanded rapidly through 2025 and 2026, with leadership reporting that 95% of processed tokens stem from custom, fine-tuned customer models rather than off-the-shelf public weights. However, this explosive demand introduces severe operational and capital headwinds. Fleet GPU utilization across 90 clusters and 18 clouds has reached the mid-90s—a level management characterizes as uncomfortably high amid global compute scarcity. Acquiring next-generation GPU hardware such as NVIDIA Blackwell B200s increasingly demands multi-year supply commitments with 20% to 30% upfront cash prepayments, creating substantial working capital requirements. Furthermore, unaudited revenue figures, undocumented net revenue retention, and hyperscaler competition from AWS, Google Cloud, and Azure represent major diligence gaps.[CO011, CO012, CO013, CO014]

1.5 Exhibits

Chapter 02

02Market Analysis

2.1 Market Boundary, Workload Scope, and Spend Allocation

The production artificial intelligence market is experiencing a structural bifurcation between model training and model inference. While the initial wave of enterprise generative AI investment centered heavily on foundation model pre-training—consuming massive capital expenditures on multi-thousand GPU clusters—production economics are dictated by the inference phase. Inference represents the ongoing execution of trained models to generate predictions, process structured outputs, and power user-facing software applications. Unlike training workloads, which are intermittent and batch-oriented, inference workloads are latency-critical, persistent, and scale proportionally with user engagement. As organizations mature their artificial intelligence initiatives, model spend is actively transitioning from broad exploration to dedicated model serving. Industry application-layer companies now allocate thirty to fifty percent of their model budgets specifically toward custom and post-trained open-source architectures rather than relying exclusively on closed frontier model APIs. This workload shift redefines the addressable market boundaries: raw compute leasing is commoditizing, while specialized middleware and runtime software that optimize latency, orchestration, and multi-cloud resilience command durable enterprise value.[CM001, CM004]

AI Inference Market Definition and Scope of Spend
Segment / CategoryIncluded SpendExcluded SpendBuyer / PayerStrategic Relevance
Dedicated Model ServingDedicated GPU instance hosting, containerization (Truss), latency optimization engines (TensorRT-LLM, vLLM), and autoscalingModel pre-training cluster compute, foundational dataset collection, and general web hostingVP Engineering, Head of ML, AI Product TeamsCore platform offering representing highest recurring spend and enterprise contract value
Hosted Model APIsPay-per-token API endpoints for open-weight models (DeepSeek, Llama, Mistral) with OpenAI-compatible interfacesProprietary frontier model subscriptions (ChatGPT Plus, Claude Pro) and raw unmanaged VMsSoftware Engineers, Prototype Developers, AI Application ArchitectsLow-friction developer on-ramp and fast prototyping channel converting to dedicated clusters
Post-Training & Fine-TuningSupervised fine-tuning (SFT), reinforcement learning (RL/GRPO), continual learning workflows, and sampler toolingLarge-scale frontier model foundation training runs and multi-thousand H100 pre-training clustersApplied AI Researchers, ML Platform EngineersHigh-margin capability enabling customers to build proprietary model intelligence tied to inference
Multi-Cloud Capacity ManagementCross-cloud GPU orchestration, regional routing, failover across 18+ cloud providers, and hybrid VPC burstPhysical data center construction, raw power procurement, and silicon fabricationChief Information Officer, Chief Technology Officer, Cloud ProcurementEliminates single-provider GPU allocation constraints and provides disaster resilience

Market definition categorizes software runtime and orchestration services versus commoditized raw compute infrastructure and frontier training runs.

[CM001, CM004, CM006, CM012]

2.2 Market Sizing Lenses: TAM, SAM, and the Custom Inference Opportunity

Evaluating the market opportunity for specialized artificial intelligence inference requires examining multiple sizing lenses rather than relying upon a singular top-down forecast. Industry research consensus values the broader artificial intelligence inference infrastructure market at approximately 106.2 billion dollars in 2025, projecting expansion to 255.0 billion dollars by 2030 at a compound annual growth rate of 19.2 percent. This expansion is propelled by an industry-wide transition wherein sixty to seventy percent of all artificial intelligence compute cycles are expected to migrate to real-time inference by 2030. However, this headline total addressable market aggregates commoditized GPU hardware, hyperscaler virtual instances, and specialized serving software. Within this broader universe, the serviceable addressable market centers on dedicated model execution and custom model runtimes. Across scaled enterprise platforms, custom and post-trained models represent ninety-five percent of processed token volume, demonstrating that standard off-the-shelf weights represent a transitional development phase. Baseten operates directly within this high-velocity layer, scaling its global footprint across eighty-seven to ninety clusters in eighteen cloud providers while processing over one billion inference requests daily and scaling its revenue run rate from six hundred million dollars toward a one-billion-dollar trajectory.[CM002, CM003, CM005, CM006, CM008]

AI Inference Market Sizing Projections and Addressable Opportunity Lenses
Sizing Lens / PublisherYearGeographyValue (USD)Growth / CAGRMethodology / BasisConfidenceLimitation / Caveat
Total AI Inference Infrastructure (Analyst Market Consensus)2025Global$106.2B19.2% CAGR (to 2030)Top-down analyst market sizing of hardware accelerators, cloud instances, and inference platform softwareMediumIncludes raw GPU infrastructure and hyperscaler commodity compute alongside specialized inference runtimes
Projected AI Inference Infrastructure TAM2030Global$255.0B19.2% CAGRExtrapolation based on 60%–70% of total enterprise AI workloads shifting from model training to production inferenceMediumForecast subject to macroeconomic compute capex pacing and semiconductor supply chain constraints
Custom & Post-Trained Model Inference Spend (SAM)2026Global30%–50% of app-layer spendRapid expansionEnterprise app-layer model expenditure redirected from closed frontier APIs toward proprietary customized weightsMediumBased on company executive disclosures and venture partner surveys rather than standardized financial reporting
Baseten Annualized Revenue Run-Rate (Captured SOM)2026Global$600M–$1.0B20x–30x YoYAnnualized revenue run-rate disclosed following Series E ($600M in March 2026) and Series F ($1B trajectory in May 2026)MediumPrivate company disclosures are un-audited; exact ARR and gross margins remain undisclosed

Sizing lenses combine published analyst market data (106.2B in 2025 to 255.0B in 2030) with company run-rate disclosures; private company financial metrics are unaudited.

[CM002, CM003, CM004, CM006, CM007, CM008]
FM001: AI Inference Market Sizing and Addressable Opportunity Layers

Hierarchical sizing lenses from broader AI compute spend down to Baseten's serviceable and captured specialized inference market.

Layer widths indicate hierarchy, not quantitative proportions.

Market projection figures from industry analyst estimates (106.2B in 2025 to 255.0B in 2030 at 19.2% CAGR); Baseten run-rate ranges from $600M (March 2026) to $1B trajectory (May 2026).

[CM002, CM003, CM005, CM006, CM014]

2.3 Buyer Segmentation, Budget Ownership, and Enterprise Adoption Triggers

Enterprise procurement and architectural adoption of dedicated inference infrastructure follow distinct technical and economic maturity curves. Target buyers predominantly encompass Heads of Machine Learning, Vice Presidents of Engineering, and Chief Technology Officers across two primary segments: high-growth artificial intelligence native software startups and transforming mid-market to Fortune 500 enterprises. Initial exploration typically begins on hosted model APIs or generic hyperscaler clouds during early prototyping; however, once an application achieves validated user signal and scaling traffic, infrastructure costs and latency overhead surge. Migrating to specialized inference runtimes delivers reported cost reductions of forty to sixty-five percent compared to incumbent setups, triggering commercial transitions. Mission-critical application providers—such as Cursor in automated software development, Abridge in clinical documentation, and Notion in collaborative knowledge work—require four-nines availability, sub-two-hundred-millisecond response latencies, and zero-downtime rolling model updates. In regulated verticals including healthcare and financial services, budget authorization is closely tied to rigorous security guarantees, mandating SOC-2 Type II certification, HIPAA compliance, single-tenant isolation, and region-restricted data residency.[CM007, CM009, CM010, CM011, CM012]

Enterprise AI Inference Buyer Personas and Adoption Map
SegmentTarget BuyerEnd UserPayer / Budget OwnerCore WorkflowAdoption Trigger
AI-Native Application StartupsVP Engineering, Head of AIFull-Stack AI Engineers, ML DevelopersEngineering / Product Cloud Infrastructure BudgetReal-time model inference for code editors, ambient scribes, document creators, and conversational agentsExorbitant closed-source API bills, latency spikes during traffic bursts, or need for custom fine-tuned models
Enterprise Production ML TeamsChief Technology Officer, Head of ML PlatformMachine Learning Engineers, Data ScientistsEnterprise Central IT & Cloud Infrastructure BudgetDeploying internal classification, proprietary domain LLMs, and multi-modal models into line-of-business softwareModel prototype escaping sandbox to production, requiring Kubernetes abstraction and zero-downtime rolling deploys
Regulated Industry Enterprises (Healthcare, Finance)Chief Information Security Officer, VP InfrastructureClinical Informaticists, Quantitative DevelopersSecurity, Compliance & Core Infrastructure ProcurementProcessing sensitive patient records, financial documents, and confidential corporate communicationsSOC-2 Type II and HIPAA compliance mandates requiring single-tenant isolation or self-hosted VPC deployments
Model Builders & AI Research LabsHead of Research, Chief ScientistResearch Scientists, Post-Training EngineersR&D Compute & Model Development BudgetContinual post-training with reinforcement learning, evaluation feedback loops, and multi-cloud model distributionNeed for tightly coupled fine-tuning to inference pipelines without rebuilding complex GPU orchestration

Buyer segmentation synthesizes customer case studies across production workloads (Cursor, Notion, Abridge) and Baseten enterprise architecture specifications.

[CM009, CM010, CM011, CM012]

2.4 Growth Tailwinds, Hardware Bottlenecks, and Sizing Diligence Gaps

The long-term trajectory of the inference infrastructure market is reinforced by powerful demand tailwinds, counterbalanced by acute hardware and contracting constraints. As operational inference costs decline through runtime software optimization, the market exhibits Jevons Paradox: developers deploy increasingly sophisticated multi-step agentic workflows, consume longer token sequences per interaction, and embed intelligence continuously across previously manual enterprise processes. Nonetheless, physical compute availability poses a formidable gating factor. Cloud provider cluster utilization remains uncomfortably high in the mid-nineties range, and access to premier accelerator hardware requires three-to-five-year procurement contracts with twenty to thirty percent upfront cash pre-payments. These working capital dynamics disadvantage sub-scale operators while rewarding platforms capable of aggregating compute across multiple cloud providers. From an investment diligence perspective, significant disclosure limitations persist: public third-party market data frequently conflates raw GPU hardware resale with proprietary software orchestration revenue. Furthermore, customer contract duration, net revenue retention cohorts, and gross churn figures remain private, preventing audited verification of reported four-hundred-percent expansion rates and cloud-switching durability.[CM013, CM014, CM015, CM016]

2.5 Exhibits

Chapter 03

03Competitors

3.1 Competitive Landscape and Provider Taxonomy

The artificial intelligence inference infrastructure market encompasses distinct categories of providers competing to serve production machine learning workloads. The first tier consists of dedicated inference clouds such as Together AI, Fireworks AI, and Baseten, which focus on running open-source and fine-tuned models with low latency and high hardware utilization. The second tier includes developer-centric serverless platforms like Modal and Replicate, which optimize developer ergonomics and flexible Python execution. The third tier comprises raw GPU infrastructure providers like CoreWeave and Lambda, which supply lower-level compute capacity. Finally, the major hyperscalers—Amazon Web Services, Microsoft Azure, and Google Cloud—operate managed platforms including AWS SageMaker, Bedrock, and Vertex AI. While venture tracker data notes over 500 active entities in machine learning software and application development, enterprise production serving has concentrated around platforms capable of guaranteeing uptime, security, and low-latency throughput for mission-critical applications.[CP002, CP006, CP007, CP015]

Competitor profile table
CompetitorCategoryScale / FundingTarget SegmentCore DifferentiationKnown Limitation
Together AISpecialized Inference Cloud$1B ARR est. / $7.5B valuation talksEnterprises & AI LabsFull lifecycle training, fine-tuning, and open-model servingIntense price competition on commodity token endpoints
Fireworks AIInference Engine Provider$800M ARR est. / $4B valuationLatency-sensitive AI developersOptimized low-latency serving and custom model compilationNarrower enterprise hybrid VPC footprint than Baseten
ModalServerless Developer Cloud$110M funding raisedAI engineers & Python teamsServerless Python container execution and rapid iterationLess focused on dedicated enterprise compliance and multi-cloud
ReplicateAPI Model HostingVC-backed privateDevelopers & prototyping teamsSimple API-first open-source model directory and hostingHigher per-unit costs at sustained large-scale enterprise volumes
Hyperscalers (AWS / Azure / GCP)Cloud Infrastructure GiantsTrillion-dollar balance sheetsBroad enterprise IT organizationsGlobal datacenter reach, existing commit contracts, silicon ownershipVendor lock-in, slower cold starts, and complex manual orchestration

Data synthesized from company profiles, Tracxn venture benchmarking, and reported funding rounds as of 2025-2026.

[CP003, CP004, CP005, CP006, CP007]

3.2 Architectural Differentiation and Platform Capabilities

Baseten differentiates from developer-first tools and generalist cloud platforms through an enterprise-grade inference stack built around its open-source Truss packaging framework, proprietary engine optimizations, and multi-cloud orchestration. While developer-oriented tools such as Modal emphasize Python function decorators and rapid prototyping, Baseten targets mission-critical enterprise workloads with dedicated cluster deployments, single-tenant isolation, and role-based access control. Its multi-cloud capacity management architecture spans 87 clusters across 18 cloud environments, enabling automated cross-cloud autoscaling and failover that protects customers against regional compute shortages. Furthermore, Baseten expanded upstream into post-training and reinforcement learning workflows via its acquisition of Parsed, allowing enterprise clients to continuously optimize proprietary models alongside production inference. This architectural posture contrasts with raw GPU hosting providers by managing the entire model serving lifecycle from packaging to observability.[CP001, CP005, CP009, CP012, CP013, CP014]

Feature / capability matrix
Buying CriteriaBasetenTogether AIFireworks AIModalHyperscalers
Cross-Cloud Autoscaling (18+ clouds)Native (Multi-Cloud Capacity Manager)LimitedLimitedSingle-cloud focusSingle-ecosystem lock-in
Sub-Second Cold Starts & Engine OptimizationHigh (Proprietary Engine Builder & vLLM/TRT)HighVery HighHigh (Container caching)Moderate to Slow
Enterprise Hybrid & Self-Hosted VPCNative (Managed VPC & Cloud failover)AvailableLimitedLimitedNative within own cloud
Post-Training & Reinforcement LearningIntegrated (Parsed acquisition & Loops SDK)Native training platformInference-centricCustom script executionFull platform services (SageMaker/Vertex)

Feature matrix compiled from vendor documentation, technical benchmarks, and public platform disclosures; unsupported enterprise capabilities marked as unknown.

[CP001, CP009, CP012, CP013]
FP001: Competitive positioning map

Comparison of AI inference providers across enterprise multi-cloud orchestration and developer serving specialization.

ItemX (4.5–8.5)Y (5.5–9)Context
1. Baseten 8.5 9
2. Together AI 8 7.5
3. Fireworks AI 7.5 6.5
4. Modal 6.5 7
5. Replicate 6 5.5
6. Hyperscalers (AWS / GCP / Azure) 4.5 8.5

Scores are ordinal ratings (0-10 scale) based on multi-cloud resilience, enterprise compliance, and inference performance benchmarks.

[CP003, CP004, CP005, CP014, CP015]

3.3 Pricing Structures and Hyperscaler Cost Disparities

Pricing in the inference market bifurcates between raw infrastructure reservation and fully managed execution layers. Major hyperscalers rent baseline GPU hardware at aggressive entry rates, with Amazon Web Services offering H100 instances at approximately $3.93 per hour, compared to Baseten list pricing near $6.50 per hour for managed serving infrastructure. However, Baseten argues that its specialized model runtimes, operator fusion, and auto-scaling cold starts deliver up to 30% to 40% cost savings compared to self-managed cloud setups by driving superior hardware utilization. Dedicated inference peers like Together AI and Fireworks AI compete intensely on per-million-token pricing for popular open-source models like Llama and DeepSeek, frequently triggering pricing wars. Baseten primary revenue model relies on usage-based consumption and dedicated compute hours, leaving gross margins fundamentally dependent on the spread between customer pricing and underlying GPU procurement costs.[CP003, CP004, CP008, CP010, CP011]

Pricing / packaging comparison
PlatformPricing / Billing ModelStarting Hardware RateEnterprise PackagingKey Tradeoff
BasetenUsage-based compute & token APIs~$6.50/hr H100 managed rateSingle-tenant clusters, custom SLAs, SOC2/HIPAAHigher list hourly compute cost offset by utilization
Together AIPer-token API & dedicated GPU hoursCompetitive per-token pricingEnterprise volume commitments & custom clustersAggressive price competition on standardized open models
Fireworks AIToken-based pricing & dedicated capacityUltra-low per-token ratesEnterprise SLAs and custom model tuningOptimized for speed rather than multi-cloud arbitrage
AWS SageMaker / BedrockReserved instance & on-demand hourly~$3.93/hr H100 raw computeEDP enterprise discount programs & unified cloud billInfrastructure complexity and hyperscaler lock-in

Pricing figures reflect public list rates and analyst estimates; custom enterprise volume agreements and negotiated committed-use discounts are excluded.

[CP008, CP010, CP011]

3.4 Switching Costs, Multi-Homing, and Platform Friction

Switching friction in production AI inference varies sharply by operational layer. At the API integration boundary, OpenAI-compatible schemas and standardized REST endpoints make migrating basic prompt completion workloads relatively straightforward. However, deep integration into Baseten specialized ecosystem introduces meaningful enterprise switching costs. Enterprise customers that adopt Truss for containerization, integrate Baseten custom observability and tracing pipelines, or establish hybrid self-hosted deployments inside their own virtual private clouds incur significant engineering inertia. Customer references including Cursor, Notion, and Abridge demonstrate production stickiness where latency tuning and high-availability guarantees discourage multi-homing across unproven providers. Nonetheless, because enterprise clients maintain their own weights and data pipelines, switching barriers remain lower than traditional core database or ERP software migrations.[CP001, CP002, CP012, CP014]

3.5 Moat Durability and Hyperscaler Substitution Risks

Baseten long-term moat durability faces serious strategic headwinds from incumbent cloud providers and specialized peers. The most critical threat stems from hyperscaler bundling: AWS, Microsoft Azure, and Google Cloud possess massive enterprise distribution channels and existing committed spend agreements, enabling them to cross-subsidize inference services. Furthermore, pure-play rivals like Together AI, backed by significant capital and reporting $1B in annualized revenue run-rates, possess substantial resources to compete on model distribution and research partnerships. In addition, Baseten business model requires purchasing or leasing compute from third-party GPU vendors, exposing operating margins to hardware supply constraints and price volatility. To maintain its valuation premium, Baseten must consistently outperform commodity cloud serving on latency, developer efficiency, and cross-cloud reliability while expanding its enterprise footprint.[CP003, CP004, CP008, CP010, CP011]

3.6 Exhibits

Chapter 04

04Financials

4.1 Revenue Model, Pricing Mechanisms, and Top-Line Scale

Baseten operates a pure-play consumption- and capacity-driven monetization model designed for enterprise machine learning infrastructure. The platform charges for usage primarily through direct API consumption or billed compute time across dedicated GPU capacity, contrasting with legacy per-seat software-as-a-service paradigms (CI001, CI002). Customer demand accelerated dramatically between late 2025 and early 2026: annualized revenue reportedly surged from roughly $200 million in December 2025 to $600 million by March 2026, representing an approximate 1,900% year-over-year expansion rate (CI003, CI004). This commercial velocity reflects broader enterprise workload migration from experimental model training to continuous production inference, with the platform processing over one billion inference requests daily across 87 clusters and 18 cloud environments (CI003, CI005). Commercial accounts span high-volume AI-native innovators including Cursor, Notion, Abridge, and OpenEvidence, alongside more than one hundred enterprise deployments (CI003, CI006, CI007). In addition to usage-based hosted model endpoints, Baseten monetizes training and fine-tuning workloads via dedicated multi-node jobs, applying a credit mechanism where twenty percent of training spend offsets production inference costs to incentivize multi-product lifecycle retention (CI005, CI008).[CI001, CI002, CI003, CI004, CI005, CI006, CI007, CI008]

Revenue streams and monetization breakdown
Revenue StreamMonetization MechanismBilling UnitCurrent Status / ScaleRevenue QualityPrimary Diligence Ask
Dedicated Model InferenceReserved or dynamically autoscaled GPU compute clustersInstance hours / minutes across GPU hardware tiersCore enterprise revenue driver; 1B+ daily calls across 87 clustersHigh volume; variable usage exposure without long-term commitmentsExamine committed versus on-demand contract mix and minimum spend thresholds
Serverless Model APIsPre-optimized endpoints for curated open-source LLMsToken volume / request throughput (per 1k tokens)Active on-ramp for developers and mid-market application buildersModerate; vulnerable to spot per-token price competitionAudit per-token gross margins net of underlying GPU allocation costs
Baseten Training & LoopsMulti-node fine-tuning, RL, and continual model learningTraining job compute hours (with 20% inference credit offset)Expanded capability following Parsed acquisition in Dec 2025Strategic expansion; serves as customer retention lock-in mechanismVerify utilization of training credits and conversion rate into inference workloads
Enterprise Support & FDEsEmbedded Forward Deployed Engineers and custom kernel tuningAnnual contractual support tiers / professional service retainersBundled with mission-critical enterprise production tiersHigh retention value; professional services margin characteristicsReview gross margin contribution of professional services versus infrastructure

Categorizes Baseten's core commercial revenue streams based on official product architecture, reported usage structures, and verified commercial packaging.

[CI001, CI002, CI003, CI005, CI008]
Pricing structures and contractual terms
Offering / TierList Pricing ModelRealized Rate DynamicsDiscounting / ConcessionsUnderwriting Assessment
Baseten Managed H100 GPUHourly instance consumption (~$6.50 / hour list rate)Realized rate varies with multi-cloud placement and reserved tierVolume-based enterprise discount tiers negotiated with salesCarries ~65% premium over raw unmanaged hyperscaler compute ($3.93/hr)
Enterprise Dedicated ClusterCustom annual or multi-year committed contract valueBlended hourly rate tied to minimum committed capacitySubstantial discounts for upfront annual commitmentsPrimary vehicle for achieving predictable annual recurring revenue
Self-Hosted / VPC DeploymentSoftware license plus control-plane management feeCustomer bears direct hardware costs; Baseten captures software marginCustom negotiated enterprise licensing agreementsHigh gross margin profile (pure software), but smaller contract pool
Model API Serverless EndpointsPay-as-you-go per million tokens or per call consumptionDirectly tracks token volume without upfront commitmentIntroductory developer credits; standard list tierHigh churn risk; lower switching friction compared to dedicated VPC

Compiles verified list pricing indicators, compute rate differentials, and contract governance terms across managed cloud and enterprise customer channels.

[CI001, CI002, CI005, CI007]

4.2 Cost Structure, Gross Margin Dynamics, and Unit Economics

The core determinant of Baseten's financial viability is its ability to extract durable software gross margins while arbitrating physical and virtual GPU compute. Delivering high-performance model serving requires substantial compute pass-through costs paid to underlying hardware hosts and neoclouds across its multi-cloud footprint (CI005, CI009). Baseten commands a premium over raw compute—pricing dedicated managed H100 instances at approximately $6.50 per hour compared to hyperscaler raw compute benchmarks of roughly $3.93 per hour—justified by out-of-the-box kernel optimizations, cold-start reduction, and multi-cloud resilience (CI001, CI005). Company case studies indicate that optimized deployments deliver up to 30% to 40% cost savings relative to unmanaged in-house clusters or closed-source commercial APIs (CI003, CI005). However, because Baseten does not publicly disclose audited gross margin percentages, hosting cost of goods sold (COGS), or net revenue retention (NRR), analysts cannot independently verify whether current scale yields classic infrastructure software gross margins (65%–75%) or compressed neocloud resale margins (35%–50%) (CI010, CI011). Furthermore, customer concentration among breakout startups creates potential margin vulnerability if anchor clients develop internal infrastructure operations once monthly inference expenditure exceeds roughly $200,000 per workload (CI006, CI012).[CI001, CI003, CI005, CI006, CI009, CI010, CI011, CI012]

Unit economics and diligence metrics register
Financial MetricReported ValueEstimation / ConfidenceAnalytical SignificanceDiligence Requirement
Annualized Revenue (ARR Run-Rate)~$600M (March 2026)Third-party reported (Medium confidence)Reflects 1,900% YoY top-line expansion from $200M in Dec 2025Obtain audited income statements to isolate GAAP revenue from annualized run-rates
Blended Gross MarginUndisclosed private metricKey test of whether Baseten is a high-margin software platform or low-margin resellerRequest GAAP gross margin breakdown separating hardware COGS from software revenues
Net Revenue Retention (NRR)Undisclosed private metricMeasures expansion within anchor enterprise cohorts (Cursor, Notion, Abridge)Audit historical cohort retention schedules across 2024–2026 customer vintages
Monthly Net Cash BurnUndisclosed private metricDetermines operating burn trajectory against $1.5B Series F capital reservesInspect trailing 12-month cash flow statements and forward hiring plan cash burn
Infrastructure Gross Margin Premium~30% to 40% TCO savingsThird-party and customer benchmarkedEconomic rationale preventing enterprise accounts from building custom ML-opsReview customer ROI models validating realized GPU utilization efficiency
Total Capital Raised$2.08B+ across 8 roundsVerified across corporate filings and financial pressIndicates exceptional access to growth capital and strategic investor backingReview cap table, liquidation preferences, and dual-tranche Series F structure

Tabulates known public financial traction markers alongside critical undisclosed private underwriting metrics; all null fields indicate private data gaps requiring formal diligence access.

[CI003, CI004, CI005, CI010, CI011, CI013, CI014]
FI001: Inference Platform Economic Value Flow

Operational and financial flow showing customer query generation converting through multi-cloud compute optimization into platform revenue and gross margin.

Node / ConnectionNode / fromToContext
Node 1 Production AI Workload [workload-demand]1B+ Daily Calls Requests from enterprise customers including Cursor, Notion, and Abridge
Node 2 Baseten Inference Stack [orchestration-layer]Multi-Cloud Scheduler Global scheduling across 87 clusters and 18 cloud providers
Node 3 Runtime Efficiency Tuning [kernel-optimization]30-40% Cost Savings TensorRT-LLM compilation and custom engine optimization
Node 4 Gross Platform Billing [gross-billing]$600M Run-Rate Usage-based instance hours and token consumption
Node 5 Compute Pass-Through COGS [hardware-cogs]Variable GPU Costs Hardware procurement across neoclouds and cloud providers
Node 6 Net Software Margin [net-gross-margin]Undisclosed Margin Residual platform software profit retained by Baseten

Flow diagram illustrates the commercial transformation of inference query volume into reported run-rate revenue and compute cost components; exact margin percentages represent private data gaps.

[CI001, CI003, CI005, CI006, CI010, CI011]

4.3 Capital Adequacy, Cash Runway, and Diligence Verdict

Baseten has executed an aggressive financing strategy to support its capital-intensive infrastructure buildout, raising more than $2 billion in aggregate equity capital through mid-2026 (CI003, CI004, CI013). Following a $300 million Series E round in January 2026 anchored by IVP, CapitalG, and Nvidia at a $5 billion valuation, Baseten closed a $1.5 billion Series F round in June 2026 at an enterprise valuation of up to $13 billion (CI003, CI004, CI014). This massive cash infusion provides deep capital adequacy to finance hardware lease commitments, global compute reservations, and planned workforce tripling across engineering and go-to-market teams (CI003, CI005). Nevertheless, the rapid cadence of four mega-rounds within eighteen months underscores substantial forward capital intensity and operational burn necessary to sustain rapid top-line growth (CI003, CI009). From an investment diligence perspective, underwriting Baseten requires verifying whether high headline ARR reflects sticky recurring commitments or volatile, short-cycle compute consumption subject to sudden churn or price commoditization (CI010, CI011, CI015).[CI003, CI004, CI005, CI009, CI010, CI011, CI013, CI014, CI015]

4.4 Exhibits

Chapter 05

05Product & Technology

5.1 Operating Model and Multi-Cloud Infrastructure Architecture

Baseten operates as a mission-critical AI inference infrastructure platform designed to deploy, scale, and serve large language models and compound AI systems in production. Rather than acting as a simple GPU reseller or a purely proprietary model provider, the company provides systems software that unifies heterogeneous compute resources into a reliable, enterprise-grade serving layer. As of mid-2026, Baseten operates across 87 globally distributed clusters spanning 18 distinct cloud providers, handling over one billion production inference calls each day. This multi-cloud architectural topology enables Baseten to route customer workloads dynamically based on GPU availability, geographic latency requirements, and cost efficiency, shielding customers from regional capacity shortages and individual provider outages. The platform's foundational architecture bridges low-level hardware characteristics with high-level orchestration, adapting standard Kubernetes primitives to handle the unique scheduling, memory, and networking demands of modern GPU computing.[CE001, CE009]

Technology / operating architecture table
Architecture LayerPrimary Technology ComponentOperational RoleKey DependencyIdentified Technical Risk
Model PackagingTruss (Python packaging library)Defines dependencies, weights loading, and inference prediction logicPython runtime and Docker containerizationAbstraction friction and lock-in requiring refactoring if migrating
Runtime EnginevLLM, SGLang, and TensorRT-LLMExecutes continuous batching, tensor parallelism, and kernel optimizationNVIDIA CUDA ecosystem and open-source engine stabilityUpstream breaking changes across rapidly evolving inference engines
Compute OrchestrationGPU-adapted Kubernetes clustersManages scheduling, live reloads, and multi-node model executionCloud provider GPU node availability and provisioning APIsCold-start delays when pulling large model weights during scale-out
Global InfrastructureMulti-cloud network (87 clusters, 18 clouds)Routes traffic, optimizes latency, and executes cross-cloud failover18 disparate cloud provider SLAs and interconnectsNetwork egress cost volatility and heterogeneous provider reliability

Architecture components compiled from technical blogs, Baseten infrastructure engineering presentations, and multi-cloud operational disclosures.

[CE001, CE002, CE003, CE009]
FE001: Product architecture map

Baseten's end-to-end inference technology stack spanning packaging, execution runtimes, orchestration, and multi-cloud physical hardware.

Developer Experience & Packaging Layer
Developer CLI, Truss packaging framework, model weight versioning, and live-reload testing environments.
Modules
  • Truss Python SDK
  • Config YAML Specification
  • Live Reload Dev Environment
  • Git-based Model Deployments
Inference Engine & Optimization Layer
High-throughput execution runtimes performing continuous batching, operator fusion, and kernel optimization.
Modules
  • vLLM Engine
  • SGLang Runtime
  • NVIDIA TensorRT-LLM
  • Quantization & Model Compilers
Orchestration & Autoscaling Layer
Intelligent autoscaling engine and customized Kubernetes controllers for GPU cluster workload scheduling.
Modules
  • Cold-Start Mitigator
  • Zero-to-Infinity Autoscaler
  • Kubernetes GPU Scheduler
  • Single-Tenant VPC Controller
Enterprise Security & Governance Layer
Access controls, audit logging, zero-data-retention enforcement, and compliance policy wrappers.
Modules
  • RBAC & SSO Integration
  • Zero Data Storage Gateway
  • HIPAA/SOC 2 Controls
  • Distributed Tracing & Metrics
Multi-Cloud Networking & Failover Layer
Global traffic routing, cross-cloud health checking, and automatic VPC-to-cloud failover mechanisms.
Modules
  • Global Ingress Router
  • Cross-Cloud Failover Agent
  • Multi-Region Traffic Balancer
  • Egress Cost Optimizer
Physical Compute & Hardware Infrastructure
Heterogeneous GPU fleet distributed across 87 clusters and 18 commercial cloud and specialized GPU providers.
Modules
  • NVIDIA H100/A100 Clusters
  • Specialized GPU Cloud Nodes
  • Hyperscaler Partner VPCs
  • Bare-Metal Accelerator Pods

Layer taxonomy synthesized from Baseten infrastructure engineering documentation, executive interviews, and technical teardowns.

[CE001, CE002, CE003, CE006, CE009, CE014]

5.2 Product Portfolio, Deployment Modalities, and Framework Abstractions

The core entry point for engineering teams building on Baseten is Truss, an open-source model packaging framework created and maintained by the company. Truss provides an opinionated Python abstraction centered on load and predict methods, accompanied by a declarative configuration file specifying hardware requirements, system packages, and Python dependencies. Around this packaging foundation, Baseten offers three primary commercial deployment options: fully managed Baseten Cloud, single-tenant dedicated clusters, and self-hosted VPC deployments running directly inside customer cloud infrastructure. The self-hosted model allows security-conscious organizations to keep proprietary model weights and sensitive inference data strictly within their own security boundaries while maintaining an automated failover capability to Baseten Cloud. Through its managed model garden, Baseten also provides turnkey access to leading open-source models, enabling developers to run pre-optimized implementations of frontier open-weight architectures alongside custom fine-tuned checkpoints.[CE002, CE005, CE011]

Product module / asset matrix
Module / SKUTarget UserMaturity / StatusDifferentiation MechanismDiligence Gap
Truss FrameworkML engineers & Python developersProduction / Open SourceOpinionated Python class packaging (load/predict) with container abstractionSwitching costs when migrating to raw vLLM/SGLang configurations
Baseten CloudGrowth startups & AI product teamsProduction / Multi-TenantMulti-cloud routing across 18 providers with automated autoscalingMargin compression from underlying cloud GPU markup
Enterprise Self-HostedRegulated enterprises (Healthcare, FinTech)Production / Single-Tenant VPCIn-VPC data isolation with automated failover to Baseten CloudHigh support intensity and manual forward-deployed engineering requirements
Model Garden / CatalogApplication developersProduction / Managed APIsPre-optimized open-source model runtimes (DeepSeek, Llama family)Commoditization pressure from native model provider APIs

Product lines and maturity statuses reflect Baseten official documentation and independent architectural reviews. Diligence gaps represent technical lock-in and margin vulnerabilities.

[CE002, CE005, CE011]

5.3 Developer Workflow, Runtime Optimization, and Forward-Deployed Engineering

Baseten's serving pipeline is engineered to eliminate the operational complexity of deploying custom machine learning models at scale. Once an engineer packages an artifact using Truss, Baseten automatically builds container images, provisions appropriate GPU hardware, and establishes autoscaling endpoints that can scale up dynamically or down to zero when idle. To achieve competitive latency and throughput, Baseten integrates leading open-source inference engines, including vLLM, SGLang, and NVIDIA TensorRT-LLM, fine-tuning continuous batching, memory allocation, and kernel execution for specific model architectures. Beyond purely software-based automation, Baseten differentiates its go-to-market and operational delivery through forward deployed engineering teams that report directly to engineering leadership. These engineers embed directly with major production customers—including category leaders such as Cursor, Notion, Abridge, and OpenEvidence—to co-engineer custom serving optimizations, diagnose tail latency bottlenecks, and directly inform internal product roadmap priorities.[CE003, CE004, CE010, CE012]

Workflow / use-case table
User JobCurrent Baseline WorkflowBaseten SolutionMeasurable BenefitTechnical Limitation
Deploying custom fine-tuned LLMManual Dockerization, CUDA configuration, and Kubernetes YAML authoringTruss packaging with automated container build and GPU schedulingReduces deployment cycle from days to minutesTies deployment definition to Baseten-specific runtime class conventions
Handling bursty traffic spikesOver-provisioning dedicated GPU clusters at continuous full costZero-to-infinity autoscaling across distributed GPU clustersEliminates idle GPU billing during traffic lullsCold-start latency penalties of 30-90 seconds on container scale-up
Serving latency-sensitive inferenceStandard unoptimized HuggingFace model pipelinesOptimized runtimes integrating vLLM, SGLang, and TensorRT-LLMAchieves higher token throughput and lower time-to-first-tokenLacks published independent head-to-head performance benchmarks
Operating in regulated sectorsComplex VPC networking, custom audit logs, and self-managed BAA/DPAOut-of-the-box SOC 2 Type II, HIPAA, and GDPR compliance controlsImmediate compliance clearance for enterprise procurementSingle-tenant clusters require high commitment and management overhead

Workflow comparisons are derived from customer technical case studies, Baseten enterprise whitepapers, and competitor benchmarking reports.

[CE002, CE003, CE006, CE008, CE010]

5.4 Enterprise Governance, Data Isolation, and Commercial Tradeoffs

To satisfy rigorous procurement requirements across healthcare, legal, and financial services, Baseten embeds comprehensive security and compliance capabilities into its platform architecture. The service is SOC 2 Type II certified, HIPAA compliant, and GDPR compliant by default across all hosting tiers. Critically for enterprise trust, Baseten enforces a strict zero-data-retention policy, guaranteeing that customer inference inputs and outputs are never permanently stored, logged, or utilized for model training. Administrative governance is delivered through role-based access control, single sign-on, team-level workspace partitioning, and audit-ready observability tools encompassing distributed tracing and custom metrics. Alongside these enterprise strengths, independent evaluations highlight several operational and financial tradeoffs. Baseten's replica-hour pricing model requires customers to pay continuously for standing GPU instances regardless of request volume, resulting in substantial cost floors for high-availability multi-replica deployments. Furthermore, serverless cold starts of 30 to 90 seconds for large models force latency-critical applications to maintain expensive warm standby instances.[CE006, CE007, CE008, CE013, CE014]

5.5 Exhibits

Chapter 06

06Customers

6.1 Customer Base Segmentation & Target Buyers

Baseten's commercial adoption spans four primary customer cohorts across the artificial intelligence ecosystem: high-velocity AI-native startups, regulated enterprise organizations, digital-native media platforms, and frontier model labs. The fastest-growing cohort consists of AI-native software applications such as Cursor, Lovable, and Clay, where low-latency inference is embedded directly into core product interaction loops and engineering teams demand continuous deployment agility. In regulated industries such as healthcare, providers including Abridge and OpenEvidence deploy on Baseten to leverage single-tenant clusters, dedicated VPC connectivity, and comprehensive SOC-2 Type II and HIPAA compliance guarantees. Digital-native platforms like Patreon and Superhuman rely on Baseten to replace costly proprietary APIs or unoptimized in-house GPU fleets with standardized open-source serving architectures. More recently, Baseten expanded upstream with Baseten for Model Labs, onboarding closed-weight AI developers including Poolside and WRITER to distribute and monetize models through its Frontier Gateway API.[CU001, CU002, CU009, CU013]

Customer segmentation table
Customer SegmentBuyer / User / PayerPrimary Use CaseObserved Scale & AdoptionRevenue / Strategic ValueDiligence Gap
AI-Native Startups (e.g. Cursor, Lovable, Clay)Founders, ML Engineers, Head of ProductReal-time code generation, data enrichment, low-latency agent inferenceMillions of daily requests, multi-model production routingCore driver of 2025–2026 hypergrowth; high expansion velocityIndividual account gross margins and workload durability undisclosed
Regulated Enterprise / Healthcare (e.g. Abridge, OpenEvidence)CTO, VP Engineering, Chief Medical Information OfficerClinical documentation transcription and real-time medical query processingProduction deployments on single-tenant clusters with HIPAA complianceHigh annual contract value, sticky compliance moats, low churn riskExact customer contract duration and SLA penalty exposure unverified
Digital Native Media & Productivity (e.g. Patreon, Superhuman, Descript)VP Engineering, Platform Infrastructure LeadsAudio transcription pipelines (Whisper), semantic search embeddingsSub-200ms latency, 440 hours engineer savings, 70% GPU cost reductionDemonstrates tangible ROI on GPU efficiency; high referenceabilityExpansion ceiling within non-generative core product lines
Frontier Model Labs (e.g. Poolside, WRITER)Head of Infrastructure, Lab Commercialization LeadsClosed-weight model monetization via Frontier Gateway and Model LibraryEarly-access partnership stage across 4 announced lab partnersStrategic hedge enabling upstream capture of proprietary model distributionRevenue concentration and viability tied to commercial success of individual labs

Customer segmentation based on verified production deployments, company announcements, and case study disclosures as of 2026.

[CU001, CU002, CU003, CU004, CU009]

6.2 Adoption Trajectory & Operational Scale

Baseten experienced explosive operational and financial expansion between late 2025 and mid-2026, tracking the industry-wide transition of enterprise compute budgets from offline model training toward recurring production inference. By March 2026, the company's annualized revenue run-rate reached approximately $600 million, roughly tripling from $200 million in December 2025 and representing approximately 1,900% year-over-year revenue growth. This top-line momentum is backed by substantial underlying infrastructure utilization, with the platform serving more than one billion inference requests per day across 87 clusters spanning more than 18 cloud provider environments. Commercial traction has broadened from tens of thousands of individual open-source developers using the Truss packaging library to more than 100 large enterprise accounts running mission-critical workloads. Early investor disclosures from 2025 indicated near-zero customer churn, reflecting the deep technical stickiness created once an application's production routing, autoscaling, and observability become integrated into Baseten's multi-cloud serving plane.[CU005, CU006, CU010, CU012]

Customer growth / adoption trajectory table
MetricReported ValueDateSourceConfidenceStrategic ImplicationMissing Denominator
Daily Inference Calls1B+ requests/day2026-06Value Add VC / TechCrunch / MirahezeMediumProves massive operational scale across 87 clusters and 18 cloudsBreakdown by customer tier, model architecture, or free vs paid calls
Annualized Revenue Run-Rate~$600M2026-03Value Add VC / MirahezeMediumCompounded from $200M in Dec 2025 (~3x in one quarter, ~1,900% YoY)Audited GAAP ARR, cash collections, and contractually committed vs metered revenue
Enterprise Customer Count100+ large enterprises2025–2026Miraheze AI Wiki / Company DisclosuresMediumBroadening enterprise footprint beyond early AI-native cohortExact ARR threshold for 'large enterprise' and active account definitions
Customer Churn RateNear-zero reported churn2025-02Miraheze AI Wiki / Series C investor disclosuresMediumIndicates high switching costs once inference is embedded in core productAudited Gross Revenue Retention (GRR) and Net Revenue Retention (NRR) cohorts

Operational and financial trajectory compiled from investor disclosures, media reports, and wiki archives; unverified quantities flagged as diligence gaps.

[CU005, CU006, CU010, CU012]

6.3 Named Customer Deployments & Measurable Outcomes

Publicly documented customer deployments confirm tangible efficiency, cost reduction, and performance gains across diverse production workloads. In creator media processing, creator platform Patreon transitioned its audio transcription workloads to OpenAI's Whisper model deployed via Baseten, reporting 440 saved engineering hours, $600,000 in annual cost savings, and an overall 70% reduction in GPU expenses. In healthcare documentation, clinical AI provider Abridge standardized on Baseten to power its ambient clinical note-taking models in production, with executive leadership emphasizing superior uptime, developer experience, and collaborative engineering support over transactional vendor relationships. In developer productivity software, email platform Superhuman achieved 80% faster embedding inference after migrating to Baseten's specialized infrastructure, enabling real-time semantic message retrieval. Additionally, technical collaboration with NVIDIA demonstrated that optimizing Baseten's open-source Truss framework with TensorRT-LLM and AWS P4d instances powered by A100 GPUs slashed cold-start latency from up to five minutes down to 5–10 seconds while doubling inference throughput for production customer models.[CU001, CU003, CU004, CU007, CU008]

Named customer proof table
CustomerSegmentDeployment / Use CaseProduction vs PilotReported OutcomeEvidence Limitation
PatreonCreator EconomyOpenAI Whisper model deployment for content audio transcriptionProductionSaved 440 engineer hours, $600K in annual costs, and 70% GPU expense reductionHistorical case study vintage (2024); ongoing expansion volume unverified
AbridgeHealthcare AIReal-time clinical documentation and medical note generationProductionBest-in-class inference reliability, lower cost, and strategic partnership supportExact inference volume, SLA terms, and contract value undisclosed
SuperhumanProductivity SoftwareSemantic embedding model serving for high-speed email searchProduction80% faster embedding model inference compared to previous infrastructureNarrow single-model deployment; broader platform adoption unconfirmed
Cursor (Anysphere)Developer ToolsCore coding assistant code completion and model inferenceProductionPowers high-throughput, low-latency interactive developer workflowsExposure to heavy inference volume; customer-specific unit economics unknown
OpenEvidenceMedical InformationInstant clinical query answering and medical evidence deliveryProductionMission-critical low-latency serving for time-sensitive healthcare queriesDeployment architecture details and compliance audit records not public

Production status and outcomes verified through official case studies, press release quotes, and technical community disclosures.

[CU001, CU003, CU004, CU007, CU008]

6.4 Customer Journey, Expansion Loops & Platform Lock-In

Baseten's land-and-expand motion begins at the individual developer surface before expanding into organization-wide infrastructure commitments. Developers typically enter through the open-source Truss packaging library or pre-optimized Model APIs, containerizing models and validating latency benchmarks locally before deploying prototype endpoints on managed Baseten Cloud. As traffic ramps toward production scale, customers transition to Baseten's Multi-Cloud Capacity Management (MCM) layer, which automatically schedules replicas across 18 cloud providers to circumvent single-vendor GPU shortages and maintain sub-200ms latency SLAs. Regulated and enterprise accounts subsequently expand into single-tenant clusters, VPC peering, and hybrid configurations where inference executes inside the customer's private cloud with automated failover. Expansion velocity compounds as internal engineering teams deploy additional model modalities—spanning text, audio transcription, image generation, and semantic embeddings—while leveraging Baseten Training and Baseten Loops for post-training alignment and reinforcement learning workflows.[CU001, CU002, CU007, CU009]

FU001: Customer journey map

Customer progression from open-source model experimentation to multi-cloud enterprise production inference and model lifecycle optimization.

Stages reflect standard commercial progression documented in Baseten's enterprise architecture, developer documentation, and case studies.

[CU001, CU002, CU007, CU009]

6.5 Retention Durability, Churn & Customer Concentration Risks

Despite hypergrowth metrics, Baseten faces structural durability and customer concentration risks inherent to its usage-based business model. Because revenue scales directly with metered GPU hours and inference volume rather than multi-year committed software subscriptions, top-line performance is immediately sensitive to customer traffic volatility, algorithmic optimization gains, or macro spend pullbacks. Customer concentration represents a significant vulnerability, as a handful of high-throughput anchor accounts like Cursor and Abridge likely account for an outsized portion of aggregate daily inference volume; any workload repatriation or architectural shift by a top customer would immediately impact run-rate. Furthermore, major hyperscalers including AWS Bedrock, Google Cloud Vertex AI, and Microsoft Azure increasingly bundle proprietary and open model serving into existing enterprise cloud enterprise agreements, leveraging captive hardware margins and discounted pricing that Baseten must consistently outperform through superior software orchestration and cross-cloud resiliency.[CU010, CU011, CU012, CU014]

6.6 Exhibits

Chapter 07

07Risks

7.1 Risk posture and underwriting frame

Baseten sells infrastructure for mission-critical model workloads, so failure impact is structurally higher than for a non-critical developer tool. The company says named AI applications depend on its production platform, while its documentation describes a broad operating surface spanning model containers, GPU capacity, regions, scaling, and observability. That combination makes reliability, security, and capacity management central underwriting questions rather than peripheral product details. Public mitigations include multi-cloud capacity management, dedicated deployments, regional placement, observability, and self-hosting. However, the retained corpus is dominated by company-issued descriptions and does not independently test uptime, controls, failover, or customer isolation. The heatmap therefore ranks residual diligence exposure, not confirmed incidents or control failures.[CR005, CR006, CR007, CR013, CR015]

Regulatory / legal risk register
Risk / scopePublic statusLikelihoodSeverityClaimed mitigationMitigation maturityResidual exposureDiligence path
Security and healthcare assurance / US regulated workloadsSOC 2 Type II and HIPAA compliance are company-claimed; underlying reports and terms were not in the assigned corpusMediumHighAudit certification, workload isolation, access controls, regional deploymentPartially evidencedMaterial until scope, exceptions, and shared responsibility are reviewedObtain current SOC 2 report, HIPAA control mapping, BAA, penetration-test summary, and remediation log
Privacy and data handling / inference requestsBaseten says it does not store request inputs or outputs and protects code and weights with encryptionMediumHighNo input/output storage, encryption, private networking, single-tenant optionsCompany-describedContract, telemetry, backup, deletion, and subprocessor behavior remain unverifiedReview DPA, retention and deletion schedules, logging defaults, subprocessors, and customer-configurable controls
Residency and cross-border processing / global deploymentsRegional environments, region selection, self-hosting, and customer-VPC deployment are described publiclyLow-mediumHighRegion-restricted placement and self-hosted deploymentProduct-documentedRouting, support access, metadata location, and failover boundaries are not independently verifiedMap data flows by product and region; test routing and failover; obtain subprocessor and support-access locations

Partial public-source register ordered by severity; likelihood and residual exposure are underwriting assessments based on company-described controls and explicit evidence gaps, not findings of a breach, enforcement action, or legal non-compliance.

[CR001, CR002, CR003, CR004, CR015]
FR001: Residual risk heatmap

Ordinal underwriting view of likelihood, impact, and mitigation maturity based on the assigned public evidence; it does not represent measured incident probabilities.

Qualitative categories are analyst judgments, not numerical probabilities; funding raised is not treated as cash available, and absence of an incident record is not treated as proof that no incident occurred.

[CR008, CR010, CR012, CR015]

7.2 Regulatory, privacy, and data-control exposure

Baseten states that it is SOC 2 Type II certified and HIPAA compliant across its hosting options, supports region-restricted deployment, encrypts model weights and source code, and does not store inference request inputs or outputs. Those are relevant mitigations for sensitive workloads, but they are claims about the control environment rather than a substitute for reviewing the current audit report, BAA, DPA, subprocessor list, deletion behavior, and contractual SLA. A secondary analysis also notes that some regulated workloads may still require dedicated or on-premises infrastructure. The appropriate conclusion is therefore not that a compliance defect exists, but that legal and security exposure cannot be fully sized from the assigned public sources. Investment approval should be conditioned on contract-level and auditor-level evidence.[CR001, CR002, CR003, CR004, CR015]

7.3 Operational and dependency risk

The operating model spans multiple clouds, regions, models, GPU types, deployment modes, and inference engines. This breadth can improve resilience and customer choice, but it also raises the number of scheduler, capacity, release, observability, and vendor interfaces that must behave correctly under load. Baseten claims four-nines uptime, cloud-agnostic autoscaling, failover options, and round-the-clock engineering support; none of the assigned independent sources verifies those performance claims. An investor's June statement that new capital would be invested aggressively in capacity, infrastructure, and research reinforces the scale of the execution burden. Key monitors are sustained SLA performance, capacity-related throttling, gross-margin movement, cloud and GPU-vendor concentration, and the share of support obligations requiring bespoke engineering.[CR005, CR006, CR007, CR012, CR014, CR015]

Operational, quality, and security risk register
Failure modeLikelihoodSeverityEvidenceClaimed mitigationMitigation maturityResidual exposure / monitor
Capacity shortfall or uneconomic GPU supply during demand spikesMediumHighPlatform manages GPU capacity across clouds and regions; investor says capital will fund capacityMulti-cloud capacity management and autoscalingProduct-documented; economics undisclosedMonitor throttling, reserved-capacity commitments, utilization, and gross margin
Availability or failover misses on mission-critical workloadsMediumHighCompany claims four-nines uptime and offers hybrid failover; independent SLA history was not retainedCross-cloud autoscaling, redundancy, regional and self-hosted optionsCompany-claimedObtain 24-month SLA attainment, severity-one incident history, recovery time, and credits paid
Regression across engines, models, hardware, or deployment modesMediumHighDocumentation lists several engines and custom-server paths across dedicated infrastructureStaging and production environments, traces, metrics, release lifecycle controlsProduct-documentedReview change-failure rate, rollback time, compatibility tests, and model-specific incident rates
Bespoke support load constrains repeatable scalingMediumMedium-highCompany and investor materials emphasize hands-on engineering and frontier-customer support24/7 engineering support and forward-deployed expertiseOperating claimTrack support hours per customer, deployment lead time, and support gross margin

Likelihood and severity are analyst assessments grounded in the described operating surface; the assigned evidence contains no verified outage frequency, incident count, utilization, or support-cost denominator.

[CR005, CR006, CR007, CR012, CR013, CR014, CR015]

7.4 Capital intensity, competitive pressure, and thesis-break triggers

Baseten announced a $300 million financing at a $5 billion valuation in January 2026 and said it had raised $585 million in total at that point. Two secondary sources later reported a $1.5 billion Series F at a $13 billion valuation, while one of them estimated a $600 million annualized revenue run rate as of March. That estimate is revenue run rate, not ARR, cash, or audited revenue, and the assigned evidence does not disclose burn, runway, margin, capacity commitments, or financing terms. A secondary competitive analysis also identifies both specialist inference vendors and hyperscalers as alternatives. Thesis-break triggers should therefore include repeated SLA misses, inability to secure economical capacity, materially worsening gross margin, customer or supplier concentration above the investment committee's limits, or new financing that implies a material down-round or preference overhang.[CR008, CR009, CR010, CR011, CR012, CR013, CR014]

Partner and dependency risk register
DependencyCounterparty / rolePublic concentration evidenceFailure scenarioSeverityClaimed mitigationResidual exposure / kill criterion
Cloud and GPU capacityUndisclosed cloud and hardware suppliersNo supplier shares or committed-capacity terms in the assigned corpusScarcity, price increase, or correlated regional failure impairs service or marginHighMulti-cloud and multi-region capacity managementEscalate if one provider exceeds committee limits or capacity cost makes target gross margin unattainable
Capital providers and financing expectationsVenture and growth investors funding infrastructure expansionLarge 2026 financings are reported, but burn, runway, preferences, and commitments are not publicGrowth or margin misses force repricing, dilution, or constrained capacity investmentHighSubstantial reported financing capacityKill if new terms create unacceptable preference overhang or a material down-round without a credible reset plan
Mission-critical AI-native customer workloadsNamed customers include Abridge, Cursor, Lovable, Notion, and OpenEvidenceNo revenue share, retention, contract-duration, or top-customer data in the assigned corpusLoss or insourcing of a large workload reduces utilization and weakens expansion economicsHighMultiple named customers and support-intensive deployment modelEscalate if top-customer or vertical exposure exceeds policy, or if net retention falls below the investment case

Counterparty concentration is undisclosed; rows identify dependency classes evidenced by the platform and financing model, while quantitative exposure and committee thresholds remain diligence inputs rather than reported facts.

[CR008, CR009, CR010, CR011, CR012, CR013, CR014]

7.5 Exhibits

Chapter 08

08Valuation

8.1 Recommendation and financing context

The current call is track/research more, not buy. Baseten announced a $1.5 billion Series F in June 2026 across two tranches priced at $13 billion and $11 billion, following a $300 million financing at a $5 billion valuation in January. TechCrunch calculated that the upper mark represented a 160% increase in less than half a year and reported that split pricing can boost the headline mark. That structure makes the headline valuation a poor substitute for an investable price or a fully diluted ownership schedule. The company also reported approximately 20x year-over-year revenue growth and more than one billion daily inference calls, evidence of momentum but not proof of durable margins, retention, or cash generation. Entry should therefore depend on verified financing terms and unit economics rather than the upper tranche alone.[CV001, CV002, CV003, CV012, CV013]

Recommendation summary
Decision elementCurrent viewEvidence basisInvestment implication
RecommendationTrack / research moreStrong reported growth, but insufficient public return inputsDo not underwrite a buy from the headline valuation alone
ConfidenceMediumFinancing terms and operating scale are reported; unit economics remain privateRequire primary diligence before pricing ownership
Risk ratingHighRapid valuation step-up, split pricing, and competitive execution riskDemand a margin of safety and downside protections
Valuation stanceStretched$11B-$13B tranche range versus an estimated ~$600M annualized-revenue referenceTreat the implied ~18.3x-21.7x ratio as illustrative, not fair value

Decision view as of 2026-10-12; annualized revenue is a third-party estimate, not audited ARR, and the ratio is not an enterprise-value multiple.

[CV001, CV004, CV005, CV012, CV013, CV015]

8.2 Thesis and anti-thesis

The thesis combines rapid company-reported growth, named production customers, and a product positioned around reliability, multi-cloud flexibility, security, and self-hosting. Baseten names Abridge, Cursor, Lovable, Notion, and OpenEvidence as users of mission-critical production workloads, while its enterprise page claims four-nines uptime. The anti-thesis is equally material: Baseten itself describes inference as a market full of smart, well-resourced competitors and warns that product market fit can be lost as the market changes. Enterprise list pricing is not published, and the public evidence does not establish gross margin, retention, customer concentration, or contractual duration. The financing validates investor demand, but it does not resolve whether growth converts into defensible, cash-generative economics.[CV006, CV007, CV008, CV010, CV011]

Thesis and anti-thesis
SideArgumentCurrent evidenceWhat would change the view
ThesisDemand and scaleCompany reports ~20x year-over-year revenue growth and >1B daily inference callsIndependent revenue-quality and retention evidence would strengthen the case
ThesisProduction relevanceNamed AI-native customers and company-claimed four-nines uptime support mission-critical positioningCustomer references and SLA records would confirm durability
Anti-thesisPrice outran proofUpper valuation rose 160% in under six months and the Series F used split pricingA discounted entry or audited economics could restore return headroom
Anti-thesisCompetitive and margin pressureBaseten acknowledges well-resourced competition and changing product-market fitDemonstrated gross-margin expansion and low churn would reduce this risk

Customer, uptime, growth, and competitive-positioning evidence is company- or investor-issued unless explicitly attributed otherwise.

[CV002, CV003, CV006, CV007, CV010, CV011, CV012]

8.3 Scenarios and entry discipline

Scenario underwriting should use the latest $11 billion to $13 billion tranche range as a reference, not as an independently verified fair-value band. A third-party market-data page reports roughly $600 million of annualized revenue for March 2026; pairing that estimate with the two tranche marks yields approximately 18.3x to 21.7x headline valuation-to-annualized-revenue. That ratio is illustrative rather than an enterprise-value multiple because the capital structure, cash balance, debt, preferences, and exact revenue definition are not public in the retained evidence. The bull case requires durable growth and improving economics sufficient to create exit value above the upper tranche. The base case requires proof that current scale persists. The bear case is multiple compression or a down round if growth normalizes before margins and retention are demonstrated.[CV001, CV004, CV005, CV014, CV015]

Bull, base, and bear scenarios
ScenarioExplicit assumptionsValuation / return logicKey risks and probability signal
BullReported growth persists; retention is strong; margins improve as utilization scalesExit value must rise materially above $13B after dilution to create venture-style upsideConditional upside only; no numerical probability is supported without audited cohorts and margins
BaseGrowth moderates but customer expansion and reliability remain durableUse $11B-$13B only as the latest financing reference and wait for a diligence-backed entry priceMost defensible current case, but financing terms and annualized-revenue quality remain unverified
BearGrowth decelerates; compute costs compress margin; customers multi-source or consolidate with larger platformsValue falls below the lower $11B tranche reference or a future round resets the markMaterial downside signal if retention, concentration, or margin diligence misses thresholds

Scenario boundaries are conditional underwriting references, not forecasts; no public probability, IRR, hold-period, or fully diluted return model is supportable.

[CV001, CV005, CV011, CV012, CV014, CV015]

8.4 Exit readiness, diligence asks, and thesis breaks

Baseten has late-stage financing scale, recognizable investors, and customer references, but public evidence does not support a numerical IRR, hold period, or exit multiple. Before underwriting an entry, investors should obtain audited revenue recognition, gross margin by deployment model, burn and runway, net revenue retention, cohort expansion, customer concentration, committed compute liabilities, and the complete Series F cap table and preference stack. An upgrade requires verified economics, durable retention, and an entry price that leaves meaningful upside after dilution. Thesis breaks include material growth deceleration, failure to sustain enterprise reliability, severe margin compression from compute costs, customer concentration that makes reported scale fragile, or financing terms that subordinate new common ownership. Until those checks close, exit readiness remains an open underwriting question rather than an assumed consequence of the headline valuation.[CV006, CV009, CV013, CV015, CV016]

FV001: Recommendation logic from operating proof to entry discipline

A sequential decision chain separates company-reported operating proof from financing price, missing underwriting inputs, and upgrade conditions.

Node / ConnectionNode / fromToContext
Node 1 Operating scale [scale]Company reports ~20x year-over-year revenue growth and more than 1B daily inference calls.
Node 2 Production proof [customers]Named AI-native customers are described as running mission-critical workloads.
Node 3 Financing reference [financing]$1.5B Series F across $13B and $11B tranches.
Node 4 Price risk [price-risk]Upper mark increased 160% in under six months; split pricing weakens the headline as a single value.
Node 5 Underwriting gap [evidence-gap]Margins, retention, concentration, burn, preferences, and fully diluted ownership remain undisclosed.
Node 6 Decision [decision]Track / research more until verified economics and entry terms create return headroom.

The flow is qualitative and sequential; it does not assign probabilities or calculate a return.

[CV002, CV003, CV006, CV012, CV013, CV016]

8.5 Exhibits

Disclaimer

This report is informational and based on publicly available and fetched sources in the associated diligence run; it is not investment advice.

Evidence index

Claims
IDStatementConfidenceSources
CO001 Baseten was incorporated in 2019 and is headquartered in San Francisco, California, providing specialized AI model inference infrastructure. High SO008, SO010, SO011
CO002 Baseten was co-founded by CEO Tuhin Srivastava, CTO Amir Haghighat, Chief Scientist Philip Howes, and Pankaj Gupta. Medium SO003, SO010
CO003 Co-founders Tuhin Srivastava, Amir Haghighat, and Philip Howes previously worked together at creator platform Gumroad, while Pankaj Gupta worked at Uber. Medium SO010
CO004 Baseten announced a $300 million Series E financing in January 2026 at a $5.0 billion valuation, bringing total capital raised to $585 million. Medium SO003, SO010
CO005 In June 2026, Baseten reportedly raised a $1.5 billion Series F round led by Altimeter Capital, Conviction, and Spark Capital at a valuation of up to $13.0 billion. Medium SO003, SO010
CO006 Baseten's inference platform offers SOC-2 Type II certification, HIPAA compliance, and fine-grained role-based access control across multi-cloud and self-hosted environments. Medium SO006
CO007 Baseten open-sourced the Truss model packaging framework and acquired reinforcement learning startup Parsed in December 2025 to expand post-training capabilities. Medium SO008, SO010
CO008 Baseten operates with concentrated technical dependency on its founding trio who manage the specialized model runtime compilation and infrastructure layers. Medium SO003, SO010
CO009 NVIDIA invested $150 million as a strategic anchor in Baseten's Series E financing alongside lead investors IVP and CapitalG. Medium SO003, SO010
CO010 In February 2025, Baseten closed a $75 million Series C financing round at an $825 million post-money valuation led by IVP and Spark Capital. Medium SO002, SO003, SO010
CO011 Baseten powers production inference for AI applications including Cursor, Abridge, OpenEvidence, Lovable, Clay, and Notion. Medium SO003, SO010
CO012 Baseten's headcount expanded from approximately 60 employees in early 2025 to around 147 by 2026 across San Francisco, New York, and remote locations. Medium SO003
CO013 Baseten CEO Tuhin Srivastava reported platform cluster utilization sits in the mid-90s, describing available compute slack as uncomfortably scarce. Medium SO009
CO014 Procuring frontier GPU hardware like NVIDIA B200 clusters now demands 3-to-5 year contract commitments with 20% to 30% upfront cash prepayments. Medium SO009
CM001 The AI inference infrastructure market is defined by running trained models to serve real-time predictions and generation, structurally distinct from model pre-training compute. Medium SM002, SM004
CM002 Industry analysts value the AI inference infrastructure market at approximately $106.2 billion in 2025, projecting expansion to $255.0 billion by 2030 at a 19.2% compound annual growth rate. Medium SM004
CM003 Industry forecasts anticipate that 60% to 70% of total AI workloads will transition to real-time inference by 2030 as products shift from model development to continuous end-user deployment. Medium SM004
CM004 Leading application-layer AI companies now direct 30% to 50% of their model spend toward custom and post-trained open-source models rather than relying exclusively on closed frontier model APIs. Medium SM001
CM005 Baseten reports that 95% of token volume processed across its platform originates from customized, post-trained, and fine-tuned models rather than standard off-the-shelf base model weights. Medium SM005
CM006 Baseten's inference platform processes more than one billion inference requests daily across 87 to 90 global clusters spanning 18 cloud providers. High SM001, SM004, SM005
CM007 Baseten claims customers migrating from incumbent providers or generic clouds experience inference serving cost reductions of up to 40% to 65% alongside lower latency. Medium SM002, SM004
CM008 Analyst projections for the $255 billion 2030 inference TAM blend raw GPU hardware consumption, hyperscaler compute instances, and specialized software runtimes into a single aggregate estimate. Medium SM004
CM009 Core buyers in the inference market encompass Heads of Machine Learning, VP Engineering leaders, and CTOs at AI-native companies and scaling tech enterprises. Medium SM004, SM008
CM010 Enterprise inference adoption triggers include achieving product-market fit, surging API costs at scale, requirements for sub-200ms latency, and data governance compliance mandates. High SM005, SM006
CM011 Production AI companies such as Cursor, Notion, Abridge, Lovable, and OpenEvidence run mission-critical AI workloads on Baseten's infrastructure. Medium SM001, SM007
CM012 Enterprise buyers require SOC-2 Type II certification, HIPAA compliance, single-tenant clusters, and region-restricted deployments to run sensitive production inference. Medium SM003, SM006
CM013 Severe GPU hardware shortages and operational data center deficits have pushed cluster utilization to uncomfortably high mid-90s percentages across cloud providers. Medium SM005
CM014 Jevons Paradox governs AI inference demand: declining cost per token drives developers to execute longer-running agentic tasks and integrate more intelligence into software workflows. Medium SM005
CM015 Procuring advanced GPU capacity such as B200 accelerators increasingly requires 3-to-5 year contract commitments with 20% to 30% of total contract value prepaid upfront. Medium SM005
CM016 Publicly verified metrics on enterprise customer churn, contract duration, and cohort retention remain undisclosed, preventing independent verification of reported 400% net dollar retention. Low SM005
CP001 Baseten provides enterprise-grade governance controls including role-based access control, single sign-on, and virtual private cloud self-hosting options. High SP003, SP007
CP002 Prominent AI-native companies including Cursor, Notion, and Abridge rely on Baseten to serve production model workloads. High SP006, SP001
CP003 Together AI operates an open-model inference and fine-tuning cloud that grew to an estimated $1 billion in annualized revenue and held talks at a $7.5 billion valuation. Medium SP005, SP004
CP004 Fireworks AI focuses on low-latency generative model serving and reached approximately $800 million in annualized revenue at a $4 billion valuation. Medium SP005, SP004
CP005 Modal has raised $110 million to offer a developer-focused serverless cloud using Python decorators for GPU container execution. Medium SP005, SP001
CP006 Venture analytics tracked over 500 active competitor entities in the machine learning software and application development category. Medium SP002
CP007 Industry analysts identify Together AI, Fireworks AI, Modal, Replicate, CoreWeave, and Anyscale as prominent alternatives to Baseten across various inference workload tiers. Medium SP001
CP008 Hyperscalers offer raw H100 GPU compute at approximately $3.93 per hour on AWS, compared to roughly $6.50 per hour for Baseten managed inference platform. Medium SP005
CP009 Baseten Multi-Cloud Capacity Management infrastructure spans 87 clusters across 18 cloud environments to automate GPU placement and failover. Medium SP004, SP005
CP010 Major hyperscalers including AWS Bedrock, Microsoft Azure, and Google Vertex AI pose substitution risks by bundling managed inference into broader enterprise cloud agreements. Medium SP004, SP005
CP011 Baseten gross margins remain structurally exposed to the cost of renting compute capacity from underlying GPU cloud suppliers. Medium SP004
CP012 Baseten open-source Truss framework has accumulated over 6,000 GitHub stars as a standard model packaging and deployment abstraction. Medium SP001, SP005
CP013 The acquisition of Parsed expanded Baseten capabilities into reinforcement learning and continual model improvement workflows. Medium SP005, SP002
CP014 Baseten strategic positioning prioritizes multi-cloud reliability and enterprise control over competing solely on the lowest single-model token price. Medium SP004, SP008
CP015 The industry shift toward open-source and fine-tuned AI models drives enterprise demand for neutral, high-performance serving infrastructure. Medium SP004, SP005
CI001 Baseten bills enterprise customers based on GPU compute capacity time and request volume, charging approximately $6.50 per hour for managed H100 instances compared to raw hyperscaler rates of $3.93 per hour. High SI005, SI008
CI002 Baseten offers customized enterprise contract tiers alongside standard self-hosted virtual private cloud deployment options for sensitive customer workloads. Medium SI005
CI003 Baseten's annualized run-rate revenue scaled from approximately $200 million in December 2025 to $600 million by March 2026, representing an estimated 1,900% year-over-year growth rate. Medium SI001, SI003
CI004 Baseten's cumulative venture financing exceeded $2 billion following its $1.5 billion Series F round in June 2026 at a headline valuation of up to $13 billion. Medium SI001, SI003
CI005 Baseten's multi-cloud infrastructure processes over one billion inference calls per day across 87 clusters and 18 cloud environments, yielding documented customer cost savings of 30% to 40%. Medium SI001, SI008
CI006 Leading AI application companies including Cursor, Notion, Abridge, and OpenEvidence run production inference workloads on Baseten's platform. High SI004, SI009
CI007 Baseten serves more than one hundred large enterprise customers alongside hundreds of smaller AI-native developer accounts. Medium SI001, SI008
CI008 Baseten offers a training credit program where twenty percent of training spend applies toward inference costs to incentivize multi-lifecycle platform retention. Medium SI008
CI009 Baseten's operating cost structure is heavily driven by third-party GPU compute procurement and infrastructure leases distributed across more than twenty cloud providers. High SI005, SI008
CI010 Baseten does not publicly disclose audited financial statements, GAAP gross margins, cash burn rate, or net revenue retention metrics. Medium SI003, SI008
CI011 Assessing Baseten's long-term operating leverage requires verifying whether its compute resale margin is defended by software optimization or eroded by hyperscaler competition. Medium SI001, SI008
CI012 Large enterprise AI accounts spending over $200,000 monthly on a single model face economic incentives to vertically integrate and self-host, posing customer retention risks. Medium SI001, SI008
CI013 Baseten raised a $300 million Series E round in January 2026 at a $5 billion valuation with participation from Nvidia, IVP, and CapitalG. High SI004, SI008
CI014 Baseten announced a $1.5 billion Series F financing round in June 2026 led by Altimeter Capital, Conviction, and Spark Capital at a valuation of up to $13 billion. Medium SI001, SI003
CI015 Baseten's historical revenue expanded from $2.7 million in 2023 to approximately $16 million in 2024 before inflecting to hundreds of millions in run-rate in 2026. Medium SI008
CE001 Baseten operates an AI inference platform serving over one billion production API calls daily across 87 global clusters on 18 cloud providers. Medium SE002
CE002 Baseten developed Truss as an open-source model packaging framework providing a Python-based abstraction with load and predict methods backed by container configuration. High SE005, SE008
CE003 Baseten's inference execution stack leverages modern open-source engines including vLLM, SGLang, and TensorRT-LLM optimized across specialized GPU architectures. Medium SE004
CE004 Baseten deploys forward deployed engineering teams reporting to engineering leadership to embed directly with enterprise customers on model serving optimization. Medium SE004
CE005 Baseten offers managed Baseten Cloud, single-tenant dedicated clusters, and self-hosted deployments inside customer VPCs with automatic cloud failover. High SE003, SE006
CE006 Baseten provides enterprise security controls including SOC 2 Type II certification, HIPAA compliance, GDPR compliance, and default zero-data-retention for request inputs and outputs. High SE003, SE006
CE007 Baseten charges on a continuous replica-hour model where active model instances bill continuously regardless of request volume, creating idle cost floors for redundant production replicas. Medium SE005
CE008 Baseten serverless cold starts on large model containers can require between 30 and 90 seconds to become ready after scaling down to zero. Medium SE005
CE009 Baseten adapted Kubernetes orchestration to schedule heterogeneous GPU workloads and built live-reload development environments for large model testing. Medium SE008
CE010 Baseten supports zero-to-infinity autoscaling designed to scale down idle capacity or scale up compute across multi-cloud GPU instances during traffic spikes. High SE003, SE006
CE011 Migrating containerized models from Baseten Truss requires rewriting Python wrappers to standard vLLM or SGLang configurations, representing an architectural switching cost. Medium SE005
CE012 Production AI companies including Abridge, Cursor, Lovable, Notion, and OpenEvidence deploy mission-critical inference workloads on Baseten's infrastructure. Medium SE007
CE013 Baseten established a commercial partnership with OpenAI in 2026 enabling enterprise customers to run open-source models alongside frontier proprietary endpoints. Medium SE001
CE014 Baseten enforces enterprise governance through role-based access control, single sign-on, team-level permissions, and exportable logging, metrics, and distributed tracing. Medium SE006
CU001 Baseten powers production AI inference for category-defining AI-native companies including Cursor, Abridge, Notion, Lovable, and OpenEvidence. High SU006, SU009
CU002 Baseten serves enterprise customers with mission-critical requirements through SOC-2 Type II certification, HIPAA compliance, single-tenant clusters, and self-hosted VPC deployment options. Medium SU004
CU003 Patreon deployed OpenAI's Whisper model on Baseten to transcribe creator content at scale, saving 440 engineering hours, $600,000 in annual costs, and reducing GPU expenses by 70%. High SU007, SU010
CU004 Healthcare AI provider Abridge uses Baseten for clinical documentation workloads, citing platform reliability, developer experience, and cost reduction. High SU006, SU009
CU005 Baseten's annualized revenue run-rate expanded from roughly $200 million in December 2025 to approximately $600 million by March 2026, driven by a 1,900% year-over-year surge in inference revenue. Medium SU003, SU010
CU006 Baseten's daily inference volume surpassed one billion calls across 87 clusters and 18 cloud provider environments worldwide by mid-2026. Medium SU003, SU010
CU007 By leveraging NVIDIA TensorRT-LLM and AWS EC2 GPU instances, Baseten reduced model cold-start latency from five minutes to 5–10 seconds and doubled inference performance for a customer LLM deployment. Medium SU002
CU008 Superhuman achieved 80% faster embedding model inference following migration to Baseten's dedicated inference infrastructure. Medium SU010
CU009 Baseten introduced Baseten for Model Labs in July 2026, providing its Frontier Gateway API and Model Library distribution to closed-weight model labs including Poolside and WRITER. Medium SU003
CU010 Baseten's consumption-based pricing model directly ties top-line revenue to inference volume, creating high exposure to customer usage fluctuations and compute budget pullbacks. Medium SU003
CU011 Hyperscalers including AWS Bedrock, Google Vertex AI, and Microsoft Azure pose significant customer retention risk by offering bundled inference services on captive GPU fleets. Medium SU003
CU012 Baseten serves over 100 large enterprise organizations and hundreds of smaller businesses with near-zero reported churn as of early 2025, though detailed contract retention metrics remain undisclosed. Medium SU010
CU013 General-audience AI directories index Baseten as a core machine learning model deployment and serving platform for production environments. Medium SU001, SU008
CU014 Baseten's customer base faces potential concentration risk because large AI-native anchor tenants such as Cursor and Abridge likely represent an outsized share of total inference call volume. Medium SU003, SU005
CR001 Baseten states that it is SOC 2 Type II certified and HIPAA compliant across all hosting options. Medium SR003, SR006
CR002 Baseten states that it does not store inference request inputs or outputs and protects model weights and source code with encryption. Medium SR006
CR003 Baseten documents region-restricted environments, regional deployments, private networking, workload isolation, and customer-owned infrastructure options. Medium SR003, SR006
CR004 A June 2026 secondary analysis says some regulated workloads may require on-premises or dedicated single-tenant infrastructure despite managed-platform controls. Low SR001
CR005 Baseten claims four-nines uptime using cloud-agnostic autoscaling and fast cold starts. Medium SR006
CR006 Baseten's documentation says the platform manages model containers, GPU capacity across clouds and regions, scaling, and observability. Medium SR003
CR007 Baseten describes its infrastructure as multi-region, multi-cloud, multi-model, and multi-GPU. Medium SR008
CR008 Baseten announced a $300 million financing at a $5 billion valuation in January 2026. Medium SR004
CR009 Baseten's January 2026 release said the company had raised $585 million in total at that date. Medium SR004
CR010 Two secondary sources report that Baseten raised a $1.5 billion Series F at a $13 billion valuation in June 2026. Medium SR001, SR002
CR011 AI Engineer estimates Baseten's annualized revenue run rate at $600 million as of March 2026; the source does not characterize that figure as ARR or audited revenue. Low SR002
CR012 Baseten investor Sarah Guo said the June 2026 capital would fund aggressive investment in capacity, infrastructure, and research products. Medium SR005
CR013 Baseten says Abridge, Cursor, Lovable, Notion, and OpenEvidence depend on its platform for mission-critical production AI workloads. Medium SR004, SR007
CR014 A June 2026 independent analysis identifies specialist inference vendors and hyperscaler platforms as alternatives to Baseten. Low SR001
CR015 Within the assigned public corpus, uptime and control evidence is predominantly company-issued, so residual operational and security exposure requires independent verification. Medium SR002, SR003, SR006
CV001 Baseten announced a $1.5 billion Series F made across two tranches priced at $13 billion and $11 billion. High SV001, SV002
CV002 The upper Series F mark was 160% above the $5 billion valuation announced five months earlier. High SV001, SV004
CV003 Baseten reported approximately 20x year-over-year revenue growth and more than one billion inference calls per day in June 2026. Medium SV002
CV004 Value Add Intelligence reports roughly $600 million of annualized revenue for March 2026, attributed to a StartupFortune estimate. Medium SV003
CV005 Combining the reported $600 million annualized-revenue estimate with the $11 billion and $13 billion tranche marks implies illustrative headline valuation-to-annualized-revenue ratios of about 18.3x and 21.7x. Medium SV002, SV003
CV006 Baseten identifies Abridge, Cursor, Lovable, Notion, and OpenEvidence as customers that depend on it for mission-critical production workloads. Medium SV004, SV006
CV007 Baseten claims four-nines uptime and offers multi-cloud, self-hosted, security, and enterprise-control options. Medium SV005
CV008 Baseten's enterprise page directs prospects to contact sales rather than publishing list pricing. Medium SV005
CV009 Baseten said the Series F proceeds would fund talent, compute, and enterprise go-to-market expansion. Medium SV002, SV008
CV010 Investor Conviction characterizes inference demand as less than one percent penetrated and supports aggressive capacity and platform investment. Medium SV008
CV011 Baseten acknowledges that inference attracts well-resourced competitors and that product-market fit could be lost if the company fails to move with the market. Medium SV007
CV012 TechCrunch reported that split-priced startup rounds can boost the headline valuation and make lead investors' paper marks appear stronger. Medium SV001
CV013 The available evidence supports tracking and further diligence rather than a buy recommendation at the headline valuation. Medium SV001, SV002, SV003
CV014 A downside scenario becomes more plausible if growth normalizes before Baseten demonstrates durable retention and margin economics. Medium SV002, SV003, SV007
CV015 The retained public evidence does not support a numerical target return, hold period, or exit multiple. Medium
CV016 Exit readiness cannot be established without verified unit economics, retention, customer concentration, and fully diluted financing terms. Medium
Sources
IDPublisherTitleQuote
SO002 Value Add VC Baseten ARR, Valuation & $75M Series C: What the AI Inference Startup Is Worth in 2026 Baseten does not publicly disclose ARR, revenue, or customer counts.
SO003 toflow.ai What Funding Has Baseten Raised? Full History & Investors | toflow.ai Baseten was founded in 2019 in San Francisco by CEO Tuhin Srivastava, CTO Amir Haghighat, Chief Scientist Philip Howes, and Pankaj Gupta. The company has grown from roughly 60 employees in early 2025 to around 147 by 2026, tracking one of the fastest valuation increases in AI infrastructure, from roughly $825 million to as much as $13 billion within about 18 months.
SO005 X / Sarah Guo (Conviction) sarah guo (@saranormous) on X .@Baseten is building the Inference Cloud, and has raised another $1.5B to invest aggressively in their capacity, infrastructure platform and research products.
SO006 Baseten Mission-Critical Inference for Enterprise AI Infrastructure We are SOC-2 Type II certified and HIPAA compliant across all hosting options and support data residency requirements through region-restricted deployments, strengthening your end-to-end enterprise AI inference workflow.
SO008 Baseten Ten reasons to join Baseten Baseten was founded in 2019 as a platform for data science teams to ship their work to production.
SO009 BigGo Finance Baseten CEO Tuhin Srivastava: The $1B Inference Cloud Betting on Custom Models and Capacity Crunch — BigGo Finance Srivastava delivers a stark assessment: "There is very, very little slack compute available." Baseten runs 90 clusters across 18 different clouds — a unified runtime fabric built to abstract away the complexity of providers, latency management, and failover for mission-critical inference workloads. And still, utilization sits in the mid-90s, a level he calls "uncomfortably high."
SO010 Miraheze / Learn AI Baseten Founded in 2019 by Tuhin Srivastava, Amir Haghighat, Pankaj Gupta, and Philip Howes, the company builds software and infrastructure that enables organizations to transform trained machine learning models into production-ready application programming interfaces with minimal operational overhead.
SO011 Baidu Baike Baseten Baseten is an American artificial intelligence company, founded in 2019 and headquartered in California (San Francisco).
SM001 Business Wire Baseten Raises $1.5 Billion to Power the Next Era of AI Inference Post-trained open source models are increasingly delivering frontier-level performance at a fraction of the cost, and leading app layer companies now direct 30 to 50 percent of model spend toward custom and post-trained models.
SM002 Forbes Baseten | Company Overview & News CEO and cofounder Tuhin Srivastava claims some clients switching from competitors see inference costs fall up to 65%, with better performance to boot.
SM003 Baseten Baseten overview - Baseten Baseten is a platform for model inference and training. You can call hosted models through an OpenAI-compatible API, deploy your own models on dedicated infrastructure, or train models and serve the resulting checkpoints.
SM004 Miraheze Learn AI Baseten The AI inference infrastructure market in which Baseten operates has become one of the most intensely contested segments of the broader AI industry. The market was valued at approximately 106.2 billion dollars in 2025 and is projected to reach 255 billion dollars by 2030, growing at a compound annual growth rate of 19.2 percent.
SM005 BigGo Finance Baseten CEO Tuhin Srivastava: The $1B Inference Cloud Betting on Custom Models and Capacity Crunch — BigGo Finance If you run AI inference at serious scale, here's the number that should stop you cold: 95% of the tokens flowing through Baseten's platform come from customized models.
SM006 Baseten Mission-Critical Inference for Enterprise AI Infrastructure We are SOC-2 Type II certified and HIPAA compliant across all hosting options and support data residency requirements through region-restricted deployments, strengthening your end-to-end enterprise AI inference workflow.
SM007 Baseten Careers at Baseten Companies like Abridge, Cursor, Lovable, Notion, and OpenEvidence depend on Baseten to power mission-critical AI workloads in production.
SM008 Baseten Ten reasons to join Baseten Baseten was founded in 2019 as a platform for data science teams to ship their work to production. As generative AI accelerated in 2022, we expanded our vision to help all engineering teams get to value with AI and ML. Today, we’re powering production inference for AI-native startups and enterprises.
SP001 Silicon Valley Investclub Baseten — Funding, Valuation & Leadership Serverless cloud for running Python and AI workloads; frequently cited as a Baseten alternative.
SP002 Tracxn Baseten Technologies The company has 514 active competitors, including 52 funded and 9 that have exited
SP003 Baseten Mission-Critical Inference for Enterprise AI Infrastructure With RBAC and fine-grained team-level access controls, SSO, integration support across detailed logging, custom metrics, and tracing, the Baseten inference platform is designed for control and visibility at scale throughout your enterprise AI infrastructure.
SP004 Value Add VC Baseten ARR Grew 1,900% YoY to a $13B Valuation The inference market is crowded with credible players attacking it from different angles.
SP005 Learn AI (Miraheze) Baseten Together AI, which provides a cloud platform for running, fine-tuning, and training open-source AI models, has grown to an estimated one billion dollars in annualized revenue and has been in talks for funding at a 7.5-billion-dollar valuation.
SP006 Baseten Careers at Baseten Companies like Abridge, Cursor, Lovable, Notion, and OpenEvidence depend on Baseten to power mission-critical AI workloads in production.
SP007 Baseten Ten reasons to join Baseten We differentiate our infrastructure with best in class performance for dedicated model deployments, unmatched security and compliance offerings, and self-hosting options.
SP008 Sarah Guo on X sarah guo (@saranormous) on X Baseten wins by helping these demanding, sophisticated customers do more than they could on their own, in their unique domains — embedding engineering and research capabilities, offering a truly elastic cloud, and providing tools for full-stack and complete-loop optimization.
SI001 Nexi Fund Baseten Raises $1.5B at $13B as AI Inference Infrastructure Market Explodes The company tripled its ARR from $200M to $600M between December 2025 and March 2026 — and then raised $1.5 billion at a $13 billion valuation to prove it was not a fluke.
SI002 aVenture Baseten - aVenture Company Research Baseten - aVenture Company Research
SI003 Value Add Intelligence Baseten — Valuation, Funding & Investors | Value Add Intelligence Baseten is a AI infra company, based in San Francisco, California, USA, founded 2019. Latest valuation $13B (As of Jun 22, 2026, Crunchbase News). Total funding $2B+ (As of Jun 22, 2026).
SI004 Business Wire Baseten Raises $300M at a $5B Valuation to Power a Multi-Model Future SAN FRANCISCO--(BUSINESS WIRE)--Baseten, the AI inference company chosen by the new wave of category-defining AI applications, today announced a $300 million financing with IVP, CapitalG, and NVIDIA as anchor investors. This values Baseten at $5 billion and marks the company’s third fundraise in the past year, reflecting the boom in demand for high-performance infrastructure that can reliably run modern AI models in production.
SI005 Baseten Mission-Critical Inference for Enterprise AI Infrastructure We achieve better GPU utilization and higher output through our optimized model runtimes, so you get more with less hardware costs on your high-performance AI inference stack.
SI008 Miraheze Baseten However, Baseten faces notable risks, including dependence on Nvidia's GPU supply chain, price competition from hyperscalers with deeper pockets, and the potential for major AI model providers like OpenAI and Anthropic to capture inference spend through their own proprietary APIs for models that are unavailable on open platforms.
SI009 toflow.ai What Funding Has Baseten Raised? Full History & Investors | toflow.ai Baseten has successfully raised funds through 7 rounds, with the latest being a Series F led by Altimeter Capital. With a total of $2.08B raised, the company continues to expand its operations.
SI010 Baidu Baike Baseten Baseten is an American artificial intelligence company, founded in 2019 and headquartered in California (San Francisco).
SE001 Australian Financial Review Local backers eye windfall as AI start-up Baseten plots $37b valuation Artificial intelligence infrastructure start-up Baseten could double its valuation in less than four months after securing a major deal with OpenAI, delivering a windfall for investors including Blackbird Ventures and former NBA player Matthew Dellavedova’s Athletic Ventures.
SE002 BestStartup.us Baseten Raises $1.5B 2026 — AI Inference Platform Hits $13B Valuation Baseten processes more than one billion inference calls every day and has grown revenue approximately 20 times year over year. ... Baseten runs those calls across 87 clusters distributed globally and spanning 18 different cloud providers
SE003 Baseten LLM Inference for Performance and Scale | Baseten Baseten's AI infra is built for efficient GPU utilization and high-throughput, low-latency inference on autoscaling infrastructure. ... We're HIPAA and GDPR-compliant, SOC 2 Type II certified, and offer dedicated, self-hosted, and hybrid deployment options
SE004 LinearB Inference engineering delivers production-grade AI at scale | LinearB Blog The stack is broad. It spans model architecture, GPU characteristics, inference engines like vLLM, SGLang, and TensorRT-LLM, orchestration layers, distributed systems design, and production operations.
SE005 Spheron Network Baseten Alternatives: 10 ML Inference Platforms Compared (2026) | Spheron Blog Baseten charges per replica-hour: every running model replica costs money continuously, regardless of how many requests it handles. ... Truss is Baseten's deployment abstraction: a Python class that defines load() and predict() methods, plus a config.yaml describing the model's hardware and dependencies.
SE006 Baseten Mission-Critical Inference for Enterprise AI Infrastructure Baseten never stores the inputs or outputs of your inference requests. Model weights and source code are protected in our cloud or yours using advanced encryption ... With RBAC and fine-grained team-level access controls, SSO, integration support across detailed logging, custom metrics, and tracing, the Baseten inference platform is designed for control and visibility at scale throughout your enterprise AI infrastructure.
SE007 Baseten Careers at Baseten Companies like Abridge, Cursor, Lovable, Notion, and OpenEvidence depend on Baseten to power mission-critical AI workloads in production.
SE008 Baseten Ten reasons to join Baseten Truss is our open-source model packaging framework, and we’ve released dozens of optimized implementations of open source models. ... From adapting Kubernetes to work for GPU workloads to building a live reload development environment for large AI models
SU001 AI Wiki Baseten | AI Wiki The free encyclopedia of artificial intelligence. Explore 2,000+ articles on AI concepts, models, tools, and applications.
SU002 NVIDIA Case study: Baseten's AI Inference Infrastructure Using the TensorRT-LLM feature of tensor parallelism served on AWS, Baseten boosted inference performance for a customer's LLM deployment by 2X through their open-source Truss framework.
SU003 Value Add VC Baseten ARR 2026: $600M Run-Rate, $13B Valuation The second risk is margin and consumption volatility. Because Baseten resells compute it buys, gross margins depend on how well it optimizes utilization — and a usage-based business is fully exposed to customer concentration and spend pullbacks.
SU004 Baseten Mission-Critical Inference for Enterprise AI Infrastructure We power four nines uptime thanks to our cloud-agnostic autoscaling and blazing-fast cold starts, critical for enterprise AI infrastructure supporting production workloads.
SU005 X (Sarah Guo / Conviction) sarah guo (@saranormous) on X Today, they serve the leading AI-native companies who want to own and improve their intelligence. These frontier customers need special-forces support and frontier scale.
SU006 Baseten Careers at Baseten Companies like Abridge, Cursor, Lovable, Notion, and OpenEvidence depend on Baseten to power mission-critical AI workloads in production.
SU007 Baseten Ten reasons to join Baseten Category-defining customers like Descript, Writer, Bland, Picnic Health, and Patreon rely on Baseten for production workloads.
SU008 Baidu Baike Baseten Baseten provides a software platform that helps enterprises run AI inference workloads.
SU009 Business Wire Baseten Raises $300M at a $5B Valuation to Power a Multi-Model Future "Baseten lets us run the models we need, the way we need to run them," says Shiv Rao, Co-founder & CEO of Abridge. "The performance is best-in-class, but what sets them apart is everything else: the reliability, the developer experience, the fact that they're constantly finding ways to lower our costs. They're a partner, not a vendor."
SU010 Miraheze AI Wiki Baseten Patreon deployed OpenAI's Whisper transcription model through Baseten to transcribe creator content at scale, reporting savings of 440 engineer hours, six hundred thousand dollars in costs, and a seventy percent reduction in GPU expenses annually.
SR001 andrew.ooo What Is Baseten? $13B Valuation, Series F Explained (June 2026) The $13B valuation implies investors are paying ~13x forward revenue at a roughly $1B annual run-rate assumption, which is rich but consistent with other 2026 AI infrastructure rounds (Together’s previous round, Anyscale’s previous round) and with the broader AI infrastructure premium.
SR002 AI Engineer Baseten: AI Inference and Training Infrastructure In June 2026, Baseten raised a $1.5 billion Series F at a $13 billion valuation. Its annualized revenue run rate reached an estimated $600 million as of March 2026.
SR003 Baseten Baseten overview Baseten manages model containers, GPU capacity across clouds and regions, scaling, and observability.
SR004 Baseten via Business Wire Baseten Raises $300M at a $5B Valuation to Power a Multi-Model Future Founded in 2019 and based in San Francisco, Baseten has raised $585 million to date from investors including IVP, CapitalG, Conviction, Bond, Greylock, and Spark Capital.
SR005 Sarah Guo / Conviction Sarah Guo on Baseten's Inference Cloud financing .@Baseten is building the Inference Cloud, and has raised another $1.5B to invest aggressively in their capacity, infrastructure platform and research products.
SR006 Baseten Mission-Critical Inference for Enterprise AI Infrastructure We power four nines uptime thanks to our cloud-agnostic autoscaling and blazing-fast cold starts, critical for enterprise AI infrastructure supporting production workloads.
SR007 Baseten Careers at Baseten Companies like Abridge, Cursor, Lovable, Notion, and OpenEvidence depend on Baseten to power mission-critical AI workloads in production.
SR008 Baseten Ten reasons to join Baseten We’re multi-region, multi-cloud, multi-model, multi-GPU, and working on becoming multi-everything.
SV001 TechCrunch AI inference startup Baseten reportedly raising $1.5B months after its last mega-round If finalized, this latest round would represent a 160% increase in valuation in less than half a year. However, the WSJ reports that this is a split-priced round, a tactic startups are using to boost their headline valuation and make lead investors look good on paper.
SV002 Baseten via Business Wire and Yahoo Finance Baseten Raises $1.5 Billion to Power the Next Era of AI Inference The round includes investments made across two tranches at $13 billion and $11 billion respectively, and reflects surging demand for inference at the app layer as closed source and open source models converge in capability, cost and customization.
SV003 Value Add Intelligence Baseten - Valuation, Funding & Investors Baseten reached roughly $600 million in annualized revenue by March 2026 — about +1,900% year over year — up from $200 million in December 2025.
SV004 Baseten via Business Wire Baseten Raises $300M at a $5B Valuation to Power a Multi-Model Future This values Baseten at $5 billion and marks the company’s third fundraise in the past year, reflecting the boom in demand for high-performance infrastructure that can reliably run modern AI models in production.
SV005 Baseten Mission-Critical Inference for Enterprise AI Infrastructure We power four nines uptime thanks to our cloud-agnostic autoscaling and blazing-fast cold starts, critical for enterprise AI infrastructure supporting production workloads.
SV006 Baseten Careers at Baseten Companies like Abridge, Cursor, Lovable, Notion, and OpenEvidence depend on Baseten to power mission-critical AI workloads in production.
SV007 Baseten Ten reasons to join Baseten We have product market fit. It took us a long time to get here, and our customers love our platform. But the AI market is changing every day and we’ll lose PMF if we don’t move with it.
SV008 Sarah Guo / Conviction Baseten is building the Inference Cloud Everything we see at @Conviction suggests we remain <1% into the wide and explosive demand for inference, and the world is still beginning to imagine the ways and volume at which we will use computational intelligence.