singletenant.ai

Vendors · Comparison

NVIDIA NIM vs Together AI

Only NVIDIA NIM documents GDPR DPA; only Together AI documents SOC 2 Type II and HIPAA BAA. Pricing, compliance and residency compared, with sources.

Last verified (older of the two profiles) How we verify

From the data

Key differences

  • Pricing NVIDIA NIM: NVIDIA AI Enterprise per GPU ($4,500/GPU/year self-managed; $1/GPU/hour in cloud marketplaces plus CSP instance costs) (published pricing). Together AI: Per 1M tokens serverless; per GPU-hour for dedicated endpoints and clusters (published pricing).
  • Category NVIDIA NIM is a Managed self-host offering; Together AI is Dedicated GPU.
  • Compliance Both document ISO 27001. Only NVIDIA NIM documents GDPR DPA. Only Together AI documents SOC 2 Type II and HIPAA BAA.
  • Data residency NVIDIA NIM's data residency is not verified; Together AI states data residency on its own pages (not contractual).
  • Jurisdiction Both parent companies are under United States jurisdiction.

Generated from the verified vendor data below; sources and dates on each vendor profile.

NVIDIA NIM

NIM containers self-host inference microservices, licensed for production via NVIDIA AI Enterprise. Dedicated deployments run in CSP model gardens, on NVIDIA Brev instances, or as private VPC endpoints via NVIDIA Cloud Functions; Hugging Face offers selected serverless NIM endpoints. AI Trust Center lists ISO 27001; SOC 2 type not specified. Cloud Services DPA includes SCCs.

Together AI

Dedicated endpoints are explicitly single-tenant GPU instances with public per-hour pricing. The dedicated endpoints page says customers choose the deployment region for data residency; the terms make no geographic commitment, so residency is Stated. ISO 27001:2022 certified by A-LIGN, an ANAB-accredited body. Reserved dedicated capacity is also sold in throughput units (PTUs).

Side by side

Capabilities compared

NVIDIA NIM Together AI
Pricing model NVIDIA AI Enterprise per GPU ($4,500/GPU/year self-managed; $1/GPU/hour in cloud marketplaces plus CSP instance costs) Per 1M tokens serverless; per GPU-hour for dedicated endpoints and clusters
Public pricing Yes Yes
Category Managed self-host Dedicated GPU
Deployment models Self-hosted containersDedicated endpointsNVIDIA-hosted APIDGX Cloud ServerlessDedicated endpointGPU clusters
Regions Not verified Not verified
Compliance ISO 27001 (stated)GDPR DPA SOC 2 Type II (stated)HIPAA BAA (stated)ISO 27001
Data residency evidence Not verified Stated
Parent jurisdiction United States United States
Sovereign for Not recorded Not recorded
Analyst note NIM containers self-host inference microservices, licensed for production via NVIDIA AI Enterprise. Dedicated deployments run in CSP model gardens, on NVIDIA Brev instances, or as private VPC endpoints via NVIDIA Cloud Functions; Hugging Face offers selected serverless NIM endpoints. AI Trust Center lists ISO 27001; SOC 2 type not specified. Cloud Services DPA includes SCCs. Dedicated endpoints are explicitly single-tenant GPU instances with public per-hour pricing. The dedicated endpoints page says customers choose the deployment region for data residency; the terms make no geographic commitment, so residency is Stated. ISO 27001:2022 certified by A-LIGN, an ANAB-accredited body. Reserved dedicated capacity is also sold in throughput units (PTUs).

Where they diverge

Deployment differentiation

Only NVIDIA NIM

Self-hosted containersDedicated endpointsNVIDIA-hosted APIDGX Cloud

Both

No overlap in deployment models.

Only Together AI

ServerlessDedicated endpointGPU clusters