DocsAdvanced & theoryInfrastructure
Advanced & theory

Infrastructure

Three GPU cluster types, how the distributed network aggregates compute, performance characteristics, and hardware requirements.

Three Cluster Types

ResonTech provides three execution modes — same API surface, fundamentally different architecture and guarantees. Choose based on isolation requirements, data residency, and commitment level.

Public Pool

Shared · multi-tenant · ephemeral. Jobs route to any available GPU node in the network. Strict workload isolation, FIFO queue with configurable priority lanes. The node is wiped clean after job completion.

  • Jobs routed to any available GPU node in the network
  • Multi-tenant with strict workload isolation
  • Ephemeral compute — no persistent state between jobs
  • Node capacity reported in real-time by the kernel
  • FIFO queue with configurable priority lanes

Data flow: Workers pull training data and scripts from your S3 bucket at job start. Outputs are written back to your bucket. The node is wiped clean after job completion.

Managed Cluster

Dedicated · reserved · persistent. Nodes reserved exclusively for your organization. No job queue contention. Persistent volumes survive between jobs — checkpoints accumulate across runs.

  • Nodes reserved exclusively for your organization
  • No job queue contention with other teams
  • Persistent node state between jobs (optional)
  • Custom GPU configurations available
  • Kernel aware of your specific hardware topology

Data flow: Workers pull from your S3 bucket. Checkpoints accumulate across runs and are written back to your bucket. Your cluster has a dedicated network segment.

Private Cluster

Sovereign · air-gapped · on-prem. ResonTech worker installed on your existing GPU nodes. The kernel runs entirely within your network perimeter — zero data egress, air-gapped mode available.

  • ResonTech worker installed on your existing GPU nodes
  • Kernel runs entirely within your network perimeter
  • Zero data egress — compute and storage stays local
  • Air-gapped mode: no inbound internet required after setup
  • Your nodes join as a private pool visible only to your org

Data flow: Jobs never route outside your declared nodes. Training data, weights, and artifacts never leave your infrastructure. ResonTech only receives job telemetry — never data content.

FeaturePublic PoolManaged ClusterPrivate Cluster
Data stays on your infra
Dedicated capacity
No queue contention
Custom GPU config
Air-gapped mode

How the Network Aggregates Compute

GPU capacity is aggregated across a distributed network — better availability, broader hardware diversity, no single vendor lock-in. The kernel manages job routing from submission to completion.

StepWhat happens
Nodes RegisterGPU suppliers install the ResonTech worker. It reports GPU specs, VRAM, network speed, and availability to the kernel.
Smart MatchingWhen a job is submitted, the kernel matches it to optimal nodes — by GPU type, locality, bandwidth, and current load.
Distributed ExecutionLarge jobs are split across multiple nodes. Data is sharded. Workers communicate via high-bandwidth interconnects.
Self-HealingHeartbeat monitoring detects node failure in seconds. Jobs reschedule automatically to healthy nodes, resuming from checkpoint.
i
The routing flow: Your Client → ResonTech Kernel → GPU Node A / Node B / Node C. Jobs are dispatched to best-fit nodes across the network. You never manage node selection.

Performance Characteristics

Four kernel-level optimizations drive throughput and recovery performance.

OptimizationHow it worksResult
Multi-node automatic distributionSubmit with a GPU count and the kernel splits your job across nodes automatically — no manual NCCL setup, no rank configuration.8× throughput gain
Topology-aware schedulingMulti-node jobs are placed on nodes with high-bandwidth interconnects — NVLink, InfiniBand. Slower nodes picked last.< 15s node selection
Data shardingYour dataset is automatically sharded across worker nodes at job start. Workers pull their shard directly from your bucket in parallel.3× data throughput
Checkpoint-aware recoveryNode failure triggers automatic rescheduling. Job resumes from last checkpoint — not epoch 0. Zero lost compute.100% recovery success

Kernel Intelligence Features

FeatureDescription
GPU affinity routingJobs requesting specific GPU types are routed to matching nodes first
Topology-aware placementMulti-node jobs prefer nodes with NVLink or InfiniBand interconnects
Preemption + recoveryLower-priority jobs yield to high-priority ones; they resume from checkpoint
Elastic scalingInference endpoints scale replicas up/down based on request throughput
Spot reclamation handlingReclaimed spot nodes trigger automatic rescheduling, not failure
Cost-aware schedulingKernel can prefer cheaper nodes when latency is not the constraint

Becoming a Supplier

Have idle GPUs? Install the ResonTech worker and your nodes join the distributed GPU pool, running real ML workloads for users on the platform.

StepWhat to do
01 · RegisterSign up as a GPU supplier. Provide hardware specs, location, and availability windows.
02 · InstallOne-line install of the ResonTech node worker. It registers your GPU into the network and handles job routing.
03 · ConfigureDefine GPU availability windows and resource allocation. The kernel registers your node capacity and factors it into job routing.
04 · MonitorJobs route to your hardware automatically. Full dashboard visibility into node utilization, job history, and resource metrics.
i
Contact office@reson.tech to join the supplier network.

Hardware Requirements

Requirements for running jobs on the network and for supplying GPUs to the network.

ComponentMinimumRecommended
GPUGTX 1080 TiRTX 3090 / A100
VRAM8 GB24 GB+
RAM32 GB128 GB+
Storage100 GB NVMe200 GB NVMe
Network100 Mbps10 Gbps (for multi-node)
OSUbuntu 20.04Ubuntu 22.04
i
Requirements vary by job type. Inference serving requires less RAM than large training runs. Multi-node training requires NVLink or InfiniBand for best performance. Contact us for specific hardware validation.