Liquid Electronics — AI Services & Hardware Engineering

Your own agents
on your own hardware
Demystified

The power of technology has never been more accessible. The gap between ordinary people and systems of their own has never been smaller. We’re here to bridge that gap, connecting agency to capabilities.

Sizing your needs

The right setup depends on what your business needs to do, how much work happens at once, and how quickly the work needs to finish.

1. Where does AI fit?

Not everything needs AI. Many business tasks can be handled by ordinary software. The first step is understanding what your business needs done and where AI would be useful.

The AI used to build and improve your software is a separate choice from the AI used during normal business operations. Providers such as OpenAI and Anthropic offer powerful frontier models without requiring you to own expensive hardware. However, using frontier models during normal business operations is expensive. That’s when running your own models on your own hardware becomes viable.

2. When does the work happen?

A system supporting your real-time operations needs enough capacity to handle all the work across your entire system all at the same time. Overnight jobs can take longer, spreading the work out over more hours and requiring less capacity, and cheaper hardware.

3. How busy does it get?

Twenty connected devices do not mean twenty jobs running at once. What matters is how much and what type of work each needs done. Existing usage records can reveal those patterns, giving us a starting point for estimating hardware needs.1

4. How critical?

Can an outage affect your bottom line? Then redundancy is a no-brainer.2 Can your business keep running while the system is restored? Then a cheaper hardware setup may be a viable option.

5. What computer do you need?

  • CPU: runs business software and databases, same as the computers you already use.
  • GPU: the AI part of a computer.3 Your work defines the models you run, and the models define your GPU.
  • Memory: smarter AI, longer conversations, and more work running at once require more memory.
  • Storage: more software, larger files, and longer backup history require more storage.
  • Network: more locations and more data moving at once require more network capacity.

6. How can you be sure?

New worlds are hard to navigate. We’ll show you what’s possible and help you get there. Contact us to take the first step.

A worked example: twenty restaurants

Twenty restaurants, one shared system.

1. Where does AI fit?

Restaurant operations
Taking, routing, displaying, and printing ordersSoftware / CPU
Tracking inventory and ordering suppliesSoftware / CPU
Scanning labels to check in deliveriesSoftware / CPU
Managing and updating menu boardsSoftware / CPU
Staff scheduling
Interpreting availability and scheduling preferencesLocal AI / GPU
Tracking availabilitySoftware / CPU
Sending notificationsSoftware / CPU
Checking PTO balancesSoftware / CPU
Recording call-outs and missed clock-insSoftware / CPU
Generating schedulesLocal AI / GPU
Confirming availabilityLocal AI / GPU
Handling shift changesLocal AI / GPU
Finding cover for no-showsLocal AI / GPU
Staff assistant
Questions and instructionsLocal AI / GPU
Records, permissions, and approved actionsSoftware / CPU
Work between restaurants
Equipment, capacity, and transfersSoftware / CPU
Interpreting staff requestsLocal AI / GPU
Making improvements to any of the software aboveCloud AI

2. When does the work happen?

Orders, kitchen updates, staff questions, and last-minute staffing changes need quick responses during the dinner rush. Schedule planning, document processing, and software development can wait until after it, spreading the work over more hours.

3. How busy does it get?

Assume each restaurant takes 300 orders an hour. Each order sends twenty requests—pieces of work—to the shared system for routing, stock updates, and records.

Add seven kitchen displays, twenty active staff devices, and three menu displays per restaurant. The heavier case doubles orders and staff activity.

WorkCalculationDinner rush · requests/secondHeavier demand · requests/second
Orders20 restaurants × 300 or 600 orders/hour × 20 operations ÷ 3,60033.3366.67
Kitchen displays140 displays checking every 2 seconds7070
Staff apps400 devices making one request every 10 or 5 seconds4080
Menu displays60 displays checking for updates every 60 seconds11
TotalSum of the four workloads144.33217.67

Menu displays store their media locally and check for updates. Stock and record updates are already counted with orders. The heavier case explores demand, not a five-year forecast.

AI answers

For AI, size for the answers needed at once and how quickly they must arrive. Reading a question and generating an answer place different demands on the computer.4

A token is a small piece of text. These targets describe how many answers arrive together and how quickly they appear:

TargetDinner rushHeavier demand
Simultaneous responses1020
Input per response2,000 tokens
Output per response300 tokens
Generation rate per response20 tokens/second
Combined generation rate200 tokens/second400 tokens/second
Input if all requests arrive together20,000 tokens40,000 tokens
Time to first tokenWithin 3 seconds

A 300-token answer at that rate takes about 15 seconds after it starts. Longer conversations, reasoning, and tool use add work.

4. How critical?

Essential work must continue if a computer fails. That calls for two computers, each sized to carry the essential heavier workload alone. Splitting a model across both would defeat that protection. The second computer also needs current data, a way to take over, and safeguards against repeating actions.2

5. What computer do you need?

The equipment

The budget uses two ASUS GX10 computers, each with a 20-core Arm CPU, NVIDIA Blackwell GPU, 128 GB of shared memory, and a 1 TB SSD.5 Existing screens, staff devices, network, and backup power are reused.

EquipmentQuantity × unit priceTotal
ASUS GX10 · 128 GB / 1 TB2 × $5,999$11,998.00
Toshiba N300 · 12 TB4 × $699$2,796.00
OWC dual-drive enclosure2 × $199.99$399.98
Central hardwareBefore tax$15,193.98

The GX10 combines ordinary computing, AI processing, and model memory. Software compatibility with Arm/Linux and combined performance still need testing.

CPU and network

CPU demand depends on how much work arrives together and how much processing each request needs. Assume 5–20 milliseconds per request, with 40% spare capacity:

CPU capacity = requests/second × CPU seconds/request ÷ 0.60

EstimateDinner rushHeavier demand
CPU capacity with headroom1.20–4.81 core-equivalents1.81–7.26 core-equivalents
Network data before overhead23.09 Mbps34.83 Mbps

These figures estimate processing demand. Actual CPUs differ, and AI uses the CPU too. The spare capacity is assumed, not measured.

For the network, assume 20,000 bytes sent and received per request:

Mbps = requests/second × 20,000 bytes × 8 ÷ 1,000,000

Allow more network capacity for retries, AI, backups, video, and keeping the computers in sync. Check the restaurant links, central connection, and local network.

Memory

Memory = model weights + conversation cache + runtime workspace + applications/database + operating headroom

A model’s stored values—its weights—are only the starting point. A 32-billion-parameter model at 4 bits needs about 16 GB for raw weights: parameters × bits ÷ 8. Conversations, software, and operating overhead need more. Enough memory to load the model does not prove it will answer quickly.4

The model and its storage format remain to be selected and tested for quality and speed.

Storage and backups

Each enclosure holds two mirrored 12 TB drives: 12 TB usable at each of two locations, not 48 TB of unique storage. Allow room for files and backup history. Mirroring protects against drive failure; restoring deleted files needs backup history too.6

Running costs

The electricity budget assumes continuous operation: two 240 W computer adapters, two 72 W enclosure supplies, 90% conversion efficiency, and 100 W of added load on reused servers. At $0.1447/kWh:

((2 × 240 + 2 × 72) ÷ 0.90 + 100) ÷ 1,000 × 8,760 × $0.1447 = $1,005.61/year

These are adapter ratings, not measured consumption. Enclosure power includes the disks; reused servers add no purchase cost. Specifications: ASUS and OWC enclosure.

Reserve $15,193.98 ÷ 5 = $3,038.80/year for equipment replacement over five years. IT support is budgeted separately in the restaurant example. That example also includes an illustrative $200 a month across the group for cloud AI used in software improvements. Cloud usage is separate from the local-computer capacity estimates.

6. How can you be sure?

Run the software, database, and model together at dinner-rush demand. Then test the heavier load with one computer unavailable. Check that:

  • at least 95% of order-to-kitchen updates arrive within one second, stock stays correct, and actions are not duplicated;
  • AI answers meet the agreed quality, speed, and simultaneous-response targets;
  • memory and storage cover real conversations, files, and backup history;
  • essential work recovers after a computer or network failure, and background jobs finish.

The dinner rush sets the capacity. The cost of an outage determines the backup plan. Testing the complete system checks that both are covered.

Sources
  1. Google SRE: Monitoring Distributed Systems — demand, response times, errors, resource saturation, and capacity planning.
  2. Google SRE: Reliable Product Launches at Scale — capacity, redundancy, and failure planning. The restaurant inputs are our assumptions.
  3. Intel: AI Accelerators — how GPUs accelerate AI workloads.
  4. NVIDIA: Inference Optimization — prompt processing, generation, model weights, conversation cache, and concurrency.
  5. ASUS GX10 specifications — processor, memory options, interfaces, and power supply. Retailer links identify the selected configurations and reference prices.
  6. OWC: RAID vs. Backup — drive mirroring and protection against deletion. The linked enclosure specifications list its bays, RAID modes, and 72 W power supply.

Tell us about your business and what you’d like to improve.