Appearance
Self-hosted Android device lab vs cloud device farm
In short: A cloud device farm rents you real phones by the minute or the parallel session. A self-hosted lab uses phones you own, run from your own computer, and BenchFleet is the way to run one. Every phone is live on one screen, workflows run on all of them and AI agents work with approvals, for a flat plan price and no meter running.
Prices checked on 20 October 2026 on each vendor's own page; they change, so check before you buy. We make BenchFleet. The two models are not rivals for ever: many teams run their own phones every day and rent a cloud for the rare device. This guide shows what each costs for a typical lab and how to run one.
Free for up to 3 phones, with no account. Pro adds workflows, schedules and AI for up to 25 phones from £12 a month + VAT.
What each term means
- Device farm or device cloud: a vendor's data centre of real phones, and often emulators, that you use remotely to run test suites or test by hand in a browser.
- Self-hosted device lab: phones you buy, plugged into a computer you control, with software to see, control and automate them. The software can be open source, a paid tool such as DeviceLab or BenchFleet, or your own scripts around adb.
- Virtual cloud phones: Android running in a virtual machine on a server (Genymotion SaaS, Limrun, Appetize). Quick to start and priced by the minute.
Search engines also use "device farm" for racks of phones that run social-media accounts. This guide is about app testing, automation and AI agents.
The trade-offs
| Cloud device farm | Self-hosted lab (your phones) | |
|---|---|---|
| Device coverage | Thousands of models, iOS and Android | The phones you pick to match your users |
| Start-up time | Minutes | Connect phones to a computer |
| Running cost | Per minute, per parallel session or per device | A software plan plus the phones |
| Session length | Often capped or metered | As long as you like: the phones are yours |
| Your data | On the vendor's devices | On your hardware |
| Upkeep | The vendor's job | Yours: cables, hubs, batteries, updates |
A 12-month cost example: 5 devices used every working day
Assumptions: 5 Android devices, about 20 hours of use each per month (an hour per working day), for 12 months, at list prices before tax and discounts. The phones you buy for a self-hosted lab are not included; add their cost yourself.
| Option | How it is priced (vendor's page, 20 Oct 2026) | About 12 months for this example |
|---|---|---|
| AWS Device Farm, pay as you go | $0.17 per device minute | 5 × 1,200 minutes × $0.17 × 12 = $12,240 |
| AWS Device Farm, unmetered | $250 per device slot per month | 5 × $250 × 12 = $15,000 |
| Sauce Labs Real Device Cloud | $199 a month billed annually, 1 to 5 concurrent sessions by plan | from $2,388; more concurrent sessions cost more |
| BrowserStack Automate, Desktop & Mobile | $175 a month billed annually, per parallel test | from $2,100 per parallel test; more parallels cost more |
| Genymotion SaaS, Unlimited (virtual devices) | $179 per device per month billed annually | 5 × $179 × 12 = $10,740 |
| DeviceLab (your phones) | First device free, then $99 per device per month | 4 × $99 × 12 = $4,752 plus phones |
| BenchFleet Pro (your phones) | £12 a month + VAT for up to 25 phones | the same each month, however long the phones run, plus the phones |
What this shows: per-minute and per-device prices add up for devices used every day, while a self-hosted lab costs mostly the phones, and BenchFleet's price does not change with how long they run. For a model you need once a month, a cloud is the sensible way to reach it.
Ways to run a lab of your own phones
- BenchFleet. A desktop app for Windows, macOS (Apple silicon) and Linux. Every phone is a live tile; one click takes control; workflows are recorded once and run on every phone; an MCP server lets Claude Code and Codex use the phones you choose, with approvals and a hash-chained audit log. Free for 3 phones.
- DeviceLab. Turns devices you own into a remote test lab that runs Maestro, Appium, Espresso, XCUITest and WebdriverIO against them; device nodes run on Mac and Linux; the first device is free, then $99 per device per month.
- DeviceFarmer (STF). A free, open-source web application for controlling devices from a browser. You run and look after its servers yourself; see the OpenSTF and DeviceFarmer comparison.
- Your own scripts around adb, with scrcpy for viewing.
Where a cloud device farm fits
- You need iPhones or many models you do not own.
- You already run Appium, Espresso or XCUITest suites in a vendor's cloud and want to keep them there.
- Nobody on the team wants to look after hardware.
For the cloud side in detail, see the BrowserStack alternative and the AWS Device Farm alternative pages.
Where your own phones fit
- You use the same few models every day, so per-minute costs keep growing.
- Sessions are long: AI agents, soak tests, apps that run for hours.
- Test accounts and data should stay on your hardware.
- People, scripts and AI agents share the same phones.
Both at once
You do not have to choose for ever. BenchFleet's cloud phones, live now (prices), put rented Android phones in the same fleet as your USB phones, so the same people, workflows and agents can use either. To see how an agent uses a phone, read let Claude Code or Codex control an Android phone.
Questions
What is a self-hosted Android device farm?
A set of Android phones you own, plugged into a computer you control, with software to see, control and automate them. BenchFleet is one: a desktop app with every phone live on one screen, takeover in a click, workflows and AI agents.
Is it cheaper to host your own phones than to rent a device cloud?
For phones you use every day, usually yes, because a flat plan costs the same however long they run, while clouds charge by the minute or the session. You buy the phones once. A model you need only now and then is a good job for a cloud.
What does BenchFleet cost for a lab of phones?
The Free plan covers 3 phones. Pro costs £12 a month + VAT for up to 25 phones with workflows, schedules and AI clients, and Team costs £20 per seat a month + VAT with no phone limit and gateways for phones on several computers.
Is a device farm the same as a phone farm?
No. A device farm or device lab is for testing and automating apps on real phones. Search engines sometimes use the words for racks of phones that run many social accounts, which is a different market. BenchFleet is for app teams, developers and AI agents using their own apps and accounts.
Can I combine my own phones with a cloud?
Yes, and many teams do: their own phones for daily work and a cloud for the occasional model they do not own. BenchFleet's cloud phones, rented by the minute, join the same fleet as your USB phones.
Why BenchFleet
- Every phone on one screen, with battery, temperature and problems in red, and takeover in a click.
- Automation without test code: record a flow once, run it on one phone, a group or every phone, on a schedule (Pro).
- AI agents under your rules: scope, approvals and an audit log.
- A flat price, Free for 3 phones and Pro at £12 a month + VAT for up to 25, with no meter and no session cap.
- Local by default: nothing leaves your computer, and there is no telemetry.
Start with the Free plan
Free for up to 3 phones, with no account. Pro adds workflows, schedules and AI for up to 25 phones from £12 a month + VAT.
- A Free plan with no time limit and no account
- Starts in Local mode, with no telemetry or analytics