← all guides

Judging Pool Uniqueness Before You Commit

Every proxy provider says their pool is “large” or “unique.” Neither word means much on its own. A pool can have a hundred thousand IPs listed and still hand you the same twelve addresses on every rotation, because those hundred thousand IPs are shared across every customer buying from that pool at the same time, and rotation just cycles you through whichever ones happen to be free. Before you commit budget to a provider, you can check this yourself with a small trial run and a bit of arithmetic. This is about running that check, not about trusting a sales page.

What “unique” is actually claiming

When a provider says a pool is unique, they’re usually making one of three different claims, and it matters which one:

  1. Unique to you. No other customer gets assigned the same IP at the same time. This is a claim about allocation, not about the underlying network.
  2. Unique in aggregate. The pool contains that many distinct IPs somewhere in its inventory, even if most of them are offline, on a waitlist, or owned by carriers who reassign them constantly.
  3. Unique from other providers. The IPs aren’t also being sold, under a different label, by a reseller of the same upstream network.

The third one is the one operators get burned by most often. A lot of “proxy providers” are resellers sitting on top of the same handful of residential or mobile networks. If you buy from two different brands and both are reselling the same upstream SIM farm or peer-to-peer SDK network, you can end up scraping a target from what looks like two independent pools but is actually one pool wearing two names. Your target sees the same subnet showing up from “two vendors” and starts treating the whole range as one suspicious cluster.

Why pools overlap in practice

Overlap isn’t a conspiracy, it’s just how the supply chain works. Residential and mobile proxy networks are expensive to build from scratch, so a lot of mid-size and small providers buy bandwidth wholesale from a handful of larger network operators and resell it under their own dashboard and pricing. Datacenter proxies overlap even more directly: if two providers both lease from the same cloud host or the same block of hosting-provider IP space, their “distinct” pools can sit on adjacent or identical subnets.

None of this is a sign of bad faith. It’s a sign that you need to check what you’re actually buying rather than take the pool-size number at face value.

The test: log exit IPs before you commit

The most reliable way to judge a pool is to make it show you its IPs directly, over a real session, rather than reading marketing copy about pool size. Here’s the shape of the test:

  1. Rotate and log. Using the provider’s trial or smallest paid tier, send a series of requests to a plain IP-echo endpoint (something like an “what’s my IP” service you control or trust) with rotation triggered between each request. Log every returned IP, along with the ASN and subnet it belongs to.
  2. Dedupe and count. After a reasonable number of rotations, count how many distinct IPs you actually saw versus how many requests you made. A pool that keeps recycling the same small set within a short session tells you the effective rotation depth is much smaller than the advertised pool size, at least for you, right now.
  3. Check subnet clustering. Group the IPs by /24 (or /64 for IPv6) and see how concentrated they are. If most of your “unique” IPs sit inside two or three subnets, a target that blocks at the subnet level, which is common, will treat them as one source regardless of how many distinct addresses you counted.
  4. Check ASN diversity. Look up the ASN for each IP. Genuine residential and mobile pools usually span many different ISPs and carriers, because they’re built from real consumer connections. A pool where every IP traces back to one or two ASNs, especially hosting-provider ASNs, is functionally a datacenter pool with a residential label on it.
  5. Cross-reference against a pool you already run or already know. If you or your organization already use another proxy pool, compare the IP lists. Overlap here is the clearest sign you’re paying twice for the same supply.

None of these steps require anything exotic. A spreadsheet, a WHOIS or ASN lookup tool, and a script that hits an echo endpoint N times is enough to get a real answer instead of a guess.

Reading the results honestly

A few unique IPs repeating inside a short trial window isn’t automatically damning. Rotation depth depends on pool size, how many other customers are drawing from it at that moment, and how the provider’s session logic works. What you’re looking for is whether the pattern matches what was sold to you. If you paid for a large, geographically spread residential pool and your trial shows twenty IPs clustered in three ASNs, that’s a real mismatch worth asking the provider about directly, and worth basing any judgment of the provider on this test, not on a review you read somewhere.

It’s also worth remembering that no pool, however well built, stays static. Residential IPs churn as home users’ routers reconnect and get reassigned new addresses by their ISP. Mobile IPs churn constantly by design, since carriers rotate customers through shared address pools for their own network management reasons. A pool that looked highly unique in your Monday trial can look different by Friday. Treat any uniqueness check as a snapshot, not a permanent certification.

Why this matters for staying clean, not just for value

Uniqueness testing isn’t only about not overpaying for redundant supply. It’s also about understanding your own footprint before you send real traffic to a target. Sites that want to manage automated traffic generally build defenses around exactly the signals described above: ASN reputation, subnet-level rate limiting, and correlation across sessions that look like they’re coming from “different” sources but share upstream characteristics. This is normal, defensible infrastructure on their side, not something to route around. A scraper that understands its own pool’s real diversity, rather than the number on the pricing page, is in a much better position to keep request rates and concurrency sane for whatever diversity it actually has, and to avoid quietly hammering a target from what is effectively one subnet under a hundred different mask IPs.

Nothing about this testing process, or about a provider’s honest uniqueness numbers, changes what’s appropriate to scrape. Public, non-paywalled data that a site’s own terms allow is a different conversation from personal data or content sitting behind a login. Pool quality doesn’t grant permission it doesn’t have.

A short checklist before you commit

  • Run a logged rotation trial of at least a few dozen requests against the tier you’re actually planning to buy.
  • Dedupe the IPs and note the ratio of unique addresses to total requests.
  • Group by subnet and by ASN, and look at how concentrated the results are.
  • Compare against any pool you already hold, to catch reseller overlap.
  • Repeat the trial on a different day if the first result surprises you, since pools shift over time.
  • Judge the provider on what the trial actually showed, not on the pool-size figure in their pricing table.

None of this guarantees a given target won’t flag or block your traffic, and no honest provider or checklist can promise that. What it gives you is a grounded picture of what you’re actually buying, so your decision to commit is based on a pool you measured yourself.

For more on choosing proxy infrastructure and running scrapers cleanly, head back to the Proxy Scraping homepage.

Get new guides and videos first — join the Telegram channel.

proxies
Need proxies that survive the block wall?

Singapore Mobile Proxy runs real 4G/5G mobile IPs on rotating SIMs — the carrier-grade addresses most of these targets still trust.

see plans →
read on
More scraping guides

The rest of the field manual: target-site playbooks, library walkthroughs, provider reviews, and anti-bot troubleshooting.

browse all guides →