Mining on Desearch Subnet 22 is now crawling work, and every rule in this post comes from the public subnet-22 repository. You crawl the pages you are assigned, upload what you find, and validators check part of it themselves. Your earnings follow your share of verified pages. No GPU is needed for crawling.
What changed: Subnet 22 now crawls for Desearch's web index
Subnet 22 used to ask miners to answer search queries. That is gone. With Desearch 2.0, the subnet builds Desearch's web index instead: pages worth keeping are found, miners crawl them, validators check part of the work, and passed pages go into the collection the search index is built from.
Queries never wait on miner work. Your miner is a crawler, not a search server. For the bigger picture, read what a decentralized search engine is and how Desearch builds its index.
What a miner does
A miner takes a task, crawls, uploads, and reports completion. In more detail, your miner:
- Claims crawl tasks.
- Fetches every assigned page through its own proxies.
- Extracts the text (title, dates, headings and main text) and keeps the page HTML.
- Uploads the result and reports the task complete.
It needs no open port, and it does not answer queries.
How your share is worked out
Your reward share is your verified pages compared with every other miner's over a recent window. If you deliver more verified pages than others, your share grows. If others deliver more, it shrinks.
Validators set weights from the record of every miner's uploads, at the rate their own checks paid.
How validators check your uploads
A validator randomly checks part of your pages. It fetches those pages itself and compares the text with what you uploaded. A task fails only when the mismatch is significant.
You never know in advance which pages will be checked. The choice is made by chance, after you upload. So the only reliable plan is to return the real page every time.
What raises your share
- Crawl more pages.
- Return the real page.
- Report counts truthfully.
- Load hard pages instead of skipping them.
- Claim only what you can finish.
- Stay reliable.
What can lower it
A failed check takes back what you were paid since your last passed check. Failures and claims you do not finish also reduce how much work you get. Cutting corners costs more than it saves.
Mining income is not guaranteed. A task score is not a fixed token payment, and no role on the subnet has permanent rewards or guaranteed profit.
What you need to start
- Python
- PM2
- A hotkey registered on Subnet 22
- Proxies
There is no GPU requirement for crawling.
How to start mining
- Clone the subnet-22 repo and install it.
- Test locally first, against a local setup that uses the same code.
- Register a hotkey on Subnet 22.
- Configure your proxies.
- Run the miner.
Step by step instructions are in docs/miner-setup.md and docs/test-your-miner.md.
Running a validator instead? You need a validator permit and stake, plus a key for a fallback scraping service. Validators can auto-update with run.sh. See docs/validator-setup.md.
What is next: embedding
Embedding work is built into the subnet but is not open yet. It opens when Desearch's own embedding model ships, and there is no date yet. You do not need new hardware for it today. More background is in Desearch 2.0: our embedding model, crawl and embed.
FAQ
How do Subnet 22 miners earn now?
By crawling assigned pages and uploading the extracted text and HTML. Rewards follow your share of verified pages compared with every other miner over a recent window.
Do I need a GPU to mine on Subnet 22?
No. Crawling needs no GPU. You need Python, PM2, a registered hotkey and proxies.
What happens if a validator check fails?
A failed check takes back what you were paid since your last passed check. Failures also reduce how much work you get.
Can I test my miner before registering?
Yes. You can test against a local setup that uses the same code. See docs/test-your-miner.md.
Is mining income guaranteed?
No. There are no permanent rewards and no guaranteed profit for any role.