Web search engines are a boon to just about everyone. It is hard to imagine a world without them even though most of us recently inhabited such a world. They let even the poor find obscure facts about obscure subjects. Knowing who is searching for what, indexed by either ‘who’ or ‘what’ is an ability little discussed so far. Imagine what the CIA would give for that ability. I imagine government agencies have such abilities to varying degrees.
Imagine the CIA’s reluctance to be the ‘who’ of such a search—Who is the CIA vetting today?
A compartmentalized search engine would reveal itself as a spider. There are now a variety of spiders that any web server will make note of in its access_log. I observe several spiders whose provenance I only casually pursue.
A spider might provide a bus service that showed each page of the web to each of several clients. “To show” is to run client code in an address space that includes the read-only text of the page. The client code is able to send information home, including the web address. The client may be protected against side channel attacks to some negotiated degree. The bus schedule is also negotiated.