WebWizard@links.hackliberty.org to Ask Lemmy@lemmy.world · 2 years agoWhat's your favourite search engine?message-squaremessage-square58fedilinkarrow-up154
arrow-up154message-squareWhat's your favourite search engine?WebWizard@links.hackliberty.org to Ask Lemmy@lemmy.world · 2 years agomessage-square58fedilink
minus-squareyeehaw@lemmy.calinkfedilinkarrow-up5·2 years agoHow does that work, does it go out and start indexing the internet for you?
minus-squarewhaleross@lemmy.worldlinkfedilinkarrow-up5·2 years agoIt’s a meta search engine. It queries other search engines and compiles you results.
minus-squarelud@lemm.eelinkfedilinkarrow-up3·2 years agoThat’s a shame, It would be more interesting to run your own crawlers. (Yes I realise that would be computationally intense and hard, but it would nonetheless be cool)
minus-squarewhaleross@lemmy.worldlinkfedilinkarrow-up3·2 years agoThere is probably a neat wget oneliner that could crawl everything on the open web. The real challenge is how to index all the information. That might be a neat Perl oneliner.
How does that work, does it go out and start indexing the internet for you?
It’s a meta search engine. It queries other search engines and compiles you results.
That’s a shame, It would be more interesting to run your own crawlers.
(Yes I realise that would be computationally intense and hard, but it would nonetheless be cool)
There is probably a neat wget oneliner that could crawl everything on the open web. The real challenge is how to index all the information. That might be a neat Perl oneliner.