Jump to content

Recommended Posts

Posted (edited)

Hi,

 

I really dig the "Web Bot" but I've always been curious how it works... Is this a web crawler bot, like Google? Or is it using a search engine to find results? Is it an actual program? A script? C++? Python?

Always kinda wanted to make my own web bot to find correlations in the Woo out there. Does Cliff ever show any of the mechanics of the web bot or offer any example code to point someone in the right direction?

 

Just curious. Love the site and Cliff's insights.

 

chadwick

Edited by chadwick
Posted

perhaps you should ask clif

moon@halfpasthuman.com

 

he got a 'tuned' lexicon, spiders and a post scrape reduction process, it created huge amounts of data. they only had enough storage for each run ... so each run purged the previous run data

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...

Important Information

Terms of Use, Privacy Policy, We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue., Guidelines