Jump to content

Bot Tech?


Recommended Posts



I really dig the "Web Bot" but I've always been curious how it works... Is this a web crawler bot, like Google? Or is it using a search engine to find results? Is it an actual program? A script? C++? Python?

Always kinda wanted to make my own web bot to find correlations in the Woo out there. Does Cliff ever show any of the mechanics of the web bot or offer any example code to point someone in the right direction?


Just curious. Love the site and Cliff's insights.



Edited by chadwick
Link to comment
Share on other sites

perhaps you should ask clif



he got a 'tuned' lexicon, spiders and a post scrape reduction process, it created huge amounts of data. they only had enough storage for each run ... so each run purged the previous run data

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Create New...

Important Information

Terms of Use, Privacy Policy, We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue., Guidelines