PicoCrawler is a very simple web crawler, written in Python. It can search all pages from the same host, creating an index to make simple to create web search feature to a specific website.
PicoCrawler is still under development and licensed using BSD License.