Filter

March 24, 2006

Filter: Code that is art of the crawler or spider’s process of indexing pages that specifically looks for violations of a search engine’s terms of use. This code then filters out violators by assessing penalties, or by removing the site altogether.