Document Analysis NLP IA
FREQ, RAKE or TFIDF
Summary (IA Generated)
Google announced the introduction of new artificial intelligence (AI) tools to help fight against a range of spam.
There are multiple forms of spam that Google fights at different points in which Google interacts with web pages.
Google specially focused it’s spam fighting algorithms on sensitive searches that were especially important to users like those related to important topics like finding medical testing sites.
“By combining our deep knowledge of spam with AI, last year we were able to build our very own spam-fighting AI that is incredibly effective at catching both known and new spam trends.
Spammers will hack a site and add new pages with links to other sites.
A widespread site hack that Google warns about is called the Japanese keyword hack because it adds Japanese language pages.
Google claimed to have caught “most” spam generated by site hacking.
Three Areas Where Google Blocks Spam.
Crawled SpamIndexed SpamSpam Caught by Manual ActionSpam Blocked Before Making it to the Index.
Google’s crawler (GoogleBot) is software that crawls the Internet to find web pages to include within Google’s search index in order to show those pages in search results.
The crawler itself can catch spam as it encounters it so that the spam doesn’t make it to the index.
Spam added through the Search Console Request Indexing tool is also caught and discarded before it is included in Google’s search index.
Spam in Search Index Blocked Before it is Ranked.
These systems don’t catch all the spam and some spam makes it into Google’s search index.
Whenever Google responds to a search query Google will scan web pages that are being considered for ranking in order to find more spam.
Spammy pages that are found at this level is used to create better spam fighting algorithms at the web crawling level.
Google claims that these systems block 99% of spam from reaching users.
As for the tiny percentage left, our teams take manual action and use the learnings from that to further improve our automated systems.
Google added low-quality review and shopping sites to the list of sites that are analyzed by their AI tools.
Everyone has an anecdote about a spam site that is getting away with ranking on Google.