Bulletproof SEO bot

[Graybeard]

I made a bulletproof SEO scraper bot in 15 minutes with ChatGPT
You are all doomed
I just scraped the Bank of America login page a few minutes ago LMFAO
I scraped this site's post page too --NP

The mission was to scrape all the anchor tags of the links --that was proof of concept (POC)
That's an SEO Trick --right
Either the BofA is stupid and incompetent or my forged header really rocks

results:>>>
data/scraper$ ./anchor.py
Enter your URL: https: // secure.bankofamerica.com/login/sign-in/signOnV2Screen.go
Skip to main content
En español
Browser Help and Tips
Close

Online ID Help

Forgot your Password?
Log In
Log In with mobile app
Log In with Password
Log in with Windows Hello
Send notification again
Log In with Password instead
Send notification again
Log In with Password instead
Log In with Password instead
Get the app link opens a new info modal layer

{storeLinkText}

Send
Learn about your Banking by Phone options
Close
Send another link

Continue link opens a new info modal layer

Forgot ID/Password?
Problem logging in?
Enroll now for online Banking
Learn more about Online Banking
Service Agreement
Privacy
Security
Your Privacy Choices
Equal Housing Lender <<<

"ALL YOUR BASE ARE BELONG TO US"

 

[azgold]

God, I wish I had your brain and know-how!

 

[Graybeard]

I was trying to make the point that using tools to rip (insert something here) is an endless loop. Someone will rip what you ripped off; and you gain nothing but a short lead time. But yes, you can study the methods of your competitors but it becomes and endless loop if you let it.

Anyway, I got the idea of using BeautifulSoup from ChatGPT but I knew of the module but hadn't used it in a script --the fake header I have used effectively for years. Hint: GoogleBot is Mozilla/5.0 compatible as well as every current web browser Block that and you block the internet