SkillAgentSearch skills...

Goscraper

Learning Go by building scraper

Install / Use

/learn @pkmishra/Goscraper
About this skill

Quality Score

0/100

Supported Platforms

Universal

README

Go Report Card

TODO

  • Given a link should be able to crawl all the hyperlinks with given pattern up to given depth - Done
  • Should be able to specific max requests per domain. (use go routines) - Done
  • Respecting Robots.txt
  • Set timeouts in http requests - Done
  • change http header dynamically - Done
  • use Cookie
View on GitHub
GitHub Stars8
CategoryEducation
Updated1y ago
Forks0

Languages

Go

Security Score

75/100

Audited on Dec 21, 2024

No findings