A very small and very simple web crawler
- Python > 3.4
- External libraries you may need to download:
- requests
- urllib
Regex used:
https://regex101.com/r/oN6dE6/10
- Multithreading
- Derived crawler classes
-
Notifications
You must be signed in to change notification settings - Fork 1
kunalbhagawati/crawler
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
A simple web crawler
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published