WebScraper
A powerful and user-friendly command-line interface tool for extracting web data and exporting it to CSV format. Built with Python, this tool provides an intuitive way to scrape web content with professional-grade features and error handling.
Install / Use
/learn @itsaugvst0x01/WebScraperREADME
WebScraper
<img src="demo/Demo01_15-01-2025.png" alt="Texto alternativo">A powerful and user-friendly command-line interface tool for extracting web data and exporting it to CSV format. Built with Python, this tool provides an intuitive way to scrape web content with professional-grade features and error handling.
🚀 Features
- User-friendly CLI Interface with rich formatting and progress indicators
- Robust Error Handling with comprehensive logging
- Data Preview capability with formatted tables
- Flexible CSS Selector support for precise data extraction
- CSV Export with automatic timestamp tracking
- Professional-grade Logging system
- URL Validation and sanitization
- Custom User-Agent handling
- Session Management for improved performance
📋 Prerequisites
- Python 3.8 or higher
- pip (Python package installer)
🔧 Installation
- Clone the repository:
git clone https://github.com/yourusername/web-scraper-cli.git
cd web-scraper-cli
- Create a virtual environment:
python -m venv venv
- Activate the virtual environment:
- On Windows:
venv\Scripts\activate - On macOS/Linux:
source venv/bin/activate
- Install the required dependencies:
pip install -r requirements.txt
