A Python-based data crawler for gaming information, focused on scraping data from Steam.
- Scrapes detailed game information from Steam
- Easy setup and execution
- Designed for data analysis or personal projects
Before you begin, ensure you have the following installed:
- Python 3.8+ โ Download Python
- pip โ Python package manager (comes with Python)
- uv โ Install globally using:
pip install uvFollow these steps to set up the project:
- Clone the repository
git clone <your-repo-url>
cd gaming_crawler- Navigate to the scripts directory
cd Scripts- Sync dependencies with uv
uv sync- Run the Steam scraper
python steam_scraper.pyOnce installed, the scraper will fetch the latest gaming data from Steam and store it locally (or as defined in your script configuration).
Quick start:
cd gaming_crawler/Scripts
python steam_scraper.py- Ensure Python is added to your system
PATHfor commands to work globally - If you encounter permission issues when installing
uv, try:pip install uv --user(installs for current user only)sudo pip install uv(Linux/Mac with admin privileges)
Happy Scraping! ๐ฎ