Skip to content

A Python-based data crawler for gaming information, focused on scraping data from various gaming websites. ACADEMIC USE ONLY!

Notifications You must be signed in to change notification settings

Bloodwingv2/Data-Crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

46 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Gaming Crawler ๐Ÿ•น๏ธ

A Python-based data crawler for gaming information, focused on scraping data from Steam.


๐Ÿš€ Features

  • Scrapes detailed game information from Steam
  • Easy setup and execution
  • Designed for data analysis or personal projects

๐Ÿ› ๏ธ Prerequisites

Before you begin, ensure you have the following installed:

  • Python 3.8+ โ€“ Download Python
  • pip โ€“ Python package manager (comes with Python)
  • uv โ€“ Install globally using:
  pip install uv

๐Ÿ“ฅ Installation

Follow these steps to set up the project:

  1. Clone the repository
   git clone <your-repo-url>
   cd gaming_crawler
  1. Navigate to the scripts directory
   cd Scripts
  1. Sync dependencies with uv
   uv sync
  1. Run the Steam scraper
   python steam_scraper.py

โšก Usage

Once installed, the scraper will fetch the latest gaming data from Steam and store it locally (or as defined in your script configuration).

Quick start:

cd gaming_crawler/Scripts
python steam_scraper.py

๐Ÿ“Œ Notes

  • Ensure Python is added to your system PATH for commands to work globally
  • If you encounter permission issues when installing uv, try:
    • pip install uv --user (installs for current user only)
    • sudo pip install uv (Linux/Mac with admin privileges)


Happy Scraping! ๐ŸŽฎ

About

A Python-based data crawler for gaming information, focused on scraping data from various gaming websites. ACADEMIC USE ONLY!

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •  

Languages