SkillAgentSearch skills...

DataParsing

Data Parsing is used to run all the necessary scripts to populate our UWPath database.

Install / Use

/learn @UW-Path/DataParsing
About this skill

Quality Score

0/100

Supported Platforms

Universal

README

Data Parsing

This repository parse course data found on the University of Waterloo website and transfer that to UWPath's databases.

Setup

Python 3 and PostgreSQL

Set up database

Make sure Postgres is setup: - Currently, only local server is available - Default Database Connection is: 'NAME': 'postgres', 'USER': 'postgres', 'PASSWORD': '1234', 'HOST': 'db', 'PORT': '5432'

Set up Python

Go to the top level of the repo and run "pip install -r requirements.txt" on terminal. To populate database run "./PopulateDatabase.sh".

Refer to wiki page for Docker setup

Related Skills

View on GitHub
GitHub Stars6
CategoryData
Updated2y ago
Forks5

Languages

Python

Security Score

60/100

Audited on Jun 26, 2023

No findings