DVC PROJECTS WITH AUTOMATED/REPRODUCIBLE DATA AND MODEL PIPELINES

Preparation

git clone https://github.com/mrbestnaija/gitworkflow-course-ds-base.git
cd course-ds-base

Create virtual environment named dvc-venv (you may use other name)

python3 -m venv dvc-venv
echo "export PYTHONPATH=$PWD" >> dvc-venv/bin/activate
source dvc-venv/bin/activate

Install python libraries

pip install --upgrade pip setuptools wheel
pip install -r requirements.txt

Add Virtual Environment to Jupyter Notebook

python -m ipykernel install --user --name=dvc-venv

Configure ToC for jupyter notebook (optional)

jupyter contrib nbextension install --user
jupyter nbextension enable toc2/main

jupyter notebook

Name		Name	Last commit message	Last commit date
Latest commit History 30 Commits
.dvc		.dvc
.env		.env
data		data
models		models
notebooks		notebooks
src		src
.dvcignore		.dvcignore
.gitignore		.gitignore
README.md		README.md
dvc.lock		dvc.lock
dvc.yaml		dvc.yaml
params.yaml		params.yaml
requirements.txt		requirements.txt