GRITANDGPT4

◦ Power up your AI with GritAndGPT4!

◦ Developed with the software and tools below.

🔗 Quick Links

📍 Overview

GritAndGPT4 is a project designed to harness the capabilities of the GRIT (Generative Region-to-Text Transformer for Object Understanding) model to capture object descriptions. These descriptions are then processed by GPT-4, which generates safety suggestions to enhance driver awareness.

📂 Repository Structure

└── GritAndGPT4/
    ├── LICENSE 2
    ├── configs/
    │   ├── Base.yaml
    │   ├── GRiT_B_DenseCap.yaml
    │   ├── GRiT_B_DenseCap_ObjectDet.yaml
    │   ├── GRiT_B_ObjectDet.yaml
    │   ├── GRiT_H_ObjectDet.yaml
    │   └── GRiT_L_ObjectDet.yaml
    ├── datasets/
    ├── demo.py
    ├── demo_images/
    ├── detectron2/
    │   ├── .circleci/
    │   │   ├── config.yml
    │   │   └── import-tests.sh
    │   ├── .clang-format
    │   ├── configs/
    │   │   ├── Base-RCNN-C4.yaml
    │   │   ├── Base-RCNN-DilatedC5.yaml
    │   │   ├── Base-RCNN-FPN.yaml
    │   │   ├── Base-RetinaNet.yaml
    │   │   ├── COCO-Detection/
    │   │   ├── COCO-InstanceSegmentation/
    │   │   ├── COCO-Keypoints/
    │   │   ├── COCO-PanopticSegmentation/
    │   │   ├── Cityscapes/
    │   │   ├── Detectron1-Comparisons/
    │   │   ├── LVISv0.5-InstanceSegmentation/
    │   │   ├── LVISv1-InstanceSegmentation/
    │   │   ├── Misc/
    │   │   ├── PascalVOC-Detection/
    │   │   ├── common/
    │   │   ├── new_baselines/
    │   │   └── quick_schedules/
    │   ├── datasets/
    │   │   ├── prepare_ade20k_sem_seg.py
    │   │   ├── prepare_cocofied_lvis.py
    │   │   ├── prepare_for_tests.sh
    │   │   └── prepare_panoptic_fpn.py
    │   ├── demo/
    │   │   ├── demo.py
    │   │   └── predictor.py
    │   ├── detectron2/
    │   │   ├── checkpoint/
    │   │   ├── config/
    │   │   ├── engine/
    │   │   ├── evaluation/
    │   │   ├── export/
    │   │   ├── layers/
    │   │   ├── model_zoo/
    │   │   ├── modeling/
    │   │   ├── projects/
    │   │   ├── solver/
    │   │   ├── structures/
    │   │   ├── tracking/
    │   │   └── utils/
    │   ├── dev/
    │   │   ├── linter.sh
    │   │   ├── packaging/
    │   │   ├── parse_results.sh
    │   │   ├── run_inference_tests.sh
    │   │   └── run_instant_tests.sh
    │   ├── docker/
    │   │   ├── Dockerfile
    │   │   ├── deploy.Dockerfile
    │   │   └── docker-compose.yml
    │   ├── projects/
    │   │   ├── DeepLab/
    │   │   ├── DensePose/
    │   │   ├── Panoptic-DeepLab/
    │   │   ├── PointRend/
    │   │   ├── PointSup/
    │   │   ├── Rethinking-BatchNorm/
    │   │   ├── TensorMask/
    │   │   └── TridentNet/
    │   ├── setup.py
    ├── grit/
    │   ├── config.py
    │   ├── custom_solver.py
    │   ├── evaluation/
    │   │   └── eval.py
    │   ├── modeling/
    │   │   ├── backbone/
    │   │   ├── meta_arch/
    │   │   ├── roi_heads/
    │   │   ├── soft_nms.py
    │   │   └── text/
    │   └── predictor.py
    ├── ks_demo_predictions/
    │   ├── 0046.txt
    │   ├── 0046_gpt-4_out.txt
    │   ├── 0117.txt
    │   ├── 0117_gpt-4_out.txt
    │   ├── 0158.txt
    │   ├── 0158_gpt-4_out.txt
    │   ├── 0226.txt
    │   ├── 0226_gpt-4_out.txt
    │   ├── 0309.txt
    │   ├── 0309_gpt-4_out.txt
    │   ├── 0334.txt
    │   ├── 0334_gpt-4_out.txt
    │   ├── 0422.txt
    │   ├── 0422_gpt-4_out.txt
    │   ├── 0518.txt
    │   ├── 0518_gpt-4_out.txt
    │   ├── 0623.txt
    │   ├── 0623_gpt-4_out.txt
    │   ├── 0638.txt
    │   ├── 0638_gpt-4_out.txt
    │   ├── 0803.txt
    │   ├── 0803_gpt-4_out.txt
    │   ├── 0831.txt
    │   └── 0831_gpt-4_out.txt
    ├── ks_demo_safety/
    ├── ks_demo_visualizations/
    ├── lauch_deepspeed.py
    ├── node_modules/
    │   └── yaml/
    │       ├── browser/
    │       ├── package.json
    │       └── util.js
    ├── predictions/
    │   ├── 1.txt
    │   ├── 1_gpt-4_out.txt
    │   ├── 2.txt
    │   ├── 2_gpt-4_out.txt
    │   ├── 85building.txt
    │   ├── 85building_gpt-4_out.txt
    │   ├── KS000455.txt
    │   ├── KS000455_gpt-4_out.txt
    │   ├── KS002508.txt
    │   ├── KS002508_gpt-4_out.txt
    │   ├── KS003229.txt
    │   ├── KS003229_gpt-4_out.txt
    │   ├── Kaohsiung_highschool_N.txt
    │   ├── Kaohsiung_highschool_N_gpt-4_out.txt
    │   ├── Kaohsiung_port.txt
    │   ├── Kaohsiung_port_gpt-4_out.txt
    │   ├── beef.txt
    │   ├── beef_gpt-4_out.txt
    │   ├── black_hole.txt
    │   ├── black_hole_gpt-4_out.txt
    │   ├── crowded traffic.txt
    │   ├── crowded traffic_gpt-4_out.txt
    │   ├── dock.txt
    │   ├── dock_gpt-4_out.txt
    │   ├── dog.txt
    │   ├── dog_gpt-4_out.txt
    │   ├── door.txt
    │   ├── door_gpt-4_out.txt
    │   ├── game.txt
    │   ├── game_gpt-4_out.txt
    │   ├── giant_brick.txt
    │   ├── giant_brick_gpt-4_out.txt
    │   ├── kaohsiung_engaging.txt
    │   ├── kaohsiung_engaging_gpt-4_out.txt
    │   ├── new_scence.txt
    │   ├── new_scence_gpt-4_out.txt
    │   ├── ntu_door.txt
    │   ├── ntu_door_gpt-4_out.txt
    │   ├── police car.txt
    │   ├── police car_gpt-4_out.txt
    │   ├── police car_man.txt
    │   ├── police car_man_gpt-4_out.txt
    │   ├── police.txt
    │   ├── police_gpt-4_out.txt
    │   ├── rocket.txt
    │   ├── rocket1.txt
    │   ├── rocket1_gpt-4_out.txt
    │   ├── rocket_gpt-4_out.txt
    │   ├── science_building.txt
    │   ├── science_building2.txt
    │   ├── science_building2_gpt-4_out.txt
    │   ├── science_building3.txt
    │   ├── science_building3_gpt-4_out.txt
    │   ├── science_building_gpt-4_out.txt
    │   ├── space1.txt
    │   ├── space1_gpt-4_out.txt
    │   ├── stone.txt
    │   ├── stone_gpt-4_out.txt
    │   ├── strange_window_building.txt
    │   ├── strange_window_building2.txt
    │   ├── strange_window_building2_gpt-4_out.txt
    │   ├── strange_window_building_gpt-4_out.txt
    │   ├── student.txt
    │   ├── student_gpt-4_out.txt
    │   ├── temple.txt
    │   ├── temple2.txt
    │   ├── temple2_gpt-4_out.txt
    │   ├── temple_gpt-4_out.txt
    │   ├── test.txt
    │   ├── test2.txt
    │   ├── test2_gpt-4_out.txt
    │   ├── test3.txt
    │   ├── test3_gpt-4_out.txt
    │   ├── test_gpt-4_out.txt
    │   ├── trip.txt
    │   ├── trip_gpt-4_out.txt
    │   ├── zoo.txt
    │   └── zoo_gpt-4_out.txt
    ├── requirements.txt
    ├── third_party/
    │   └── CenterNet2/
    │       ├── .circleci/
    │       ├── .clang-format
    │       ├── .github/
    │       ├── configs/
    │       ├── datasets/
    │       ├── demo/
    │       ├── detectron2/
    │       ├── dev/
    │       ├── docker/
    │       ├── projects/
    │       ├── setup.py
    ├── train_deepspeed.py
    ├── train_net.py
    ├── visualizations/
    └── 指令.txt

🚀 Getting Started

⚙️ Installation

Clone the GritAndGPT4 repository:

git clone https://github.com/kennysuper007/GritAndGPT4

Change to the project directory:

cd GritAndGPT4

Install the dependencies:

pip install -r requirements.txt

🤖 Running GritAndGPT4

Use the following command to run GritAndGPT4:

python demo.py --test-task DenseCap --config-file configs/GRiT_B_DenseCap_ObjectDet.yaml --input demo_images --output visualizations --output_preds predictions --LLM gpt-4 --opts MODEL.WEIGHTS models/grit_b_densecap_objectdet.pth

🤝 Contributing

Contributions are welcome! Here are several ways you can contribute:

Submit Pull Requests: Review open PRs, and submit your own PRs.
Join the Discussions: Share your insights, provide feedback, or ask questions.
Report Issues: Submit bugs found or log feature requests for GritAndGPT4.

Contributing Guidelines

Fork the Repository: Start by forking the project repository to your GitHub account.
Clone Locally: Clone the forked repository to your local machine using a Git client.
```
git clone <your-forked-repo-url>
```
Create a New Branch: Always work on a new branch, giving it a descriptive name.
```
git checkout -b new-feature-x
```
Make Your Changes: Develop and test your changes locally.
Commit Your Changes: Commit with a clear and concise message describing your updates.
```
git commit -m 'Implemented new feature x.'
```
Push to GitHub: Push the changes to your forked repository.
```
git push origin new-feature-x
```
Submit a Pull Request: Create a PR against the original project repository. Clearly describe the changes and their motivations.

Once your PR is reviewed and approved, it will be merged into the main branch.

📄 License

This project is protected under the MIT License. For more details, refer to the LICENSE file.

👏 Acknowledgments

I modified the GPT-4 prompt to improve the quality and safety of the suggestions based on Kinan's code.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Repository files navigation

GRITANDGPT4

◦ Power up your AI with GritAndGPT4!

◦ Developed with the software and tools below.

🔗 Quick Links

📍 Overview

📂 Repository Structure

🚀 Getting Started

⚙️ Installation

🤖 Running GritAndGPT4

🤝 Contributing

📄 License

👏 Acknowledgments

About

Uh oh!

Releases

Packages

Uh oh!

Languages

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
configs		configs
datasets		datasets
demo_images		demo_images
detectron2		detectron2
docs		docs
grit		grit
ks_demo_predictions		ks_demo_predictions
ks_demo_safety		ks_demo_safety
ks_demo_visualizations		ks_demo_visualizations
node_modules/yaml		node_modules/yaml
predictions		predictions
third_party/CenterNet2		third_party/CenterNet2
visualizations		visualizations
.DS_Store		.DS_Store
.gitignore		.gitignore
.gitmodules		.gitmodules
LICENSE		LICENSE
LICENSE 2		LICENSE 2
README.md		README.md
demo.py		demo.py
lauch_deepspeed.py		lauch_deepspeed.py
requirements.txt		requirements.txt
train_deepspeed.py		train_deepspeed.py
train_net.py		train_net.py
指令.txt		指令.txt

License

ShangChienLiu/GritAndGPT4

Folders and files

Latest commit

History

Repository files navigation

GRITANDGPT4

◦ Power up your AI with GritAndGPT4!

◦ Developed with the software and tools below.

🔗 Quick Links

📍 Overview

📂 Repository Structure

🚀 Getting Started

⚙️ Installation

🤖 Running GritAndGPT4

🤝 Contributing

📄 License

👏 Acknowledgments

About

Resources

License

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Uh oh!

Languages

Packages