commit ab07054eb79562260dcb2c07a174693e26de69ef Author: Shilong Liu Date: Fri Mar 10 15:26:21 2023 +0800 init diff --git a/.asset/arch.png b/.asset/arch.png new file mode 100644 index 0000000..30b23f8 Binary files /dev/null and b/.asset/arch.png differ diff --git a/.asset/hero_figure.png b/.asset/hero_figure.png new file mode 100644 index 0000000..14dae60 Binary files /dev/null and b/.asset/hero_figure.png differ diff --git a/README.md b/README.md new file mode 100644 index 0000000..e61ca94 --- /dev/null +++ b/README.md @@ -0,0 +1,43 @@ +# Grounding DINO +[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/grounding-dino-marrying-dino-with-grounded/zero-shot-object-detection-on-mscoco)](https://paperswithcode.com/sota/zero-shot-object-detection-on-mscoco?p=grounding-dino-marrying-dino-with-grounded) \ +[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/grounding-dino-marrying-dino-with-grounded/zero-shot-object-detection-on-odinw)](https://paperswithcode.com/sota/zero-shot-object-detection-on-odinw?p=grounding-dino-marrying-dino-with-grounded) \ +[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/grounding-dino-marrying-dino-with-grounded/object-detection-on-coco-minival)](https://paperswithcode.com/sota/object-detection-on-coco-minival?p=grounding-dino-marrying-dino-with-grounded) \ +[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/grounding-dino-marrying-dino-with-grounded/object-detection-on-coco)](https://paperswithcode.com/sota/object-detection-on-coco?p=grounding-dino-marrying-dino-with-grounded) + + +Official pytorch implementation of [Grounding DINO](https://arxiv.org/abs/2303.05499). Code will be available soon! + +## Highlight +- SOTA Closed-Set Detection Model [DINO](https://github.com/IDEA-Research/DINO) => SOTA Open-Set Detection Model **Grounding DINO** +- Pure Transformer-based. +- COCO zero-shot **52.5 AP** (training without COCO data!). COCO fine-tune **63.0 AP**. + +![hero_figure](.asset\hero_figure.png) + + +## Model + +Includes: a text backbone, an image backbone, a feature enhancer, a language-guided query selection, and a cross-modality decoder. + +![arch](.asset\arch.png) + + +# Links +Our model is related to [DINO](https://github.com/IDEA-Research/DINO) and [GLIP](https://github.com/microsoft/GLIP). Thanks for their great work! + +We also thank great previous work including DETR, Deformable DETR, SMCA, Conditional DETR, Anchor DETR, Dynamic DETR, DAB-DETR, DN-DETR, etc. More related work are available at [Awesome Detection Transformer](https://github.com/IDEACVR/awesome-detection-transformer). A new toolbox [detrex](https://github.com/IDEA-Research/detrex) is available as well. + + +# Bibtex +If you find our work helpful for your research, please consider citing the following BibTeX entry. +```bibtex +@inproceedings{ShilongLiu2023GroundingDM, + title={Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection}, + author={Shilong Liu and Zhaoyang Zeng and Tianhe Ren and Feng Li and Hao Zhang and Jie Yang and Chunyuan Li and Jianwei Yang and Hang Su and Jun Zhu and Lei Zhang}, + year={2023} +} +``` + + + +