From 1cb498a7f140803f69e760f50760dd0489f3d9d9 Mon Sep 17 00:00:00 2001 From: tiankeyu Date: Wed, 11 Jan 2023 11:07:29 +0800 Subject: [PATCH] [upd] readmes --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index b018325..4451759 100644 --- a/README.md +++ b/README.md @@ -1,4 +1,4 @@ -## SparK✨: the first successful BERT-style pre-training on any convolutional nets [![arXiv](https://img.shields.io/badge/arXiv-2301.03580-b31b1b.svg)](https://arxiv.org/abs/2301.03580) +# SparK✨: the first successful BERT-style pre-training on any convolutional nets [![arXiv](https://img.shields.io/badge/arXiv-2301.03580-b31b1b.svg)](https://arxiv.org/abs/2301.03580) This is an official implementation of the paper "Designing BERT for Convolutional Networks: ***Spar***se and Hierarchical Mas***k***ed Modeling". @@ -55,7 +55,7 @@ This is an official implementation of the paper "Designing BERT for Convolutiona ## Install -Check [INSTALL.md](INSTALL.md) to prepare dependencies. Our implementation is based on `torch==1.10.0+cu113`, `torchvision==0.11.1+cu113`, and `timm==0.5.4`. [This](https://github.com/facebookresearch/SparseConvNet) sparse convolution framework is an optional library. +Check [INSTALL.md](INSTALL.md) to install all dependencies. Our implementation is based on `torch==1.10.0+cu113`, `torchvision==0.11.1+cu113`, and `timm==0.5.4`. [This](https://github.com/facebookresearch/SparseConvNet) sparse convolution framework is an optional library. ## Pre-training