Update README.md
Browse files
README.md
CHANGED
@@ -8,12 +8,16 @@ library_name: timm
|
|
8 |
|
9 |
# Model Card for Model ID
|
10 |
|
11 |
-
Based on **quasi-linear hyperbolic systems of PDEs** [
|
12 |
|
13 |
-
*This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).*
|
14 |
|
15 |

|
16 |
|
|
|
|
|
|
|
|
|
|
|
17 |
## Model Details
|
18 |
|
19 |
### Model Description
|
|
|
8 |
|
9 |
# Model Card for Model ID
|
10 |
|
11 |
+
Based on **quasi-linear hyperbolic systems of PDEs** [[Liu et al, 2023](https://github.com/liuyao12/ConvNets-PDE-perspective)], the QLNet enters an uncharted water of ConvNet model space marked by the use of (element-wise) multiplication instead of ReLU as the primary nonlinearity. It achieves comparable performance as ResNet50 on ImageNet-1k (acc=78.4), demonstrating that its capacity/expressivity, and deserves more study (hyper-paremeter tuning, optimizer, etc.) by the community.
|
12 |
|
|
|
13 |
|
14 |

|
15 |
|
16 |
+
One notable feature of the architecture is the absence of ReLU or other element-wise activation functions, which enables the model to admit a *continuous* symmetry in its parameters. Check out the [notebook](https://colab.research.google.com/#fileId=https://huggingface.co/liuyao/QLNet/blob/main/QLNet_symmetry.ipynb) for a demonstration that transforms the weights while leaving the output unchanged.
|
17 |
+
|
18 |
+
*This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).*
|
19 |
+
|
20 |
+
|
21 |
## Model Details
|
22 |
|
23 |
### Model Description
|