Update README.md
Browse files
README.md
CHANGED
|
@@ -1,12 +1,33 @@
|
|
| 1 |
---
|
| 2 |
license: bsd-3-clause
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
- model_hub_mixin
|
| 6 |
-
- pytorch_model_hub_mixin
|
| 7 |
---
|
| 8 |
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
- Paper:
|
| 12 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: bsd-3-clause
|
| 3 |
+
language:
|
| 4 |
+
- en
|
|
|
|
|
|
|
| 5 |
---
|
| 6 |
|
| 7 |
+
# MEMFOF-Tartan-T-TSKH-spring
|
| 8 |
+
|
| 9 |
+
<a href="" style="text-decoration: none;">π Paper</a> | <a href="https://msu-video-group.github.io/memfof" style="text-decoration: none;">π Project Page</a> | <a href="https://github.com/msu-video-group/memfof" style="text-decoration: none;">π» Code</a> | <a href="https://colab.research.google.com/github/msu-video-group/memfof/blob/dev/demo.ipynb" style="text-decoration: none;">π Colab</a> | <a href="https://huggingface.co/spaces/egorchistov/MEMFOF" style="text-decoration: none;">π€ Demo</a>
|
| 10 |
+
|
| 11 |
+
π This is a MEMFOF checkpoint trained **from MEMFOF-Tartan-T-TSKH** checkpoint on the **Spring** dataset.
|
| 12 |
+
|
| 13 |
+
β
**Note:** This model is intended for submission to **Spring benchmark**.
|
| 14 |
+
|
| 15 |
+
## π οΈ Usage
|
| 16 |
+
|
| 17 |
+
```shell
|
| 18 |
+
git clone https://github.com/msu-video-group/memfof.git
|
| 19 |
+
cd memfof
|
| 20 |
+
pip3 install -r requirements.txt
|
| 21 |
+
```
|
| 22 |
+
|
| 23 |
+
```python
|
| 24 |
+
import torch
|
| 25 |
+
from core.memfof import MEMFOF
|
| 26 |
+
|
| 27 |
+
device = "cuda" if torch.cuda.is_available() else "cpu"
|
| 28 |
+
model = MEMFOF.from_pretrained("egorchistov/MEMFOF-Tartan-T-TSKH-spring").eval().to(device)
|
| 29 |
+
|
| 30 |
+
with torch.inference_mode():
|
| 31 |
+
example_input = torch.randint(0, 256, [1, 3, 3, 1080, 1920], device=device) # [B=1, T=3, C=3, H=1080, W=1920]
|
| 32 |
+
backward_flow, forward_flow = model(example_input).unbind(dim=1) # [B=1, C=2, H=1080, W=1920]
|
| 33 |
+
```
|