Spaces:
Runtime error
Runtime error
Commit
·
4ad10fb
1
Parent(s):
4e05835
Update app.py
Browse files
app.py
CHANGED
|
@@ -329,11 +329,10 @@ ONLY WORKS WITH GPU!
|
|
| 329 |
You can load the model with 8-bit or 4-bit quantization to make it fit in smaller hardwares. Setting the environment variable `bits` to control the quantization.
|
| 330 |
|
| 331 |
Recommended configurations:
|
| 332 |
-
| Hardware
|
| 333 |
-
|
| 334 |
-
|
|
| 335 |
-
|
| 336 |
-
| A100-Large (40G) | 16 |
|
| 337 |
"""
|
| 338 |
|
| 339 |
tos_markdown = """
|
|
|
|
| 329 |
You can load the model with 8-bit or 4-bit quantization to make it fit in smaller hardwares. Setting the environment variable `bits` to control the quantization.
|
| 330 |
|
| 331 |
Recommended configurations:
|
| 332 |
+
| Hardware | A10G-Large (24G) | T4-Medium (15G) | A100-Large (40G) |
|
| 333 |
+
|-------------------|------------------|-----------------|------------------|
|
| 334 |
+
| **Bits** | 8 (default) | 4 | 16 |
|
| 335 |
+
|
|
|
|
| 336 |
"""
|
| 337 |
|
| 338 |
tos_markdown = """
|