Commit
·
d559c9e
1
Parent(s):
a603ea7
Update ReadMe
Browse files
README.md
CHANGED
|
@@ -73,7 +73,7 @@ model = BACKBONE_REGISTRY.build(
|
|
| 73 |
)
|
| 74 |
```
|
| 75 |
|
| 76 |
-
The model supports the following raw inputs which you can specify in modalities
|
| 77 |
If your data does not use all bands of a modality, you can specify a subset with `bands={'S2L2A': ['BLUE', 'GREEN', 'RED', 'NIR_NARROW', 'SWIR_1', 'SWIR_2']}`.
|
| 78 |
You can pass the inputs as in a dict to the model. If a tensor is directly passed, the model assumes it is the first defined modality.
|
| 79 |
TerraMind can also handle missing input modalities.
|
|
@@ -131,12 +131,13 @@ model = FULL_MODEL_REGISTRY.build(
|
|
| 131 |
modalities=['S2L2A'],
|
| 132 |
output_modalities=['S1GRD', 'LULC'],
|
| 133 |
timesteps=10, # Define diffusion steps
|
| 134 |
-
standardize=True, #
|
| 135 |
)
|
| 136 |
```
|
| 137 |
-
Like the backbone, pass multiple modalities as a dict or a single modality as a tensor to the model which returns generated
|
| 138 |
Note: These generations are not reconstructions but "mental images" representing how the model imagines the modality.
|
| 139 |
You can control generation details via the number of diffusion steps (`timesteps`) that you can pass to the constructor or the forward function.
|
|
|
|
| 140 |
|
| 141 |
We provide an example notebook for generations at https://github.com/IBM/terramind.
|
| 142 |
|
|
|
|
| 73 |
)
|
| 74 |
```
|
| 75 |
|
| 76 |
+
The model supports the following raw inputs which you can specify in `modalities`: S2L2A, S2L1C, S1GRD, S1RTC, DEM, RGB.
|
| 77 |
If your data does not use all bands of a modality, you can specify a subset with `bands={'S2L2A': ['BLUE', 'GREEN', 'RED', 'NIR_NARROW', 'SWIR_1', 'SWIR_2']}`.
|
| 78 |
You can pass the inputs as in a dict to the model. If a tensor is directly passed, the model assumes it is the first defined modality.
|
| 79 |
TerraMind can also handle missing input modalities.
|
|
|
|
| 131 |
modalities=['S2L2A'],
|
| 132 |
output_modalities=['S1GRD', 'LULC'],
|
| 133 |
timesteps=10, # Define diffusion steps
|
| 134 |
+
standardize=True, # Apply standardization
|
| 135 |
)
|
| 136 |
```
|
| 137 |
+
Like the backbone, pass multiple modalities as a dict or a single modality as a tensor to the model which returns the generated `output_modalities` as a dict of tensors.
|
| 138 |
Note: These generations are not reconstructions but "mental images" representing how the model imagines the modality.
|
| 139 |
You can control generation details via the number of diffusion steps (`timesteps`) that you can pass to the constructor or the forward function.
|
| 140 |
+
By passing `standardize=True`, the pre-training standardization values are automatically applied to the input and output.
|
| 141 |
|
| 142 |
We provide an example notebook for generations at https://github.com/IBM/terramind.
|
| 143 |
|