thumbs/links

README.md

@@ -19,12 +19,12 @@ tags:
 ---
 
 
-# Affective TTS / SoundScape
+# Affective TTS / SoundScapes
 
-  - [SHIFT TTS tool](https://github.com/audeering/shift) with [Affective voices](https://audeering.github.io/shift/)
+  - [SHIFT TTS tool](https://github.com/audeering/shift) 
   - Analysis of emotionality [#1](https://huggingface.co/dkounadis/artificial-styletts2/discussions/2)
   - Soundscape `e.g. trees, water, hills,`, generation via [AudioGen](https://huggingface.co/dkounadis/artificial-styletts2/discussions/3)
-  - `landscape2soundscape.py` shows how to overlay TTS & Soundscape to Images and create videos
+  - `landscape2soundscape.py` shows how to overlay TTS & sound to image and create video
 
 ## Available Voices
 
@@ -32,8 +32,6 @@ tags:
 
 ## API
 
-Install
-
 ```
 virtualenv --python=python3 ~/.envs/.my_env
 source ~/.envs/.my_env/bin/activate
@@ -47,34 +45,7 @@ Flask
 CUDA_DEVICE_ORDER=PCI_BUS_ID HF_HOME=./hf_home CUDA_VISIBLE_DEVICES=2 python api.py
 ```
 
-The following need `api.py` to be running on a `tmux session`. 
-
-## Text 2 Speech
-
-```python
-# Basic TTS - See Available Voices
-python tts.py --text sample.txt --voice "en_US/m-ailabs_low#mary_ann" --affective
-
-# voice cloning
-python tts.py --text sample.txt --native assets/native_voice.wav
-```
-
-## Image 2 Video
-
-```python
-# Make video narrating an image - All above TTS args apply also here!
-python tts.py --text sample.txt --image assets/image_from_T31.jpg
-```
-
-## Video 2 Video
-
-```python
-# Video Dubbing - from time-stamped subtitles (.srt)
-python tts.py --text assets/head_of_fortuna_en.srt --video assets/head_of_fortuna.mp4
-
-# Video narration - from text description (.txt)
-python tts.py --text assets/head_of_fortuna_GPT.txt --video assets/head_of_fortuna.mp4
-```
+The following need `api.py` to be already running `on a tmux session`. 
 
 ## Landscape 2 Soundscape
 
@@ -83,7 +54,7 @@ python tts.py --text assets/head_of_fortuna_GPT.txt --video assets/head_of_fortu
 python landscape2soundscape.py
 ```
 
-# Examples
+# YouTube Videos / Examples
 
 Substitute Native voice via TTS
 
@@ -132,9 +103,9 @@ python tts.py --text sample.txt --image assets/image_from_T31.jpg
 ```
 
 ## Landscape 2 Soundscape
-  - YouTube Videos
+  - YouTube Videos For SHIFT demo / Collaboration with [SMB](https://www.smb.museum/home/)
+
 
-[![01schic](uc_spk_Landscape2Soundscape_Masterpieces_pics/01_Schick_AII840_001.jpg)](https://www.youtube.com/watch?v=FCYS29OrA1s)
 
 
 
@@ -143,6 +114,10 @@ python tts.py --text sample.txt --image assets/image_from_T31.jpg
 python landscape2soundscape.py
 ```
 
+[![01](uc_spk_Landscape2Soundscape_Masterpieces_pics/thumb____01_Schick_AII840_001.jpg)](https://youtu.be/SSi3gUO4GtY)
+
+[![02](uc_spk_Landscape2Soundscape_Masterpieces_pics/thumb____02_Constable_AI555_001.jpg)(https://youtu.be/2YjxAPkdXIc)
+
 
 # Live Demo - Paplay
 

landscape2soundscape.py

@@ -110,7 +110,7 @@ DESCRIPTIONS = [
         '09_Blechen_AII823_001.jpg',
         '09_Blechen_AII823_001.txt',
         'Cascade in Africa',
-        'C. Blechen, Wasserfälle Bei Tivoli, 1832',
+        'C. Blechen, Wasserfalle Bei Tivoli, 1832',
         'en_US/m-ailabs_low#mary_ann',
     ],
     # 10
@@ -118,7 +118,7 @@ DESCRIPTIONS = [
         '10_Boecklin_967648_NG2-80_001_rsz.jpg',
         '10_Boecklin_967648_NG2-80_001.txt',
         'Hades ades at it sisland',
-        'A. Böcklin, Toteninsel, 1883',
+        'A. Bocklin, Toteninsel, 1883',
         'en_US/cmu-arctic_low#jmk',
     ],
     # 11
@@ -175,6 +175,8 @@ for img, text, scene, title, voice in DESCRIPTIONS[:20]:
     im[offset_h:h+offset_h, :w, :] = (.4 * im[offset_h:h+offset_h, :w, :] + .6 * fram).astype(np.uint8)    
 
     cv2.imwrite('_tmp_banner.png', im)
+    print('save 2nd',PIC_DIR + 'thumb____' + img)
+    cv2.imwrite(PIC_DIR + 'thumb____' + img, cv2.resize(im, (im.shape[1]//4, im.shape[0]//4)))
     OUT_FILE = img.split('/')[-1].replace('.','__') + '.mp4'  # assets / -1
     print(f'{OUT_FILE=}\n')
     subprocess.run(