chatbit-api / DEPLOY.md
Seounghyup's picture
ChatBIA API Server for Hugging Face Spaces
8a1a81a

Hugging Face Spaces ๋ฐฐํฌ ๊ฐ€์ด๋“œ

1๋‹จ๊ณ„: Hugging Face ๊ณ„์ • ์ƒ์„ฑ

  1. https://huggingface.co/ ์ ‘์†
  2. ํšŒ์›๊ฐ€์ž… (GitHub ๊ณ„์ •์œผ๋กœ ๊ฐ€๋Šฅ)
  3. ๋ฌด๋ฃŒ ๊ณ„์ •์œผ๋กœ ์ถฉ๋ถ„!

2๋‹จ๊ณ„: Space ์ƒ์„ฑ

  1. https://huggingface.co/new-space
  2. ์„ค์ •:
    • Space name: chatbia-api (์›ํ•˜๋Š” ์ด๋ฆ„)
    • License: MIT
    • Space SDK: Docker
    • Space hardware: CPU basic (๋ฌด๋ฃŒ)
    • Visibility: Public

3๋‹จ๊ณ„: Git ์„ค์ •

๋กœ์ปฌ์—์„œ Git ์ดˆ๊ธฐํ™”

cd ChatBIA-Server

# Git ์ดˆ๊ธฐํ™”
git init
git lfs install
git lfs track "*.gguf"

# Hugging Face ๋ฆฌ๋ชจํŠธ ์ถ”๊ฐ€
git remote add origin https://huggingface.co/spaces/YOUR-USERNAME/chatbia-api

# ํŒŒ์ผ ์ถ”๊ฐ€
git add .
git commit -m "Initial commit"

4๋‹จ๊ณ„: ๋ชจ๋ธ ํŒŒ์ผ ์ถ”๊ฐ€

์ค‘์š”: ๋ชจ๋ธ ํŒŒ์ผ์€ Git LFS๋กœ ์—…๋กœ๋“œํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค!

# models ํด๋”์— GGUF ํŒŒ์ผ ๋ณต์‚ฌ
cp ../ChatBIA-Windows/models/*.gguf .

# Git LFS๋กœ ์ถ”๊ฐ€
git add Qwen2.5-3B-Instruct-Q4_K_M.gguf
git add ChatBIA-3B-v0.1-Q4_K_M.gguf

git commit -m "Add model files"

5๋‹จ๊ณ„: Push

# Hugging Face ํ† ํฐ ์„ค์ • (์ตœ์ดˆ 1ํšŒ)
# https://huggingface.co/settings/tokens ์—์„œ ํ† ํฐ ์ƒ์„ฑ

git push origin main

์ฐธ๊ณ : ๋ชจ๋ธ ํŒŒ์ผ์ด ํฌ๋ฏ€๋กœ ์—…๋กœ๋“œ์— ์‹œ๊ฐ„์ด ๊ฑธ๋ฆฝ๋‹ˆ๋‹ค (~10-20๋ถ„)

6๋‹จ๊ณ„: ๋ฐฐํฌ ํ™•์ธ

  1. Space ํŽ˜์ด์ง€์—์„œ "Building" ์ƒํƒœ ํ™•์ธ
  2. ๋นŒ๋“œ ์™„๋ฃŒ ํ›„ "Running" ์ƒํƒœ ํ™•์ธ
  3. API ํ…Œ์ŠคํŠธ:
curl https://YOUR-USERNAME-chatbia-api.hf.space/

7๋‹จ๊ณ„: API URL ํ™•์ธ

๋ฐฐํฌ ์™„๋ฃŒ ํ›„ Space URL:

https://YOUR-USERNAME-chatbia-api.hf.space

์ด URL์„ ์•ˆ๋“œ๋กœ์ด๋“œ ์•ฑ์—์„œ ์‚ฌ์šฉํ•˜๋ฉด ๋ฉ๋‹ˆ๋‹ค!

๋ฌธ์ œ ํ•ด๊ฒฐ

๋นŒ๋“œ ์‹คํŒจ

  • Logs ํƒญ์—์„œ ์—๋Ÿฌ ํ™•์ธ
  • ์ฃผ๋กœ requirements.txt ๋ฌธ์ œ

๋ชจ๋ธ ๋กœ๋“œ ์‹คํŒจ

  • Git LFS๊ฐ€ ์ œ๋Œ€๋กœ ์„ค์ •๋˜์—ˆ๋Š”์ง€ ํ™•์ธ
  • ๋ชจ๋ธ ํŒŒ์ผ์ด ์ •์ƒ์ ์œผ๋กœ ์—…๋กœ๋“œ๋˜์—ˆ๋Š”์ง€ ํ™•์ธ

๋А๋ฆฐ ์‘๋‹ต

  • CPU basic์€ ๋ฌด๋ฃŒ์ง€๋งŒ ๋А๋ฆฝ๋‹ˆ๋‹ค
  • ์œ ๋ฃŒ GPU๋กœ ์—…๊ทธ๋ ˆ์ด๋“œ ๊ฐ€๋Šฅ (~$0.60/hour)

๋Œ€์•ˆ: ๋กœ์ปฌ ํ…Œ์ŠคํŠธ ๋จผ์ €

# Docker๋กœ ๋กœ์ปฌ ํ…Œ์ŠคํŠธ
docker build -t chatbia-api .
docker run -p 7860:7860 chatbia-api

# ํ…Œ์ŠคํŠธ
curl http://localhost:7860/

๋น„์šฉ

  • CPU basic: ๋ฌด๋ฃŒ โœ…
  • CPU upgrade: $0.03/hour
  • GPU T4: $0.60/hour
  • GPU A10G: $3.15/hour

๋ฌด๋ฃŒ CPU๋กœ ์‹œ์ž‘ํ•˜์„ธ์š”!