BounharAbdelaziz
/

Al-Atlas-LLM-1.7B

Text Generation

Generated from Trainer

text-generation-inference

Model card Files Files and versions

Metrics Training metrics Community

You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

Al-Atlas-LLM-Large

This model is a fine-tuned version of HuggingFaceTB/SmolLM2-1.7B on an unknown dataset.

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.005
train_batch_size: 16
eval_batch_size: 8
seed: 42
optimizer: Use OptimizerNames.PAGED_ADAMW with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: cosine
lr_scheduler_warmup_ratio: 0.03
num_epochs: 1

Training results

Framework versions

Transformers 4.46.3
Pytorch 2.5.1+cu124
Datasets 3.1.0
Tokenizers 0.20.3

Downloads last month: -

Safetensors

Model size

2B params

Tensor type

F16

·

Model tree for BounharAbdelaziz/Al-Atlas-LLM-1.7B

Base model

HuggingFaceTB/SmolLM2-1.7B

Finetuned

(42)

this model

Quantizations

1 model

Dataset used to train BounharAbdelaziz/Al-Atlas-LLM-1.7B

Collection including BounharAbdelaziz/Al-Atlas-LLM-1.7B

Moroccan Darija LLMs

Language Models that speaks Moroccan darija (ary) • 9 items • Updated Feb 20 • 4

Evaluation results

Metadata error: specify a dataset to view leaderboard