_sliding_window_pattern

#6
by janimo - opened

Hello. Why the underscore at the beginning of this config setting, making it inconsistent with the previous Gemma 3 model config.json files?
Is it being deprecated and is the layer_types field to be used instead?

Google org

Layer_type is the new way to go about it yes!

This comment has been hidden (marked as Off-Topic)
Google org

Hi ,

Thanks for your question! The underscore prefix in config settings often indicates an internal or private attribute intended to avoid conflicts or signal that it’s not part of the public API. This can happen when evolving model configs for better modularity or backward compatibility.

Regarding the google/gemma-3-270m model, it’s possible that this underscore-prefixed setting reflects an internal refactor or interim step as the config format evolves. The layer_types field you mentioned is indeed part of the newer config conventions and might be the preferred way going forward.

For information kindly refer this model’s documentation.

Thank you.

Sign up or log in to comment