Alignment Studio: Aligning Large Language Models to Particular
  Contextual Regulations
The alignment of large language models is usually done by model providers to
add or control behaviors that are common or universally understood across use
cases and contexts. In contrast, in this article, we present an approach and
architecture that empowers application developers to tune a model to their
particular values, social norms, laws and other regulations, and orchestrate
between potentially conflicting requirements in context. We lay out three main
components of such an Alignment Studio architecture: Framers, Instructors, and
Auditors that work in concert to control the behavior of a language model. We
illustrate this approach with a running example of aligning a company's
internal-facing enterprise chatbot to its business conduct guidelines.
65f7a455fdb0e12d2c46dc43
Swapnaja Achintalwar
65f7a455fdb0e12d2c46dc44
Ioana Baldini
65f7a455fdb0e12d2c46dc45
Djallel Bouneffouf
65f7a455fdb0e12d2c46dc46
Joan Byamugisha
65f7a455fdb0e12d2c46dc47
Maria Chang
admin_assigned
2024-03-18T09:03:07.845Z
64f0f28739b002de8707edb4
/avatars/9bfe37cbaa7671cad5dca92a581857b0.svg
Maria Chang
user
maria-chang
65f7a455fdb0e12d2c46dc48
Pierre Dognin
65f7a455fdb0e12d2c46dc49
Eitan Farchi
65f7a455fdb0e12d2c46dc4a
Ndivhuwo Makondo
admin_assigned
2024-03-18T09:03:22.290Z
6478fa2e50ff700163177a63
/avatars/bdc86d5faea1d3088171cef52cbaf96c.svg
Ndivhuwo Makondo
user
Ndivhuwo
65f7a455fdb0e12d2c46dc4b
Aleksandra Mojsilovic
65f7a455fdb0e12d2c46dc4c
Manish Nagireddy
admin_assigned
2024-03-18T09:03:32.116Z
659ed39fd75c46188d7496ff
/avatars/665e4dd171f7e8c1c483cdeb02b71744.svg
Manish Nagireddy
user
mnagired
65f7a455fdb0e12d2c46dc4d
Karthikeyan Natesan Ramamurthy
admin_assigned
2024-03-18T09:03:39.304Z
65d77d5439352e8c0b45b06a
/avatars/b2eae578ea01c37d590036b23f79c8bf.svg
Karthikeyan Natesan Ramamurthy
user
nrkarthikeyan
65f7a455fdb0e12d2c46dc4e
Inkit Padhi
claimed_verified
2024-10-09T07:38:42.947Z
656d56f30a5ec499aa0f57b1
https://cdn-avatars.huggingface.co/v1/production/uploads/656d56f30a5ec499aa0f57b1/YdXgxiwpJ0-xdn0UvOjj4.jpeg
Inkit
user
ink-pad
65f7a455fdb0e12d2c46dc4f
Orna Raz
65f7a455fdb0e12d2c46dc50
Jesus Rios
claimed_verified
2024-03-19T08:46:08.822Z
644c226a778ecbfb977ff98f
/avatars/1aabf342a6137a56986cac717aa3bc87.svg
Jesus Rios
user
jesusriosal
65f7a455fdb0e12d2c46dc51
Prasanna Sattigeri
admin_assigned
2024-03-18T09:03:56.432Z
63068ec0df993a789e69644b
https://cdn-avatars.huggingface.co/v1/production/uploads/63068ec0df993a789e69644b/hR4Qs1KFMpF7sW6VzXYH1.png
Prasanna Sattigeri
user
pronics2004
65f7a455fdb0e12d2c46dc52
Moninder Singh
admin_assigned
2024-03-18T09:04:03.195Z
6328dbe8b109150305e5683c
/avatars/9b760fdd2104a7c9c558ee6f64730a87.svg
Moninder Singh
user
moninder
65f7a455fdb0e12d2c46dc53
Siphiwe Thwala
65f7a455fdb0e12d2c46dc54
Rosario A. Uceda-Sosa
65f7a455fdb0e12d2c46dc55
Kush R. Varshney
admin_assigned
2024-03-18T09:04:18.499Z
648b118c60292bdb12e402f6
/avatars/8cc8a06447c871bae4405c837ba0661e.svg
Kush Varshney
user
kushvarshney
Alignment Studio: Aligning Large Language Models to Particular
  Contextual Regulations
The alignment of large language models is usually done by model providers to
add or control behaviors that are common or universally understood across use
cases and contexts. In contrast, in this article, we present an approach and
architecture that empowers application developers to tune a model to their
particular values, social norms, laws and other regulations, and orchestrate
between potentially conflicting requirements in context. We lay out three main
components of such an Alignment Studio architecture: Framers, Instructors, and
Auditors that work in concert to control the behavior of a language model. We
illustrate this approach with a running example of aligning a company's
internal-facing enterprise chatbot to its business conduct guidelines.
An Alignment Studio architecture empowers developers to tailor language models to specific values, social norms, laws, and guidelines by integrating Framers, Instructors, and Auditors.
Alignment Studio Framers Instructors Auditors language models business conduct guidelines