Model card: Difference between revisions

From CTPwiki

No edit summary
No edit summary
 
(2 intermediate revisions by the same user not shown)
Line 1: Line 1:
As models begin to pile up in open repositories like Hugging Face, model cards have emerged as a privileged means to document them. Think about model cards as nutrition labels for models. Ideally, they list the model's ingredients, how it was trained and its validation procedures as well as its intended use and limitations. Whilst the repositories cannot force their use upon the users, they automatically create an empty model card when a new models is uploaded in an effort to encourage standardization and transparency. However, if one examines how model cards are redacted, one can see that their content can vary a lot. Sometimes they thoroughly document the model, with a reference to an academic paper, sometimes they offer only minimal information or are simply empty. In that, model cards testify to the diverse nature of model providers. Some are working in computer science labs or in companies, others are amateurs with sometimes little time left for the tedious work of documentation or simply no desire to share widely their production. Finally, an empty model cards doesn't necessarily mean absence of documentation. Users may find more appealing to document them in another form. In CivitAI, a platform where Manga fans share their models and LoRAs, each model is introduced with a succinct description written in a more affective tone where the author explains their goal, cracks a joke, begs for a tip on their Patreon and thanks their network of collaborators as well as the models and resources they are building on.
== Model card ==
 
As models begin to pile up in open repositories like [[Hugging Face]], [https://arxiv.org/abs/2402.05160 model cards] have emerged as a privileged means to document them. Think about model cards as nutrition labels for models. Ideally, they list the model's ingredients, how it was trained and its validation procedures as well as its intended use and limitations. Whilst the repositories cannot force their use upon the users, they automatically create an empty model card when a new models is uploaded in an effort to encourage standardization and transparency. However, if one examines how model cards are redacted, one can see that their content can vary a lot. Sometimes they thoroughly document the model, with a reference to an academic paper, sometimes they offer only minimal information or are simply empty. In that, model cards testify to the diverse nature of model providers. Some are working in computer science labs or in companies, others are amateurs with sometimes little time left for the tedious work of documentation or simply no desire to share widely their production. Finally, an empty model cards doesn't necessarily mean absence of documentation. Users may find more appealing to document them in another form. In [[CivitAI]], a platform where Manga fans share their models and LoRAs, each model is introduced with a succinct description written in a more affective tone where the author explains their goal, cracks a joke, begs for a tip on their Patreon and thanks their network of collaborators as well as the models and resources they are building on.
 
From [https://arxiv.org/abs/2402.05160 What's documented in AI? Systematic Analysis of 32K AI Model Cards]:
 
  Model cards have emerged as the standard approach to document AI models, inspired by the concept of food nutrition labels and datasheets in the electronics industry. They are documents that provide essential information about a model in a standardized, easy-to-understand format. At the core of these cards are sections detailing model training and validation procedures, intended uses and potential limitations such as bias and fairness analysis, and usage guidance. Compared to other documentation formats such as academic papers or technical reports, model cards are increasingly becoming a preferred reference for practitioners in the AI community for a number of reasons. First, they offer more concise, relevant, and easily understandable information about AI models, rendering them more accessible. Another important aspect of model cards is their up-to-date nature, as they can be frequently updated to reflect any changes, improvements, or new findings about the AI model.
  In contrast, academic papers, once published, may not be updated as regularly, which could result in outdated information. Additionally, many popular model repositories, especially those originating from industry or open-source enthusiasts, don’t have accompanying academic papers or technical reports. This further accentuates the indispensable role of model cards as a comprehensive, streamlined, and informative communication mechanism within the AI ecosystem.


== Examples ==
== Examples ==
Line 13: Line 8:
[[File:Screenshot 2025-05-23 at 12-36-34 dnad244 wan random loras · Hugging Face.png|thumb|left|alt=An empty model card|An empty model card]]
[[File:Screenshot 2025-05-23 at 12-36-34 dnad244 wan random loras · Hugging Face.png|thumb|left|alt=An empty model card|An empty model card]]
<div style="clear:both;"></div>
<div style="clear:both;"></div>
== What is the network that sustains this object? ==
* How does it move from person to person, person to software, to platform, what things are attached to it (visual culture)
* Networks of attachments
* How does it relate / sustain a collective? (human + non-human)
== How does it evolve through time? ==
   
Evolution of the interface for these objects. Early chatgpt offered two parameters through the API: prompt and temperature. Today extremely complex object with all kinds of components and parameters. Visually what is the difference? Richness of the interface in decentralization (the more options, the better...)
== How does it create value? Or decrease / affect value? ==
== What is its place/role in techno cultural strategies? ==
== How does it relate to autonomous infrastructure? ==


== Resources ==
== Resources ==

Latest revision as of 19:53, 19 August 2025

Model card

As models begin to pile up in open repositories like Hugging Face, model cards have emerged as a privileged means to document them. Think about model cards as nutrition labels for models. Ideally, they list the model's ingredients, how it was trained and its validation procedures as well as its intended use and limitations. Whilst the repositories cannot force their use upon the users, they automatically create an empty model card when a new models is uploaded in an effort to encourage standardization and transparency. However, if one examines how model cards are redacted, one can see that their content can vary a lot. Sometimes they thoroughly document the model, with a reference to an academic paper, sometimes they offer only minimal information or are simply empty. In that, model cards testify to the diverse nature of model providers. Some are working in computer science labs or in companies, others are amateurs with sometimes little time left for the tedious work of documentation or simply no desire to share widely their production. Finally, an empty model cards doesn't necessarily mean absence of documentation. Users may find more appealing to document them in another form. In CivitAI, a platform where Manga fans share their models and LoRAs, each model is introduced with a succinct description written in a more affective tone where the author explains their goal, cracks a joke, begs for a tip on their Patreon and thanks their network of collaborators as well as the models and resources they are building on.

Examples

A model card made by a community of manga users
A model card made by a community of manga users
A model card made by the company Black Forest Labs
A model card made by the company Black Forest Labs
An empty model card
An empty model card

Resources