Generative AI Image Policy

Cantina allows users to create AI-generated media, including images and videos, to support creativity and expression. These tools are powerful, and with that power comes responsibility. This policy is designed to balance creative freedom with the safety, dignity, and trust of our community. 

Important notice about AI-generated media

You may encounter AI-powered bots that generate media based on user prompts in Cantina. Generated content may be inaccurate, offensive, or harmful. Do not rely on AI-generated media for factual accuracy, professional guidance, or decision-making. By creating, activating, or interacting with generative AI tools, you assume responsibility for how they are used, as outlined in our Terms of Service.

User responsibility and intent

You are responsible for the media you request, generate, upload, or use on Cantina  including media created through bots, prompts, avatars, or uploads.

Please note that while an image or video may not in and of itself violate our Generative AI policy, we reserve the right to take action if we deem that the user’s intent is in contravention of our guidelines. To do so, we may investigate factors such as account behavior, previous prompts and comments, as well as history of engagement on the platform. In addition, we hold our users accountable for the content they seek to create through Cantina’s bots, whether it is by requesting drawings, selfies, videos, designing a bot’s avatar or uploading a photo to serve as the bot’s avatar.

What violates this policy?

You may not use Cantina’s generative AI tools to create, upload, or distribute media that violates our high-priority harm policies:

1. Exploitation & sexual harm
   1. Involves child sexual abuse material, sexual exploitation, grooming, or endangerment

   2. Sexualizes minors in any form

   3. Depicts sexual violence, coercion, sextortion, or non-consensual intimate activity

   4. Includes sexually explicit deepfakes or sexualized depictions of individuals without consent

2. Harassment, hate & violence

   1. Degrades, dehumanizes, or targets individuals or groups based on protected characteristics

   2. Advocates or glorifies violence, terrorism, or extremist ideologies

   3. Encourages or provides instructions for self-harm, suicide, or eating disorders

   4. Depicts extreme or graphic violence, torture, mutilation, or animal abuse

3. Rights & likeness violations

   1. Uses someone's likeness without consent or legal right

   2. Uploads images or videos of people without permission

   3. Violates intellectual property, privacy, or publicity rights 

4. Deception, manipulation & harm

   1. Misleads others into believing AI-generated media is real or human-created in a harmful or deceptive context

   2. Creates defamatory, fraudulent, or scam-related content

   3. Generates misinformation or disinformation, including content intended to interfere with civic or political processes

   4. Advances harmful conspiracy narratives tied to real-world geopolitical events

Misleading professional representations 

You may not generate or distribute AI-generated media that falsely represents a person, bot, or fictional character as a licensed professional for the purpose of providing medical, legal, financial, or other high-risk advice. This includes media that falsely implies professional qualifications, licensure, endorsements, or expertise in a manner that could reasonably cause users to rely on the content when making important personal, legal, medical or financial decisions. 

Bot avatar guidelines  

We apply additional safeguards and review to avatar media due to the heightened risk of misuse. Bot avatars, whether uploaded or AI-generated, must comply with this policy.

• Do not upload images of real people without their consent
• Do not create avatars that depict or resemble minors
• Do not use avatars to impersonate individuals or mislead others
   

Moderation and enforcement

Cantina uses a combination of automated systems, human review, and user reports to identify and address policy violations. When violations occur, we may take action including content removal, warnings, feature restrictions, or temporary or permanent account suspension. If you are unsure whether a request or upload may violate this policy, do not proceed. 

How can I report violations of this policy?

If you encounter AI-generated media that violates this policy, please report it by flagging the content. Providing context helps our Trust & Safety team review and address issues more effectively. We also encourage users to report unintended harmful outputs as well, even when generated unintentionally.