Generative AI Image Policy

Cantina users can use Generative AI technology to create images on demand. The following guidelines aim to strike a balance between creative self-expression and maintaining the safety and respect of everyone in our community.

Warning: Rooms in the Cantina may contain AI-powered bots that generate content based on user-directed prompts and messages. The resulting content may be offensive, inaccurate, and potentially harmful. Do NOT rely on them for accurate information, guidance, or counseling. By creating, activating, and/or interacting with bots, you assume all risks related to your bot use as outlined in the Terms of Service. 

Cantina’s approach to providing a safe environment includes taking into account intent and keeping our community accountable for their engagement with bots. Please note that while an image may not in and of itself violate our Generative AI policy, we reserve the right to take action if we deem that the user’s intent is in contravention of our guidelines. To do so, we may investigate factors such as account behavior, previous prompts and comments, as well as history of engagement on the platform. In addition, we hold our users accountable for the content they seek to create through Cantina’s bots, whether it is by requesting drawings, selfies, designing a bot’s avatar or uploading a photo to serve as the bot’s avatar. 

We rely on a combination of user reporting and proactive monitoring by content moderators and automated technologies to foster a welcoming environment for our community, and to identify and remove content that may violate our Community Guidelines and Terms of Service. When we are made aware of violations of our policies, we aim to take swift action. That may include issuing warnings and suspending accounts on a temporary or permanent basis. 

What violates this policy?

We prohibit the use of our technology to upload, attempt to generate or disseminate images with the following purposes:

1. Exploitation 
   • Child sexual abuse material, child sexual exploitation content, or child endangerment
   • Sexualization of minors
   • Sexual solicitation 
   • Sexual violence
   • Grooming
   • Sextortion
   • Non-consensual intimate activity 
   • Slavery
2. Harmful content
   • Images designed to discriminate, degrade, dehumanize or humiliate any individual or group due to their belonging to protected categories such as race, religion, national origin, ethnicity, sexual identity or orientation,  disability, and others
   • Media advocating violence towards others through known hate symbols or violent threats
   • Depictions of acts of terrorism, supporting or praising terrorist organizations, actors or ideologies, or content designed to further recruitment for terrorist organizations
   • Images aimed at encouraging or providing instructions for self-harm and suicide as well as cutting and eating disorders
   • Extreme gore media like images involving bodily destruction, detached body parts, cannibalism,  mutilation, torture or animal abuse 
   • Nudity and sexual content: do not request images that include male or female nudity, sexualization of minors, or any other explicit sexual imagery 
   • Sexually explicit deep fakes
   • Sexualized images of private or public individuals 
3. Misleading others or creating content that can be deceiving, particularly on a matter of importance
   • Generating media of a defamatory nature
   • Misleading people into believing that content you have produced synthetically on our platform was human-generated
   • Creating fraud, spam or unsolicited bulk content
   • Generating disinformation or misinformation 
   • Attempting to create content for voter interference purposes such as misleading media related to politicians, ballot-boxes, protests, or other content that may be used to influence the political process
   • Generating or furthering conspiracy theories or narratives related to ongoing geopolitical events with a harmful intent
4. Violating the rights of others 
   • Trying to generate media that violates others’ rights such as their intellectual property or privacy rights
   • Impersonating individuals or using their likeness without consent, authorization or legal right
   • Upload images of people without their consent or images for which you don’t hold appropriate usage rights
5. Additional content policies
   • Nudity or sexually explicit imagery
   • Images of real minors to be used as bot avatars

Prompt guidelines:
User messages serve as prompts that tell bot characters what to create. As such, you are solely responsible for the images you ask bots to create. All bot-generated images across room types, including direct messages, must adhere to this policy.

Bot avatar guidelines: 

Cantina’s goal is to mitigate the usage of its technology to cause harm. As such, we have strict policies around bot avatars in addition to our GenAI Media Policy. 

• Uploaded avatar
  • Images uploaded as bot avatars are subject to strict monitoring to prevent harmful uses such as unauthorized deepfake content. We ask users not to upload images of people without their consent. 
• AI-generated avatar
  • We have guardrails in place to prevent certain AI-generated avatars, such as those depicting minors.

Cantina and Community Moderation 

• We include in-product warnings, maintain stricter enforcement guidelines, proactively scan uploaded images, and manually moderate derivative content such as bot-generated images to uphold our commitment to minimize harmful use of our tools such as the creation of unauthorized deepfake content. 
• If you are unsure if your drawing or selfie request might violate guidelines, don't request it.
• We provide our community with reporting tools so that they can bring content to our attention. If you encounter bot-generated images that violate Cantina guidelines, please flag the image and/or delete it if possible. 
• Prompts can sometimes generate unintended inappropriate content. If this occurs, please flag the image as well and/or delete it.

How can I report violations of this policy?

If you encounter content that violates our Generative AI Image Policy, please report it by flagging the image or message. Please include specific details about the content and why it violates our policy to help our moderation team assess and address the issue.