Violations

If a violation is detected, it’s classified into one of the categories outlined in this guide.


Hate

Hate is classified into one of the following categories:

  • Name
    hate
    Description

    Any violation related to hate.

  • Name
    hate-racism
    Description

    Any violation related to racism.

  • Name
    hate-sexism
    Description

    Any violation related to sexism.

  • Name
    hate-religion
    Description

    Any violation related to religion.

Example Response

{
  "data": {
    "severity": 7,
    "violations": [
      "hate",
      "profanity-slurs"
    ],
    "pii": []
  },
  "error": null
}

Violent content

Violent content is classified into one of the following categories:

  • Name
    violence
    Description

    Anything violent.

  • Name
    violence-threats
    Description

    Any threats of violence.

  • Name
    violence-extreme
    Description

    Any extreme violence.

  • Name
    extremism
    Description

    Any extremism-related content.

  • Name
    terrorism
    Description

    Any terrorism-related content.

Example Response

{
  "data": {
    "severity": 8,
    "violations": [
      "violence-threats"
    ],
    "pii": []
  },
  "error": null
}

Suicide & Self-harm

Suicide-related content is classified into one of the following categories:

  • Name
    suicide
    Description

    Any content related to suicide.

  • Name
    self-harm
    Description

    Any content related to self-harm.

  • Name
    self-harm-glorification
    Description

    Any content that glorifies self-harm or suicide.

Example Response

{
  "data": {
    "severity": 8,
    "violations": [
      "self-harm",
      "suicide"
    ],
    "pii": []
  },
  "error": null
}

PII

PII is classified into one of the following categories:

  • Name
    pii-sensitive
    Description

    Any content that contains sensitive information.

  • Name
    pii-financial
    Description

    Any content that contains financial information.

  • Name
    pii-health
    Description

    Any content that contains health information.

  • Name
    pii-contact
    Description

    Any content that contains contact information.

  • Name
    pii-location
    Description

    Any content that contains location information.

Example Response

{
  "data": {
    "severity": 3,
    "violations": [
      "pii-contact",
      "pii-location"
    ],
    "pii": [
      "[ADDRESS REDACTED]", // this will not be redacted 
      "[PHONE NUMBER REDACTED]" // in the response
    ]
  },
  "error": null
}

Profanity

Profanity is classified into one of the following categories:

  • Name
    profanity
    Description

    Any content that contains profane language.

  • Name
    profanity-slurs
    Description

    Any content that contains slurs.

Example Response

{
  "data": {
    "severity": 7,
    "violations": [
      "hate",
      "profanity-slurs"
    ],
    "pii": []
  },
  "error": null
}

Sexual content

Sexual content is classified into one of the following categories:

  • Name
    sexual
    Description

    Any content that contains sexual content.

  • Name
    sexual-nudity
    Description

    Any content that contains nudity.

  • Name
    sexual-explicit
    Description

    Any content that contains explicit sexual content.

  • Name
    sexual-violence
    Description

    Any content that contains violence in a sexual context.

  • Name
    sexual-suggestive
    Description

    Any content that contains suggestive sexual content.

  • Name
    child-exploitation
    Description

    Any content that contains child exploitation.

  • Name
    csam
    Description

    Any content that contains child sexual abuse material.

Example Response

{
  "data": {
    "severity": 8,
    "violations": [
      "sexual-explicit"
    ],
    "pii": []
  },
  "error": null
}

Harmful content

Harmful content is classified into one of the following categories:

  • Name
    bullying
    Description

    Anything that is considered bullying.

  • Name
    harassment
    Description

    Anything that is considered harassment.

  • Name
    stalking
    Description

    Anything that is considered stalking.

  • Name
    doxxing
    Description

    Anything that is considered doxxing.

Example Response

{
  "data": {
    "severity": 8,
    "violations": [
      "doxxing"
    ],
    "pii": [
      "[ADDRESS REDACTED]"
    ]
  },
  "error": null
}

Deceptive content

Deceptive content is classified into one of the following categories:

  • Name
    misinformation-health
    Description

    Any content that contains misinformation related to health.

  • Name
    misinformation-political
    Description

    Any content that contains misinformation related to politics.

  • Name
    misinformation-science
    Description

    Any content that contains misinformation related to science.

  • Name
    fraud
    Description

    Any content that contains fraud.

  • Name
    scams
    Description

    Any content that contains scams.

Example Response

{
  "data": {
    "severity": 8,
    "violations": [
      "misinformation-health"
    ],
    "pii": []
  },
  "error": null
}

Illegal content

Illegal content is classified into one of the following categories:

  • Name
    illegal
    Description

    Anything that is considered illegal.

  • Name
    illegal-drugs
    Description

    Any content that relates to illegal drugs.

  • Name
    illegal-weapons
    Description

    Any content that relates to illegal weapons.

  • Name
    illegal-gambling
    Description

    Any content that relates to illegal gambling.

  • Name
    trafficking
    Description

    Any content that relates to trafficking.

  • Name
    piracy
    Description

    Any content that relates to piracy.

Example Response

{
  "data": {
    "severity": 8,
    "violations": [
      "illegal"
    ],
    "pii": []
  },
  "error": null
}

Other

  • Name
    spam
    Description

    Anything that can be considered spam.

  • Name
    impersonation
    Description

    Anything that can be considered impersonation.

Example Response

{
  "data": {
    "severity": 6,
    "violations": [
      "spam"
    ],
    "pii": []
  },
  "error": null
}

Was this page helpful?