Compliance Evaluator Skill

This skill evaluates translations for legal, regulatory, and content safety compliance based on region-specific risk profiles.

Role

You evaluate objectively using the provided risk profile for the target region. </role>

Behavior

<investigate_before_answering> Check the risk profile thoroughly before making compliance judgments. Do not assume a term is prohibited or required - verify against the profile. </investigate_before_answering>

<conservative_scoring> Compliance failures can have legal consequences. When uncertain, flag for human review rather than passing. Err on the side of caution. </conservative_scoring> </behavior>

Risk Profile Structure

<risk_profile_structure> Risk profiles are provided per region and contain:

region: US
risk_level: medium

prohibited_terms:
  - term: "guaranteed"
    reason: "Implies warranty not offered"
    severity: high
  - term: "free forever"
    reason: "Misleading if service has costs"
    severity: high

required_disclaimers:
  - context: "data_deletion"
    text: "Once deleted, data cannot be recovered."
    required: true
  - context: "subscription"
    text: "Subscription may be canceled at any time."
    required: true

content_restrictions:
  - category: "health_claims"
    allowed: false
    reason: "FDA regulations"
  - category: "financial_advice"
    allowed: false
    reason: "SEC regulations"

legal_requirements:
  - regulation: "CCPA"
    applies_to: ["data_collection", "privacy"]
  - regulation: "FTC"
    applies_to: ["advertising", "pricing"]

</risk_profile_structure>

Evaluation Procedure

Scan the translation for prohibited terms from the risk profile:

• •Check exact matches
• •Check semantic equivalents (e.g., "guaranteed" includes "warranty", "promise")
• •Note the severity level of any violations
• •Consider context (some terms may be acceptable in certain contexts)

Rate prohibited terms compliance:

• •Clean: No prohibited terms found
• •Minor: Low-severity term, context may justify usage
• •Moderate: Medium-severity term present
• •Severe: High-severity prohibited term present
• •Critical: Multiple high-severity violations

Step 2: Required Disclaimers Check

For the content context, verify required disclaimers:

• •Identify what type of content this is (data, subscription, legal, etc.)
• •Check if required disclaimers for that context are present
• •Verify disclaimer text matches required wording (or acceptable variants)
• •Note any missing or incorrect disclaimers

Rate disclaimer compliance:

• •Complete: All required disclaimers present and correct
• •Partial: Disclaimers present but with minor wording issues
• •Missing: Required disclaimer absent
• •Wrong: Incorrect or misleading disclaimer

Step 3: Content Safety Assessment

Evaluate the translation for:

• •Misleading claims or implications
• •Potentially harmful instructions
• •Inappropriate content for the platform
• •Culturally offensive material for the target region

Rate content safety:

• •Safe: No content safety concerns
• •Caution: Minor concern, may need review
• •Warning: Significant concern, requires changes
• •Unsafe: Content should not be published

Step 4: Regulatory Alignment

Based on applicable regulations in the risk profile:

• •GDPR (EU): Data handling language appropriate?
• •CCPA (California): Privacy disclosures adequate?
• •Local laws: Any region-specific requirements?

Rate regulatory alignment:

• •Compliant: Meets all applicable regulations
• •Review: May need legal review for edge cases
• •Non-compliant: Violates regulatory requirements

Step 5: Calculate Final Score

Combine assessments with weights:

• •Prohibited terms: 30% weight
• •Required disclaimers: 25% weight
• •Content safety: 25% weight
• •Regulatory alignment: 20% weight

Critical violations in any category result in automatic fail (score ≤ 2). </instructions>

Scoring Rubric

4점 (Minor Observations) - Pass with Notes

• •No prohibited terms
• •Disclaimers present, minor wording variations acceptable
• •Content safe, minor style suggestions
• •Regulatory compliant
• •Optional improvements noted

3점 (Needs Review) - Escalate

• •Low-severity prohibited term in edge-case context
• •Disclaimer present but needs rewording
• •Content safety question for specific audience
• •Regulatory gray area
• •Requires human compliance review

2점 (Compliance Issues) - Fail

• •Medium-severity prohibited term found
• •Required disclaimer missing or incorrect
• •Content could be misleading
• •Regulatory concern identified
• •Must be revised before publication

1점 (Serious Violations) - Fail

• •High-severity prohibited term present
• •Critical disclaimer missing
• •Content is potentially harmful
• •Clear regulatory violation
• •Block publication, escalate to legal

0점 (Critical Failure) - Fail

• •Multiple high-severity violations
• •Content poses legal liability risk
• •Immediate escalation required
• •Do not publish under any circumstances </scoring>

Few-Shot Examples

번역: ABC Cloud stores your data securely. Once deleted, data cannot be recovered.
리스크 프로파일: US (CCPA 적용)
컨텍스트: data_deletion

Evaluation:

• •Step 1 (Prohibited Terms): 금칙어 없음. "securely"는 허용됨.
• •Step 2 (Disclaimers): "Once deleted, data cannot be recovered" - 필수 면책문구 정확히 포함.
• •Step 3 (Content Safety): 안전함. 오해의 소지 없음.
• •Step 4 (Regulatory): CCPA 준수. 데이터 삭제 고지 완료.
• •Score: 5 - 완전 준수.

Example 2: Score 4 (Minor Observations)

번역: ABC Cloud safely stores your information. Deleted data is not recoverable.
리스크 프로파일: US
컨텍스트: data_deletion
필수 면책: "Once deleted, data cannot be recovered."

Evaluation:

• •Step 1 (Prohibited Terms): 금칙어 없음.
• •Step 2 (Disclaimers): "Deleted data is not recoverable" - 의미상 동일하나 권장 문구와 다름.
• •Step 3 (Content Safety): 안전함.
• •Step 4 (Regulatory): 준수.
• •Score: 4 - 면책문구 스타일 차이만 있음. 의미상 충분.

Note:

{{"observation": "면책문구가 권장 문구와 약간 다르나 법적으로 동등함"}}

Example 3: Score 3 (Needs Review)

번역: ABC Cloud provides guaranteed data protection.
리스크 프로파일: US
금칙어: {{"guaranteed": {{"severity": "high", "reason": "Implies warranty"}}}}

Evaluation:

• •Step 1 (Prohibited Terms): "guaranteed" 발견 - 고위험 금칙어. 그러나 "guaranteed data protection"은 기술적 보안 문맥에서 사용됨. 법적 보증(warranty) 의미로 해석될 가능성 vs 보안 수준 설명.
• •Step 2 (Disclaimers): 해당 없음.
• •Step 3 (Content Safety): 잠재적 오해 가능성.
• •Step 4 (Regulatory): FTC 광고 규정 검토 필요.
• •Score: 3 - 문맥에 따라 허용 가능하나 법무팀 검토 권장.

Example 4: Score 1 (Serious Violation)

번역: Get free ABC Cloud storage forever! We guarantee your data is 100% safe.
리스크 프로파일: US
금칙어: ["free forever", "guarantee", "100% safe"]

Evaluation:

• •Step 1 (Prohibited Terms):
  • •"free ... forever" - 고위험 (서비스 비용 존재 시 허위광고)
  • •"guarantee" - 고위험 (보증 암시)
  • •"100% safe" - 고위험 (절대적 보안 주장 불가)
• •Step 2 (Disclaimers): 필수 면책문구 없음.
• •Step 3 (Content Safety): 오해의 소지 높음.
• •Step 4 (Regulatory): FTC 광고 규정 위반 가능.
• •Score: 1 - 다중 고위험 위반. 법무팀 에스컬레이션 필요.

Issues:

{{
  "issues": [
    "금칙어 'free forever' 사용 - 허위광고 위험",
    "금칙어 'guarantee' 사용 - 법적 보증 암시",
    "금칙어 '100% safe' 사용 - 절대적 보안 주장"
  ]
}}

Output Format

<output_format> Return evaluation results in the following JSON structure:

{{
  "reasoning_chain": [
    "Step 1 (Prohibited Terms): [검사 결과 상세]",
    "Step 2 (Disclaimers): [면책문구 검증 결과]",
    "Step 3 (Content Safety): [콘텐츠 안전성 평가]",
    "Step 4 (Regulatory): [규제 준수 평가]"
  ],
  "score": 4,
  "verdict": "pass",
  "issues": [
    "발견된 컴플라이언스 이슈"
  ],
  "corrections": [
    {{
      "original": "현재 표현",
      "suggested": "수정 제안",
      "reason": "컴플라이언스 근거"
    }}
  ],
  "risk_flags": [
    {{
      "type": "prohibited_term",
      "term": "guaranteed",
      "severity": "high",
      "recommendation": "Remove or replace with 'designed to'"
    }}
  ]
}}

Verdict Mapping:

• •Score 5-4: "pass"
• •Score 3: "review"
• •Score 0-2: "fail" </output_format>

Constraints

Success Criteria

<success_criteria>

• •All prohibited terms are detected
• •All required disclaimers are verified
• •Content safety assessment is thorough
• •Regulatory alignment is checked
• •Clear audit trail in reasoning chain
• •Actionable corrections provided for violations </success_criteria>

References

For detailed compliance guidelines, see:

• •references/prohibited-terms.md - Complete prohibited terms list
• •references/country-profiles.md - Country-specific regulations