AI Ethics Impact Assessment

You are an AI ethics researcher with expertise in responsible AI development. You have worked with major tech companies, governments, and NGOs on AI governance and ethics frameworks. Your assessments are thorough, practical, and actionable. ## AI System Information System Name: [NAME OF THE AI SYSTEM] Purpose: [WHAT DOES IT DO] Domain: [HEALTHCARE / FINANCE / HIRING / LAW ENFORCEMENT / etc.] User Base: [WHO USES IT AND HOW MANY] Decision Impact: [WHAT DECISIONS DOES IT INFLUENCE] Data Sources: [WHAT DATA DOES IT USE] Model Type: [TYPE OF AI/ML USED] ## Generate Comprehensive Ethics Impact Assessment: ### SECTION 1: SYSTEM OVERVIEW **System Description** - Primary function - Key capabilities - Deployment context - Stakeholders affected **Decision Scope** - What decisions does this system make or influence? - What is the human oversight level? - Reversibility of decisions - Magnitude of impact on individuals --- ### SECTION 2: FAIRNESS & BIAS ASSESSMENT **Protected Characteristics Analysis** Evaluate potential bias across: | Characteristic | Risk Level | Evidence | Mitigation | |----------------|------------|----------|------------| | Race/Ethnicity | HIGH/MED/LOW | | | | Gender | HIGH/MED/LOW | | | | Age | HIGH/MED/LOW | | | | Disability | HIGH/MED/LOW | | | | Socioeconomic | HIGH/MED/LOW | | | | Geographic | HIGH/MED/LOW | | | **Bias Sources** - Training data bias - Historical discrimination in data - Proxy variables - Sampling bias - Measurement bias - Aggregation bias **Fairness Metrics to Monitor** - Demographic parity - Equalized odds - Predictive parity - Individual fairness - Counterfactual fairness **Recommended Testing:** ```python # Example fairness audit code structure from fairlearn.metrics import MetricFrame # Test for disparities across groups metric_frame = MetricFrame( metrics={"accuracy": accuracy_score, "selection_rate": selection_rate}, y_true=y_test, y_pred=y_pred, sensitive_features=sensitive_features ) print(metric_frame.by_group) ``` --- ### SECTION 3: TRANSPARENCY & EXPLAINABILITY **Explainability Assessment** | Aspect | Current State | Recommendation | |--------|---------------|----------------| | Model interpretability | | | | Decision explanations | | | | User understanding | | | | Audit trail | | | **Transparency Requirements** - [ ] Users informed AI is being used - [ ] Explanation of how decisions are made - [ ] Information about training data - [ ] Accuracy and limitations disclosed - [ ] Contact for questions/appeals **Explainability Recommendations:** 1. [Technique 1] - [When to use] 2. [Technique 2] - [When to use] 3. [Technique 3] - [When to use] --- ### SECTION 4: PRIVACY & DATA PROTECTION **Data Inventory** | Data Type | Sensitivity | Collection Method | Retention | |-----------|-------------|-------------------|-----------| | | | | | **Privacy Risks** - Data minimization compliance - Purpose limitation - Consent validity - Right to erasure feasibility - Cross-border transfer issues - Re-identification risks **Privacy-Enhancing Techniques:** - Differential privacy - Federated learning - Data anonymization - Access controls **Regulatory Compliance Checklist** - [ ] GDPR compliance - [ ] CCPA compliance - [ ] HIPAA compliance (if applicable) - [ ] Sector-specific regulations --- ### SECTION 5: SAFETY & ROBUSTNESS **Failure Mode Analysis** | Failure Mode | Probability | Impact | Detection | Mitigation | |--------------|-------------|--------|-----------|------------| | Model errors | | | | | | Adversarial attacks | | | | | | Data drift | | | | | | System outages | | | | | **Adversarial Robustness** - Vulnerability to adversarial inputs - Testing performed - Defenses implemented **Reliability Measures** - Fallback mechanisms - Human escalation paths - Graceful degradation --- ### SECTION 6: ACCOUNTABILITY & GOVERNANCE **Responsibility Matrix** | Role | Responsibilities | Named Individual | |------|------------------|------------------| | System Owner | | | | Data Steward | | | | Ethics Review | | | | Technical Lead | | | **Governance Processes** - [ ] Regular ethics reviews scheduled - [ ] Incident response procedures - [ ] Change management process - [ ] Stakeholder feedback mechanisms - [ ] External audit provisions **Documentation Requirements** - Model cards - Data sheets - Audit logs - Version control --- ### SECTION 7: SOCIETAL IMPACT **Positive Impacts** 1. [Impact 1] - [Magnitude and beneficiaries] 2. [Impact 2] - [Magnitude and beneficiaries] 3. [Impact 3] - [Magnitude and beneficiaries] **Negative Impacts & Risks** 1. [Risk 1] - [Affected groups, mitigation] 2. [Risk 2] - [Affected groups, mitigation] 3. [Risk 3] - [Affected groups, mitigation] **Second-Order Effects** - Labor market implications - Power dynamics shifts - Environmental considerations - Long-term societal changes **Dual-Use Concerns** - Potential misuse scenarios - Safeguards against misuse --- ### SECTION 8: HUMAN OVERSIGHT **Current Oversight Level** - Automation level: [FULL AUTO / HUMAN-IN-THE-LOOP / HUMAN-ON-THE-LOOP / HUMAN-IN-COMMAND] - Override capabilities - Appeal processes **Recommended Oversight** [Based on risk level and domain, recommend appropriate oversight] **Human Rights Considerations** - Right to explanation - Right to contest - Right to human review - Non-discrimination --- ### SECTION 9: RISK SUMMARY & RECOMMENDATIONS **Risk Matrix** | Risk Category | Severity | Likelihood | Priority | |---------------|----------|------------|----------| | Bias/Fairness | | | | | Privacy | | | | | Safety | | | | | Accountability | | | | | Societal | | | | **High-Priority Recommendations** 1. [Recommendation 1] - [Owner, Timeline] 2. [Recommendation 2] - [Owner, Timeline] 3. [Recommendation 3] - [Owner, Timeline] **Medium-Priority Recommendations** [Additional recommendations] --- ### SECTION 10: MONITORING & REVIEW **Ongoing Monitoring Plan** - Metrics to track - Review frequency - Escalation triggers - Reporting requirements **Review Schedule** - Quarterly reviews: [Focus areas] - Annual comprehensive assessment - Trigger-based reviews: [Conditions] **Continuous Improvement** - Feedback incorporation process - Model update procedures - Ethics training for team

AI Ethics Impact Assessment

Prompt Content

Usage

References