San Francisco AI Bias Audit Requirements for Vendors

Technology and Data California 3 Minutes Read ยท published February 06, 2026 Flag of California

Overview

San Francisco, California requires vendors who supply AI or automated decision systems to municipal agencies to meet bias-audit and accountability expectations when those systems are used in city programs or services. This guide explains typical procurement requirements, vendor obligations, evidence and recordkeeping, and how city enforcement and appeals work under San Francisco city rules and legislation [1].

  • Vendors must disclose use of automated decision systems and provide technical documentation.
  • Vendors are generally expected to deliver independent bias audits or algorithmic impact assessments.
  • Contracts may require ongoing monitoring, data access for audits, and mitigation plans for identified risks.
Start early: audit scheduling and procurement timelines must align with the bid schedule.

Penalties & Enforcement

San Francisco enforces procurement contract terms through the contracting agency and the City Administrator or designated contract office; specific penalties and fines are set in contract terms or controlling ordinances and implementing rules. Where numeric fines or per-day penalties would be applicable, such figures are not specified on the cited page [1]. Departments may instead rely on contract remedies, suspension of work, termination for default, withholding of payments, or pursuit of damages.

  • Monetary fines: not specified on the cited page [1].
  • Escalation: contracts commonly include progressive remedies for first, repeat, or continuing breaches; exact ranges are not specified on the cited page [1].
  • Non-monetary sanctions: corrective action orders, suspension or termination of contract, mandatory remediation, and court actions.
  • Enforcer and complaint pathway: contracting department or Office of Contract Administration; see Help and Support / Resources for official contact pages.
  • Appeals/review: protest procedures and contract claim processes are available through the contracting office; specific time limits for appeals are not specified on the cited page [1].
If an audit reveals discrimination risks, expect contract suspension until mitigation is approved.

Applications & Forms

Requirements for submitting bias audits are typically set within solicitation documents and contract clauses. A standalone city form for AI bias audits is not published on the cited page; vendors should follow solicitation instructions and submit audit reports as attachments unless the bid documents specify a form [1].

  • Where provided, include auditor name, methodology, datasets, metrics, and remediation plan.
  • Fees: any certification or review fees are set in solicitation or contract; not specified on the cited page [1].

Vendor Obligations and Best Practices

Vendors should prepare documentation and contract language that demonstrates compliance: model documentation, training and testing datasets, bias metrics, independent audit reports, version histories, access controls, and redaction methods for sensitive data. Contracts may require data-sharing under confidentiality terms to permit city-conducted compliance checks.

  • Maintain records of model development, datasets, and performance testing.
  • Provide mitigation plans for identified biases and update models as required.
  • Meet deadlines for audit delivery specified in the solicitation or contract.
Document chain-of-custody for data used in audits to speed review.

Action Steps for Vendors

  • Review solicitation clauses on automated decision systems and audit deliverables before bidding.
  • Commission an independent bias audit from a qualified third party aligned with solicitation requirements.
  • Include remediation commitments and timelines in your proposal to demonstrate responsiveness.
  • Prepare to use the city appeal or protest procedures if a compliance determination affects contract award.

FAQ

Do all vendors need an AI bias audit to bid on San Francisco contracts?
Not always; requirements depend on whether the solicitation involves automated decision systems and the department's policy, and the controlling ordinance text should be checked [1].
Who reviews audit reports?
Contracting officers or designated technical reviewers in the procuring department review the reports; the Office of Contract Administration may be involved for compliance enforcement.
What if an audit finds bias?
The city may require mitigation, corrective plans, or contract remedies including suspension or termination depending on the severity.

How-To

  1. Identify whether your solution qualifies as an automated decision system in the solicitation.
  2. Engage an independent auditor with relevant technical and statistical expertise.
  3. Produce an audit report addressing methodology, datasets, metrics, findings, and remediation steps.
  4. Submit the audit and required documentation per solicitation instructions and retain records for compliance checks.
  5. If there is an adverse contract action, use the contracting office protest and appeal process.

Key Takeaways

  • Check solicitation language early to confirm audit and disclosure requirements.
  • Independent bias audits and clear remediation plans improve award prospects.
  • Keep records and be prepared to cooperate with contracting office reviews.

Help and Support / Resources

Categories

General Governance and Administration Public Safety Public Health and Welfare Land Use and Zoning Housing and Building Standards Transportation Environmental Protection Parks and Public Spaces Business and Consumer Protection Taxation and Finance Labor and Employment Education Civil Rights and Equity Elections and Campaign Finance Events and Special Uses Signs and Advertising Utilities and Infrastructure Technology and Data