The Office of the State Auditor (Office) today announces the release of its review of the State’s contract with Banjo, Inc. (Banjo). Attorney General Reyes requested the Office review the contract for Banjo’s public safety application Live Time. The circumstances surrounding Live Time posed several complex technical and social issues, including concerns regarding privacy and potential algorithmic bias. We recognize the compelling law enforcement interests underlying the associated procurement, particularly the possibility of leveraging technology to accelerate the safe rescue of abducted children.
Key takeaways of the review include:
- The actual capabilities of Live Time appeared inconsistent with Banjo’s claims in its proposal. Other competing vendors might have been able to meet the lower expectations.
- It appears that Live Time lacked the advertised AI technology. Live Time appeared suited to aid a skilled analyst via the power of an enhanced dashboard.
- Because of the reduced capability of the Live Time system, it appears much less likely sensitive personally-identifiable information (PII) was accessed, transferred, and used improperly than was previously feared. Live Time appeared to lack the algorithmic sophistication that would have posed the risk of inappropriate discrimination.
- The architecture of Live Time’s access to certain public safety systems should not have been permitted based on existing industry best practices.
In June 2020, State Auditor Dougall announced the formation of a Commission on Protecting Privacy and Preventing Discrimination (Commission) to assist in the Office’s review.
In February 2021, the Commission released two documents intended to help State and local government entities that are considering the procurement of advanced software technology. The two documents are:
- Software Application Procurement Principles for Utah Government Entities (Principles)
- Questions from the Commission on Protecting Privacy and Preventing Discrimination (Questions)
The application of these recently released principles to the original RFP likely would have avoided the pitfalls encountered.
State Auditor John Dougall said, “I recognize the challenges of finding innovative ways to better perform critical government functions. I also understand the complexities of translating one’s vision into operational tools. I commend government entities who continually strive to strengthen operations while saving money, despite the hurdles encountered pursuing those objectives.”
The news release, the Review, the Principles and the Questions are found at auditor.utah.gov.
The Review is found specifically at:
https://reporting.auditor.utah.gov/servlet/servlet.FileDownload?file=0151K0000042i9lQAA
“Software Application Procurement Principles for Utah Government Entities” is found at
https://auditor.utah.gov/wp-content/uploads/sites/6/2021/02/Office-of-the-State-Auditor-Software-Application-Procurement-Principles-Privacy-and-Anti-Discrimination-Feb-2-2021-Final.pdf
“Questions from the Commission on Protecting Privacy and Preventing Discrimination” is found at
https://auditor.utah.gov/wp-content/uploads/sites/6/2021/02/Office-of-the-State-Auditor-Questions-to-help-Procuring-Agencies-_-Entities-with-Software-Procurement-Feb-1-2021-Final.pdf