Audit Status Report: Unified Vision of Zero Waste Activities INFORMATION CALENDAR Will Help Align Service Levels with Billing and Ensure Customer November 3, 2022 Equity
2 BACKGROUND
Public Works’ Zero Waste Division is responsible for the collection of residential material, including refuse, recycling, and composting; collection and processing of commercial material, including refuse, recycling, and composting; off-site hauling and composting of green/food waste for all customers; off-site hauling, sorting, and marketing of construction and demolition debris for all customers; and manages contracts related to the above work.
ENVIRONMENTAL SUSTAINABILITY AND CLIMATE IMPACTS
With the implementation of the Audit’s recommendations, the Zero Waste Division will continue to help reduce the volume of waste landfilled and:
Increase residential composting, recycling, and source reduction. Increase commercial composting, recycling, and source reduction. Increase recycling of construction and demolition (C&D) debris. Expand efforts to eliminate waste at its source.
Increase waste diversion in public buildings.
All of these above-noted items promote the City’s zero waste goal and are included in the approved Climate Action Plan Goals for Waste Reduction and Recycling.
POSSIBLE FUTURE ACTION
Public Works will continue to take timely and focused action(s) to address outstanding and partially implemented recommendations. The Zero Waste Division is working with the Information Technology and Finance Departments to select the software solution(s) needed to facilitate the implementation of the audit recommendations.
FISCAL IMPACTS OF POSSIBLE FUTURE ACTION
Public Works will update Council periodically on the progress, resources available, and any additional funding needed to address those recommendations that remain outstanding and partially implemented.
CONTACT PERSON
Greg Apa, Solid Waste and Recycling Manager, (510) 981-6359 Attachment:
1. Audit Findings and Recommendations Response Form
ATTACHMENT No. 1
Audit Title: Unified Vision of Zero Waste Activities Will Help Align Service Levels with Billing and Ensure Customer Equity Findings and Recommendations Lead Dept. Agree,
Partially
Agree, or
Do Not
Agree and
Corrective
Action Plan
Expected or
Actual
Implementation
Date
Status of Outstanding Audit Recommendations and Implementation Progress Summary
Finding: Integrated thinking about zero waste operations will help ensure accurate billings and customer equity
1.1 Agree to a common and unified
vision for zero waste operations.
Discuss the long-term zero waste
goals, objectives, and key initiatives
and share that information with
those responsible for day-to-day
operations. Use meetings and
informal communications to
regularly encourage staff to
embrace a unified view of zero
waste operations.
City
Manager’s
Office and
Team
Response:
Public
Works,
Finance,
and
Information
Technology
Agree October 2016 January 23, 2018 Update
Implemented
Since late 2015, Zero Waste, 311, and IT (called collectively the Customer Solutions Group or Group) have met on a monthly basis to discuss operational issues that affect the three
divisions. Given that this Group was already in place and per the Auditor’s recommendation, the Group opted to include Finance as a participant instead of creating of a separate
team and meeting.
The meetings’ monthly agenda identifies that the Group’s primary focus is the development and continuous implementation of a common approach by all members to ensure a unified vision for zero waste operations for all community members. In addition, the meetings’ agenda details those customers’ issues as they occur, so that, the Group’s members resolve them. These resolutions are applied by the Group to continue its efforts to strive towards the City’s zero waste goals and the initiatives needed to attain these goals.
1.2 Form a zero waste team
comprised of managers and line
staff involved with zero waste
operations (i.e., waste collection,
billings, customer calls, systems
support). Include a diverse pool of
people who can share ideas,
resources, and knowledge. Have
the team members’ work
collectively to evaluate their
respective functions; the
interrelationships among their
departmental activities; and the
practices, policies, and procedures
they use to perform their zero
waste account management and
operations functions. Ensure that
the team understands that their
Team
Response:
Public
Works,
Finance,
and
Information
Technology
Agree October 2016 September 20, 2016 Update
Implemented
Zero Waste, 311, and IT meet on a monthly basis to discuss operational issues that affect the three divisions. This meeting schedule has been in existence for over one year.
Since there was already a setup in place, we decided to include Finance as a participant versus create a separate team. We expanded the group and meeting scope to accommodate the Auditor’s recommendations. At every meeting, it will be the first agenda item to make sure all participants are made aware of the team’s concept. We will consider this completely implemented by October 2016, as at that time we will have met twice within the capacity required by this audit recommendation. This will be a regular meeting for the foreseeable future. The team members do understand that the Zero Waste operation is an enterprise with different parts and that the success of the operation depends on each of these distinctive units working together.
ATTACHMENT No. 1
Audit Title: Unified Vision of Zero Waste Activities Will Help Align Service Levels with Billing and Ensure Customer Equity Findi
ngs and Recommendations Lead D
ept. Agree,
Partia
lly
Agree, or
Do Not
Agree and
Corrective
Action Plan
Expect
ed or
Actual
Implementation
Date
Statu
s of Outstanding Audit Recommendations and Implementation Progress Summary
goal is to develop and support a
holistic approach to zero waste
operations not only to ensure
billing accuracy, but also to help
accomplish zero waste by 2020
and ensure continued efficient
and effective operations beyond
that achievement.
1.3 Require the zero waste team formed
in response to recommendation 1.2 to
develop written procedures that
clearly support cross- departmental
strategies and help staff perform their
work, as well as understand how their
work contributes to success. Include
information that helps promote the
unified view of zero waste operations,
while also explaining the individual
tasks that take place within the
departments and how those connect.
Examples include, but are not limited
to, describing the process for routing
customer cases from 311 calls, and
detailing in layman’s terms the
monthly updates that take place to
align the CX and RouteSmart systems.
Also see recommendation 1.2.
Team
Response:
Public
Works,
Finance,
and
Information
Technology
Agree Originally
Expected
December 2017
July 2019
September 20, 2016 Update
Staff from the Zero Waste Division, 311 Customer Service Center, Information Technology, and Finance Revenue Collection are reviewing and updating standard operating procedures for refuse and recycling services; reconfiguring and updating webpages; and creating technical assistance tools for zero waste customers. In July 2016, the group participated in an IT Strategic Plan Workshop to review the start of service process using the Rapid Workflow Process Model. The group will use this model to review other critical workflow processes.
January 23, 2018 Update
Partially Implemented
The Customer Solutions Group is constantly reviewing and updating standard
operating procedures for refuse and recycling services; reconfiguring and updating webpages; and creating technical assistance tools for its zero waste customers. An example of this effort is Zero Waste and 311 identified issues related to responding to the community members complaints related to collection services. Zero Waste and 311 developed 311’s scripted response and Solid Waste Supervisor response flow chart to ensure these issues were addressed within a 48 hour time frame.
In July 2016,
the Group participated in an IT Strategic Plan Workshop to review the start of service process using the Rapid Workflow Process Model. And as of this date, the ERP implementation schedule hasn’t reached its scheduled timeline to integrate CX and RouteSmart systems. Nonetheless, the Group will use this Model to review other
critical workflow processes to ensure that updates are developed in layman’s terms in its monthly updates.
September 25, 2018 Update
Partially Implemented
ATTACHMENT No. 1
Audit Title: Unified Vision of Zero Waste Activities Will Help Align Service Levels with Billing and Ensure Customer Equity Findi
ngs and Recommendations Lead D
ept. Agree,
Partia
lly
Agree, or
Do Not
Agree and
Corrective
Action Plan
Expect
ed or
Actual
Implementation
Date
Statu
s of Outstanding Audit Recommendations and Implementation Progress Summary
December 2019
January 2021
July 2024
IT administration, IT-311 and Zero Waste have commenced efforts, such as, an As-Is (existing software) review to improve customer interface with the City and a To-Be (future software) for the development of an RFP to solicit new software for new customer interface, refuse billing and routing systems. These reviews were facilitated by the City’s software consultant, Third Wave. The RFP is tentatively scheduled for a late 2018 release.
Rather than the purchase of another software system to integrate the existing inefficient (i.e., requires another software program to be bolted on to existing software), and inadequate software, a new routing and customer billing system would replace the CX and RouteSmart™ systems, integrate with ERMA and would be customer driven resolution and coordinated billing system.
March 12, 2019 Update
Partially Implemented
IT released an RFP on behalf of Public Works for Zero Waste Management software on October 18, 2018. The RFP was for a Zero Waste Management System and Professional Services consisting of a Waste Billing System, a Waste Computerized Maintenance Management System and a Route Optimization System. One proposal was received. If the proposal is accepted, software installation and implementation is anticipated to begin immediately upon contract execution in May 2019, with software operational by December 2019
March 24, 2020 Update
Partially Implemented
IT released an RFP for a Zero Waste Management System and Professional Services consisting of a Waste Billing System, a Waste Computerized Maintenance Management System will allow a follow-up RFP for Route Optimization System on October 18, 2018. One proposal was received. IT and Legal are in the process of finalizing a contract with the vendor with software installation to follow.
November 13, 2022 Update
Dropped
Contract awarded to AMCS, July 2020, to install new customer account & financial software platform to be up and running by mid-2024.
1.4 Require the zero waste team
formed in response to
Team
Response:
Agree October 2016 September 20, 2016 Update
Implemented.
ATTACHMENT No. 1
Audit Title: Unified Vision of Zero Waste Activities Will Help Align Service Levels with Billing and Ensure Customer Equity Findi
ngs and Recommendations Lead D
ept. Agree,
Partia
lly
Agree, or
Do Not
Agree and
Corrective
Action Plan
Expect
ed or
Actual
Implementation
Date
Statu
s of Outstanding Audit Recommendations and Implementation Progress Summary
recommendation 1.2 to have
regular meetings, e.g., quarterly, to
share information about their
operations and the known or
expected changes and events that
may impact cross-functional
efforts. These meetings may need
to be more frequent at first and
less frequent over time. The team
should use their meeting time to:
Identify continued barriers to
change.
Decide on solutions
that will help
overcome barriers.
Share information about the
challenges preventing staff from
meeting operational objectives.
Make cross-departmental
decisions to improve processes
and customer service.
Also see recommendation 1.2.
Public
Works,
Finance,
and
Information
Technology
As mentioned in response to recommendation 1.2, we expanded our existing monthly meeting to include Finance. The purpose of those meetings has always been to share information about operational and staff challenges. We expanded the meeting to include specific suggestions for this recommendation.
This initiative will be a continuous process that will be put in place for years to come as it becomes part of managing the operations of Zero Waste.
1.5 In collaboration with Information
Technology and as part of
Enterprise Resource Planning,
budget for, select, and install an
account management system
designed for zero waste activities.
Use information from the zero
waste team evaluation
(recommendation 1.2) and zero
waste strategy analyses
Team
Response:
Public
Works and
Finance
Agree January 23, 2018 Update
Not Implemented
The current Customer Relationship Management (CRM) system will not integrate with RouteSmart™ due to both FUND$ and CRM system limitations. The City is currently engaged in the Enterprise Resource Planning process to replace the FUND$ and then integrate the CRM system, which according to the current schedule by June 2019. The long term solution will be to procure a new customer management, operations and billing software that will fully integrate the RouteSmart™ with the new ERP.
Zero Waste Division and the Customer Solutions Group is actively engaging with IT to ensure that the new ERP system recognizes that Zero Waste Division is an enterprise funded operation. That is, it would be desirable to utilize RouteSmart system’s
ATTACHMENT No. 1
Audit Title: Unified Vision of Zero Waste Activities Will Help Align Service Levels with Billing and Ensure Customer Equity Findi
ngs and Recommendations Lead D
ept. Agree,
Partia
lly
Agree, or
Do Not
Agree and
Corrective
Action Plan
Expect
ed or
Actual
Implementation
Date
Statu
s of Outstanding Audit Recommendations and Implementation Progress Summary
(recommendation 1.8) to identify
the critical business needs that
should be included in the purchase
of new zero waste account
management system, or that should
be considered when determining
whether sufficient middleware
options exist to fully integrate
existing systems with the new
account management software.
Also see recommendations 1.2 and
1.8. July 2019
December 2019
January 2021
July 2024
capabilities to generate customer driven service requests (work orders), whereas the current ERP system is a City staff internally generated system input. IT has recognized that to provide seamless CRM service that a Request for Proposals (RFP) for an application that delivers the most efficient financial and operational software system that specifically handles the Zero Waste collection services will be written in FY2018 as part of Phase 2 of the ERP project.
September 25, 2018 Update
Partially Implemented
IT administration, IT-311 and Zero Waste have commenced efforts, such as, an As-Is (existing software) review to improve customer interface with the City and a To-Be (future software) for the development of an RFP to solicit new software for new customer interface, refuse billing and routing systems. These reviews were facilitated by the City’s software consultant, Third Wave. The RFP is tentatively scheduled for a late 2018 release.
Rather than the purchase of another software system to integrate the existing inefficient (i.e., requires another software program to be bolted on to existing software), and inadequate software, a new routing and customer billing system would replace the CX and RouteSmart™ systems, integrate with ERMA and would be customer driven resolution and coordinated billing system.
March 12, 2019 Update
Partially Implemented
IT released an RFP on behalf of Public Works for Zero Waste Management software on October 18, 2018. The RFP was for a Zero Waste Management System and Professional Services consisting of a Waste Billing System, a Waste Computerized Maintenance Management System and a Route Optimization System. One proposal was received. If the proposal is accepted, software installation and implementation is anticipated to begin immediately upon contract execution in May 2019, with software operational by December 2019.
March 24, 2020 Update
Partially Implemented
IT released an RFP for a Zero Waste Management System and Professional Services consisting of a Waste Billing System, a Waste Computerized Maintenance Management System will allow a follow-up RFP for Route Optimization System on October 18, 2018. One proposal was received. IT and Legal are in the process of finalizing a contract with the vendor with software installation to follow.
November 13, 2022 Update.
ATTACHMENT No. 1
Audit Title: Unified Vision of Zero Waste Activities Will Help Align Service Levels with Billing and Ensure Customer Equity Findi
ngs and Recommendations Lead D
ept. Agree,
Partia
lly
Agree, or
Do Not
Agree and
Corrective
Action Plan
Expect
ed or
Actual
Implementation
Date
Statu
s of Outstanding Audit Recommendations and Implementation Progress Summary
Dropped
Contract awarded to AMCS to install new customer account & financial software platform to be up and running by mid-2024.
1.6 Incorporate systems thinking into the
hiring process for both competitive
and promotional recruitments:
Describe the interdependent
nature of zero waste
operations in job
announcements.
Highlight the cross-
functional responsibilities
and relationships in job
descriptions. Discuss cross-
functional experiences
during job interviews to gain
an understanding of an
applicant’s mindset about
shared accountability.
Team
Response:
Public
Works and
Finance
Agree
Difficult to
implement I and
II because some
classifications
are not specific
to Zero Waste
operations but
are general
classification
that are
Citywide Item III
– During job
interviews for
Zero Waste
functions,
questions are
tailored to
potential hires
about the
working
conditions
specifically as
the relate to
Zero Waste.
October 2016
October 2016
September 20, 2016 Update
Public Works is currently recruiting for zero waste and using the interview techniques described. Finance and IT, however, are not in the process of, or able to identify when they will be, recruiting for a position for which this recommendation applies.
Therefore, we cannot identify a future implementation date. However, both IT and Finance applied these concepts in recent hires. Additionally, all the departments intend to use the concepts described in the recommendation as much as allowable and consider this recommendation implemented.
During the interview process, candidates are provided an overview of Zero Waste Division operations including relationships with other departments, the strategic priorities used to guide our everyday thinking and application of resources, and owning the commitment to excel in the areas of courtesy, knowledge, promptness, and teamwork.
To the extent possible and allowable by the City’s recruitment practices, we will include in our recruitment materials information that conveys to applicants for general classifications that their work will include cross-functional responsibilities and shared accountability.
January 23, 2018 Update
Implemented
The Departments of Public Works and Human Resources have reviewed the process of development of job announcements, such as, the recent hiring of Zero Waste Division Operations Manager to directly address the issues noted in this Recommendation.
With this job description for the Operations Manager and future Zero Waste management, administrative and operation staff positions will include a description of the interdepartmental nature of zero waste operations, and highlight cross-functional responsibilities.
1.7 Require that someone other than
the person who manually calculated
the zero waste rates and entered the
updated rates into the CX module
Finance Agree May 2015 September 20, 2016 Update
Completed. For FY 2016 updates, which was input in 2015, Finance implemented a Quality Assurance process in which an error report was produced by IT. The Supervisor reviewed the report and made corrective changes. The report was re-
ATTACHMENT No. 1
Audit Title: Unified Vision of Zero Waste Activities Will Help Align Service Levels with Billing and Ensure Customer Equity Findi
ngs and Recommendations Lead D
ept. Agree,
Partia
lly
Agree, or
Do Not
Agree and
Corrective
Action Plan
Expect
ed or
Actual
Implementation
Date
Statu
s of Outstanding Audit Recommendations and Implementation Progress Summary
perform an independent review of
the calculations and data entry for
accuracy. Have the reviewer report
back on any errors.
Ensure that management is also
notified of the errors, verifies that the
corrections were made, and signs off
on the review.
July 2024
produced two other times to make sure all the error was fixed and the Manager of the unit signed off on the final report before finalizing system changes.
January 23, 2018 Update:
Implemented
The initial base rates were approved by Resolution No. 66,600-N.S. effective July 1, 2014 for FY2015. The Department of Public Works administration calculates the next Fiscal Year’s rates based on the previous Fiscal Year’s rates. The rates are calculated utilizing the current CPI, the published April annual rate, or 3%, whichever is greater.
These new FY rates and calculations are verified and signed off by Zero Waste Division Manager. The completed approved Rate Tables are then forwarded to the Finance Department Revenue Collections Manager for final verification and FUND$ system input for billing.
November 13, 2022 Update
Implemented
Contract awarded to AMCS, July 2020, to install new customer account & financial software platform to be up and running by mid-2024. New Rates were proposed at a 12/07/2022 Council Work Session that was to include the cost of AMCS. The Proposition 218 rate approval process was put on hold by City Agenda Committee in January 2022.
1.8 Request that Information Technology
use the CX module data extracts,
such as the one used for this audit, to
provide Public Works staff with the
data they need to analyze zero waste
strategies. Use the data extracts to
further identify the critical business
needs for new zero waste account
management software.
Also see recommendation 1.5.
Public Works Agree Originally
Expected:
December 2016
September 20, 2016 Update
We will ask IT to provide our fiscal services and zero waste strategy staff with CX data using existing data extracts, and use that for data analytics using software such as Excel. We will use these extracts to help identify the reporting needs of a new zero waste account management system.
If needed, IT staff can provide reports or training to Public Works staff so they are able to run the reports themselves or extract the information in the format needed, if feasible.
January 23, 2018 Update
Not Implemented
The CX module data utilized for this Audit was specifically designed to support the data request and this is what is called a bolt-on module, which means, it retrieves specific data requested from the CRM. Any module development requires IT to code, test and implement these bolt-on modules for a specific request. To analyze all appropriate data to identify a critical Zero Waste Division business need(s) would require the utilization of data residing in RouteSmart™. The Current CRM system will not integrate or auto-populate with RouteSmart™ due to CRM system limitations. Per
ATTACHMENT No. 1
Audit Title: Unified Vision of Zero Waste Activities Will Help Align Service Levels with Billing and Ensure Customer Equity Findi
ngs and Recommendations Lead D
ept. Agree,
Partia
lly
Agree, or
Do Not
Agree and
Corrective
Action Plan
Expect
ed or
Actual
Implementation
Date
Statu
s of Outstanding Audit Recommendations and Implementation Progress Summary
December 2019
December 2019
January 2021
the current IT ERP implementation schedule, the City is scheduled to upgrade and/or replace the CRM system in June 2019.
The long term solution will be to procure a new customer management, operations and billing software that will integrate and fully utilize the RouteSmart™ data. An RFP for an application that delivers the most efficient financial and operational software system specific to the Zero Waste Division operational and the solid waste industry requirements is scheduled to be developed in FY2018 as part of Phase 2 of the ERP project.
September 25, 2018 Update
Partially Implemented
IT provided extensive CX data in support of the Commercial Route expansion. During the expansion which involved adding over 400 accounts, critical limitations of the CZX software were identified. Additionally, IT facilitated the key departments to complete an As-Is analysis of existing software to identify areas of improvement. The departments have completed s To-Be analysis of future software which was the basis for a Request For Proposals (RFP) to solicit new software for new customer interface, refuse billing and routing systems. Both the CX (customer account management and billing software) and RouteSmart™ (collection routing software) systems are planned for replacement within the next year. These reviews were facilitated by the City’s software consultant, Third Wave. The RFP is tentatively scheduled for late 2018 release. IT administration, IT-311 and Zero Waste are collaborating to ensure a unified approach.
This new routing and customers billing software will the CX and RouteSmart™ Systems and integrate with Erma, the City’s new financial software system. The new software will be customer driven and provide enhanced, coordinated billing system.
March 12, 2019 Update
Partially Implemented
IT released an RFP on behalf of Public Works for Zero Waste Management software on October 18, 2018. The RFP was for a Zero Waste Management System and Professional Services consisting of a Waste Billing System, a Waste Computerized Maintenance Management System and a Route Optimization System. One proposal was received. If the proposal is accepted, software installation and implementation is anticipated to begin immediately upon contract execution in May 2019, with software operational by December 2019.
March 24, 2020 Update
Partially Implemented
ATTACHMENT No. 1
Audit Title: Unified Vision of Zero Waste Activities Will Help Align Service Levels with Billing and Ensure Customer Equity Findi
ngs and Recommendations Lead D
ept. Agree,
Partia
lly
Agree, or
Do Not
Agree and
Corrective
Action Plan
Expect
ed or
Actual
Implementation
Date
Statu
s of Outstanding Audit Recommendations and Implementation Progress Summary
July 2024
IT released an RFP for a Zero Waste Management System and Professional Services consisting of a Waste Billing System, a Waste Computerized Maintenance Management System will allow a follow-up RFP for Route Optimization System on October 18, 2018. One proposal was received. IT and Legal are in the process of finalizing a contract with the vendor with software installation to follow.
November 13, 2022 Update.
Dropped
Contract awarded to AMCS to install new customer account & financial software platform to be up and running by mid-2024.
1.9 Perform, or contract for, a fully
comprehensive route audit to align
service delivery with billing rates.
Use the route audit to:
Make CX module and/or
RouteSmart system updates
to ensure customers are billed
correctly for their City-
provided services.
Ensure that all residential
accounts are receiving
required services.
Ensure that the commercial
accounts that the City is
responsible for receive and pay
for the zero waste services
required by City policy. Verify
that roll-off bin customers
serviced by the Zero Waste
Division are accurately billed.
Public Works Agree Originally
expected: July
2018
December 2019
September 20, 2016 Update
As part of the route audit, actual service levels will be compared against data in the CX module and appropriate updates made to ensure that all residential and commercial accounts are receiving required services and billed correctly for those services. Route books will also be updated to reflect the results of the route audit.
January 23, 2018 Update
Not Implemented
IT has created a table for monthly routing development that extracts customer information from the FUND$ and provides the data to be then downloaded into RouteSmart™. Due to the FUND$ system limitations, this link takes hours to download information into RouteSmart™. The company, RouteSmart™, has stated that this integration process should take minutes. The City will be replacing the ERP system in June 2019 and then the CRM system would be upgraded or replaced.
The long term solution is to integrate the new customer management, operations and billing software with RouteSmart™. With RouteSmart™ full utilization and the integration of a work order system, the invoicing system could be customer based, i.e. customers’ billing and services are directly linked with the new EFP implementation, to allow the City to more easily reconcile services provided with customers’ invoices.
September 25, 2018 Update
Partially Implemented
IT facilitated the key departments to complete an As-Is analysis of existing software to identify areas of improvement. The departments have completed s To-Be analysis of future software which was the basis for a Request For Proposals (RFP) to solicit new software for new customer interface, refuse billing and routing systems. Both the CX (customer account management and billing software) and RouteSmart™ (collection routing software) systems are planned for replacement within the next year. These reviews were facilitated by the City’s software consultant, Third Wave. The RFP is
ATTACHMENT No. 1
Audit Title: Unified Vision of Zero Waste Activities Will Help Align Service Levels with Billing and Ensure Customer Equity Findi
ngs and Recommendations Lead D
ept. Agree,
Partia
lly
Agree, or
Do Not
Agree and
Corrective
Action Plan
Expect
ed or
Actual
Implementation
Date
Statu
s of Outstanding Audit Recommendations and Implementation Progress Summary
December 2019
January 2020
July 2024
tentatively scheduled for late 2018 release. IT administration, IT-311 and Zero Waste are collaborating to ensure a unified approach.
This new routing and customers billing software will the CX and RouteSmart™ Systems and integrate with Erma, the City’s new financial software system. The new software will be customer driven and provide enhanced, coordinated billing system.
March 12, 2019 Update
Partially Implemented
IT released an RFP on behalf of Public Works for Zero Waste Management software on October 18, 2018. The RFP was for a Zero Waste Management System and Professional Services consisting of a Waste Billing System, a Waste Computerized Maintenance Management System and a Route Optimization System. One proposal was received. If the proposal is accepted, software installation and implementation is anticipated to begin immediately upon contract execution in May 2019, with software operational by December 2019.
March 24, 2020 Update
Partially Implemented
IT released an RFP for a Zero Waste Management System and Professional Services consisting of a Waste Billing System, a Waste Computerized Maintenance Management System will allow a follow-up RFP for Route Optimization System on October 18, 2018. One proposal was received. IT and Legal are in the process of finalizing a contract with the vendor with software installation to follow.
August 24, 2022 Update.
Dropped
Contract awarded to AMCS to install new customer account & financial software platform to be up and running by mid-2024.
1.10 Enforce the requirement for zero
waste drivers to compare actual
service levels against route books
and addenda during their collection
routes, and report any variances to
the Zero Waste Division supervisor
for correction. Ensure that the
drivers’ efforts are supported by
taking action to correct the
Public
Works
Agree. December 2016 September 20, 2016 Update
We agree that the actual service levels should be compared against route books but believe that enforcing the policy to have drivers do onsite comparisons is no longer an efficient use of our drivers’ time. We are exploring other options, such as using student interns to do the comparisons.
January 23, 2018 Update
Implemented
The Zero Waste drivers are reminded monthly to verify actual service levels with the route books for their collection routes by the Zero Waste Management Team. The Zero Waste dispatcher(s) are in constant communication with the drivers to ensure service levels are correct. If service levels are not corrected, Zero Waste Supervisor(s)
ATTACHMENT No. 1
Audit Title: Unified Vision of Zero Waste Activities Will Help Align Service Levels with Billing and Ensure Customer Equity Findi
ngs and Recommendations Lead D
ept. Agree,
Partia
lly
Agree, or
Do Not
Agree and
Corrective
Action Plan
Expect
ed or
Actual
Implementation
Date
Statu
s of Outstanding Audit Recommendations and Implementation Progress Summary
discrepancies. undertake appropriate corrective actions to ensure verification.
1.11 When drafting new franchise hauler
agreements:
Clearly define the fee calculation
requirements.
Clearly define the type of
financial data and reports that
the haulers must submit to
support their fee calculations.
Create and enforce the use of
standardized forms for the
franchise haulers to use when
remitting their fees to facilitate
Public Works staff’s review.
Public
Works
Agree Originally
Expected:
December 2017
July 2019
September 20, 2016 Update
The City has contracted with a consultant to assess development and implementation costs related to the City’s planned in-house commercial hauling system, and evaluate the financial and operational impacts of that system on the City and on existing commercial customers. The study will look at future franchise agreements for waste collection services and will include these factors.
January 23, 2018 Update
Not Implemented
The City Council approved a recommendation to replace the current non-exclusive franchise collection system for commercial refuse and recyclables with in-house commercial refuse and recycling collection services except for roll-off service. In FY19, Public Works’ will be issuing an RFP to solicit a consultant to review all Transfer Station and residential and commercial community members’ rates. Once contracted, the consultant will assess development and implementation costs related to redesigning the franchise
commercial hauling system to provide for roll-off and
compactor services. Then, the consultant will evaluate the financial and operational impacts of that system on the City and on existing commercial customers.
January 23, 2018 Update
Not Implemented
No changes since last report, but progress continues on this item.
September 25, 2018 Update
Not Implemented
No changes since last report, but progress continues on this item.
March 12, 2019 Update
Dropped
With Zero Waste Division successful completion in March 2018 of the integration of commercial accounts (440 +) formerly collected under the existing Non-Exclusive Commercial Hauler Franchise Agreement system, revision of the existing system is not required. Zero Waste does not anticipate issuing new Franchise Agreements but will work with the three existing Franchisees during the next Franchise Agreement renewal process in 2020 to enhance reporting requirements. Public Works will also evaluate the published fees as set by resolution as listed in 9.60.260 of the Municipal Code.
ATTACHMENT No. 1
Audit Title: Unified Vision of Zero Waste Activities Will Help Align Service Levels with Billing and Ensure Customer Equity Findi
ngs and Recommendations Lead D
ept. Agree,
Partia
lly
Agree, or
Do Not
Agree and
Corrective
Action Plan
Expect
ed or
Actual
Implementation
Date
Statu
s of Outstanding Audit Recommendations and Implementation Progress Summary
1.12 Continue to investigate whether the
franchise hauler erroneously
removed recyclables from its fee
calculations and, if so, back bill as
allowable, per state law and city
code.
Public
Works
Partially Agree Originally
Expected;
December 2016
October 2018
September 20, 2016 Update
City Council Approved a Public Works Action Calendar Item to replace the current non-exclusive franchise collection system. Public Works’ long-term plan is for the department to take over all commercial zero waste services except for roll-off containers and compactors. Given the planned changes, it is not practical or cost- effective to undertake the task of investigating the past fee calculations. However, moving forward, for any franchise hauler agreements we may have, we will require that staff have written procedures in place that describe the correct calculations for determining what that haulers owe the City, and that staff review invoices for accuracy in comparison to those calculation requirements.
January 23, 2018 Update
Alternative Implemented
At its May 26, 20151, the City Council approved a Department of Public Works Action Calendar Item to replace the
current non-exclusive franchise collection system. The Council’s approved Public Works’ long-term plan for in-house collection of these non- exclusive commercial waste collection
services except for roll-off and compactor
services. This in-house commercial waste collection by Zero Waste Division is scheduled to start March 1, 2018 as detailed at the October 10, 2017 Council Work session2. Given the approved action with the non-exclusive franchisees termination, it would be neither practical nor cost-effective to undertake the task of investigating the past fee calculations. ZWD staff agrees for any future franchise hauler agreements for roll-off and compactor services that staff will have written procedures in place that describe the correct calculations to determine what that owe the City, and that staff will review invoices for accuracy in comparison to those calculation requirements.
September 25, 2018 Update
Dropped
Beginning in March 2018, the Zero Waste Division began collecting commercial waste, recyclables and compost in-house, except for roll-off and compactor services. Written procedures that describe the correct calculations are in progress concurrence with the implementation of Erma, the City new financial software system, to start October 1, 2018.
1 https://www.cityofberkeley.info/Clerk/City_Council/2015/05_May/Documents/2015-05-26_Item_34_Zero_Waste.aspx 2 https://www.cityofberkeley.info/Clerk/City_Council/2016/09_Sep/Documents/2016-09-13_WS_Item_01_Zero_Waste_Worksession.aspx
ATTACHMENT No. 1
Audit Title: Unified Vision of Zero Waste Activities Will Help Align Service Levels with Billing and Ensure Customer Equity Findi
ngs and Recommendations Lead D
ept. Agree,
Partia
lly
Agree, or
Do Not
Agree and
Corrective
Action Plan
Expect
ed or
Actual
Implementation
Date
Statu
s of Outstanding Audit Recommendations and Implementation Progress Summary
June 2020 March 12, 2019 Update
Partially Alternately Implemented
Given the roll-out issues associated with the November 1st implementation of the City’s new enterprise resource planning system, “Erma”, staff time has been rerouted to resolve. This project is on hold.
Office of the City Manager
2180 Milvia Street, Berkeley, CA 94704 ● Tel: (510) 981-7000 ● TDD: (510) 981-6903 ● Fax: (510) 981-7099 E-Mail: [email protected] Website: http://www.CityofBerkeley.info/Manager
INFORMATION CALENDAR
November 3, 2022
To: Honorable Mayor and Members of the City Council
From: Dee Williams-Ridley, City Manager
Submitted by: Liam Garland, Director, Public Works Department Subject: Audit Status Report – Lease Audit: Conflicting Directives Hinder Contract Oversight
INTRODUCTION
The Office of the City Auditor presented a June 2009 Leases Audit: Conflicting Directives Hinder Contract Oversight. The City Auditor conducted the audit to determine whether facility leases were properly initiated, tracked, recorded, and renewed or terminated; whether monitoring of collection activities was effective and efficient; and whether payments and receipts were properly recorded. This report is the seventh and final update to the 2009 Lease Audit, which is slated for no further follow-up action as recommended by the City Auditor for all audits more than five years old.
CURRENT SITUATION AND ITS EFFECTS
This report is the seventh and final update to the 2009 Lease Audit. In recognition of its goal to implement Lease Audit recommendations, Public Works has committed to providing status updates of real property matters to City Council, thereby providing information on properties owned and leased by the City and progress updates on revisions to Administrative Regulation 6.6: Negotiating and Preparing City Lease or License Agreements, Acquiring/or Disposing of Real Property as recommended in the 2009 Lease Audit.
BACKGROUND
In June 2009, the City Auditor’s Office issued its report Leases Audit: Conflicting Directives Hinder Contract Oversight. The objective of the audit was to determine the effectiveness of the City’s facility lease oversight and resulted in recommendations aimed at improving lease oversight and management. The City Auditor requested the City Manager continue to report to Council on the status of those recommendations until all were fully implemented or otherwise addressed. The sixth and most recent status report was presented to City Council on May 29, 2018.
The original Audit Report included twenty-four recommendations, seventeen of which have been closed; fifteen were implemented as recommended; one was implemented with an alternative solution; and one was closed after management reconsidered it and reported it would not be implemented because it would neither be appropriate nor
Audit Status Report: Lease Audit: Conflicting Directives Hinder Contract Oversight INFORMATION CALENDAR November 3, 2022
realistic to do so. The May 2018 report stated that the seven remaining recommendations are partially implemented and that further implementation should be suspended.
ENVIRONMENTAL SUSTAINABILITY AND CLIMATE IMPACTS
There are no identifiable environmental effects or opportunities associated with the subject of this report.
POSSIBLE FUTURE ACTION
When resources become available, the City Manager and Public Works aim to develop an implementation plan to improve property management citywide. Alternatively, the City Auditor may choose to launch a new performance audit with updated recommendations.
FISCAL IMPACTS OF POSSIBLE FUTURE ACTION
Currently, Public Works’ Property Management Unit has one (1) full-time employee. Any increase in these services would very likely require additional staffing and budget.
CONTACT PERSON
Dionne Early, Community Development Project Coordinator, Public Works, (510) 981-6453
Andrew Brozyna, Deputy Director of Operations, Public Works, (510) 981-6396 Attachment:
1. Audit Findings and Recommendations Response Form
Audit Title: Leases Audit: Conflicting Directives Hinder Contract Oversight
Finding Recommendation Lead
Department
Status of Outstanding Audit Recommendations and
Implementation Progress Summary
The City’s 2002 plan to
centralize property and
facility lease
management has not
been implemented.
1.1 The City Manager should
formalize and approve the
division of responsibilities
between the Public Works
department and other
departments regarding lease
management.
City
Manager
Original Audit Response: City Manager and Public Works agreed with recommendation.
10/28/13 Status: Partially Implemented
1/31/17 Status Update: Partially Implemented/Further
Implementation Needed.
5/29/18 Status Update: Partially Implemented. Despite nearly nine years of attempting to decentralize property management within the City of Berkeley, particularly in regards to lease management, the effort has not been successful. The City’s contract with Contra Costa County Real Estate Division does provide some real property services, but the Community Development Project Coordinator responsible for Public Works property management continues to have to play an active role in all Departments’ real property decision-making and lease management. The City Manager’s Office will work with the various departments that currently support property management to develop an alternative citywide approach by functional responsibility. For example, some portions of property management, such as facility maintenance and lease negotiations may be centralized, but doing so will require additional resources.
Further status reports for this recommendation will be submitted until it is “alternatively implemented.”
11/3/22 Status Update: Dropped. Audit recommendations are considered dropped if the City has not implemented them within five years.
The City’s 2002 plan to
centralize property and
facility lease
management has not
been implemented.
1.2 The Public Works
department should
determine and formally
define the role of the real
property administration staff
given available resources.
City
Manager
Original Audit Response: City Manager and Public Works agreed with recommendation.
10/28/13 Status: Partially Implemented/Further Implementation Suspended.
1/31/17 Status Update: Partially Implemented/Further
Implementation Needed.
5/29/18 Status Update: Partially Implemented. The City continues to not have dedicated real property administration staff identified in every department. The Interdepartmental Real Property Working Group meetings have made it clear that each department has specific and varied real property needs. This resulted in the group disbanding, and each department is instead working with Public Works’ Community Development Project Coordinator on an as- needed basis. Full implementation of this recommendation will be completed once an alternative citywide approach to property management has been identified and implemented.
11/3/22 Status Update: Dropped. Audit recommendations are considered dropped if the City has not implemented them within five years.
The City’s 2002 plan to
centralize property and
facility lease
management has not
been implemented.
1.3 Develop and finalize a
property management plan
that documents the specific
responsibilities of Public
Works and of other
departments for lease
management.
Public
Works
Original Audit Response: City Manager and Public Works agreed with recommendation.
10/28/13 Status: Partially Implemented/Further Implementation Suspended.
1/31/17 Status Update: Partially Implemented/Further
Implementation Needed.
5/29/18 Status Update: Partially Implemented. Full implementation of this recommendation will be completed once an alternative citywide approach to property management has been identified and implemented.
11/3/22 Status Update: Dropped. Audit recommendations are considered dropped if the City has not implemented them within five years.
The City’s 2002 plan to
centralize property and
facility lease
management has not
been implemented.
1.4 The property management
plan should be coordinated
with affected City
departments, including the
Contract Administrator in
Finance/Purchasing, before
finalizing.
Public
Works
Original Audit Response: Public Works agreed with
recommendation.
10/28/13 Status: Partially Implemented
1/31/17 Status Update: Partially Implemented/Further
Implementation Needed.
5/29/18 Status Update: Partially Implemented. A new Contract Administrator/General Services Manager (GSM) was hired summer 2016. The GSM is an important partner in improving lease boilerplates, contract templates, and RFP guidance associated with property management. While significant improvements in
coordination have occurred, as stated above, a property management plan structured around decentralization has notbeen completed. Full implementation of this recommendation will be completed once an alternative citywide approach to property management has been identified and implemented.
11/3/22 Status Update: Dropped. Audit recommendations are considered dropped if the City has not implemented them within five years.
The City’s 2002 plan to
centralize property and
facility lease
management has not
been implemented.
1.5 Formally communicate the
plan with all affected City
departments.
City
Manager
Original Audit Response: Public Works agreed with
recommendation.
10/28/13 Status: Partially Implemented
1/31/17 Status Update: Partially Implemented/Further
Implementation Needed.
5/29/18 Status Update: Partially Implemented. The
Interdepartmental Real Property Working Group meetings were terminated. A team folder on the City’s shared drive continues to be used to share property management documents. No plan to continue decentralized management of property in the City of Berkeley is being developed. Full implementation of this recommendation will be completed once an alternative citywide approach to property management has been identified and implemented.
11/3/22 Status Update: Dropped. Audit recommendations are considered dropped if the City has not implemented them within five years.
City staff did not
comply with City rules
and regulations
because the City lacks
clear guidelines and
simple tools for
effective lease
negotiations, review,
approval, and
oversight.
2.1 Administrative Regulation 6.6
and Contracts Online should
be updated to give clear
direction to City staff
regarding administration and
execution of lease
agreements.
Public
Works
Original Audit Response: Public Works and Finance agreed with recommendation.
11/9/10 Status: Contracts Online Updated
10/28/13 Status: Partially Implemented
1/31/17 Status Update: Partially Implemented/Further
Implementation Needed.
5/29/18 Status Update: Partially Implemented. While updates to Contracts Online were completed, leases must be updated, usually with the assistance of outside counsel, to ensure all current requirements from local, states and federal levels are addressed. A generic template does not work for the majority of revenue or expenditure leases involving the City. Updating AR 6.6 will not sufficiently clarify administration and execution of City lease agreements. A suite of Administrative Regulations will be developed that cover thefull spectrum of the City’s real property needs to ensure staff and City Council follow a process that is fully transparent and adheres to accepted public outreach processes. 11/3/22 Status Update: Dropped. Audit recommendations are considered dropped if the City has not implemented them within five years.
There are no
performance measures
to document
expectations of and
performance by the
Real Property
Administrator or
departmental lease
managers.
3.3 Public Works should update
the City’s real property
administration policies and
procedures to align with
management’s expectations.
Public
Works
Original Audit Response: Public Works agreed with
recommendation.
10/28/13 Status: Partially Implemented
1/31/17 Status Update: Partially Implemented/Further
Implementation Needed.
5/29/18 Status Update: Partially Implemented/Further
Implementation. Public Works will update the City’s real property administration policies and procedures once an alternative citywide approach to property management has been identified and implemented.
11/3/22 Status Update: Dropped. Audit recommendations are considered dropped if the City has not implemented them within five years.
Office of the City Manager
2180 Milvia Street, Berkeley, CA 94704 ● Tel: (510) 981-7000 ● TDD: (510) 981-6903 ● Fax: (510) 981-7099 E-Mail: [email protected] Website: http://www.CityofBerkeley.info/Manager
INFORMATION CALENDAR
November 3, 2022
To: Honorable Mayor and Members of the City Council
From: Dee Williams-Ridley, City Manager
Submitted by: Liam Garland, Director, Department of Public Works Subject: Audit Status Reports: Fleet Replacement Fund Short Millions & Rocky Road: Berkeley Streets At Risk and Significantly Underfunded
INTRODUCTION
On November 19, 2020, the City Auditor published the Rocky Road: Berkeley Streets at Risk and Significantly Underfunded Audit Report1, reviewing the funding resources to sufficiently maintain City streets, and asking if Public Works has clear policies and processes to guide paving decisions. This is the first status report regarding this audit.
On June 2, 2021, the City Auditor published the Fleet Replacement Fund Short Millions Audit Report2, reviewing the solvency of the fund to sufficiently replace vehicles and asking if Public Works has the key information necessary to manage the Fleet program.
This is the first status report to City Council on the efforts made to implement the Audit Report’s recommendations for Fleet.
CURRENT SITUATION AND ITS EFFECTS
The Street Paving Audit Report noted two findings and five recommendations for the Public Works Department to review, implement and report to Council. As of this report, three recommendations have been implemented and two recommendations have been partially implemented.
The Fleet Audit Report noted two findings and twelve recommendations for the Public Works Department to review, implement and report to Council. As of this report, there are updates to the status of all twelve recommendations. The first set of seven recommendations was related to the underfunding of the replacement fund. One recommendation has been partly implemented, the remaining six recommendations have been started. The second set of five recommendations focused on Public Works having critical information available to inform management and decision making. All five recommendations under this finding have been started.
1 Rocky Road: Berkeley Streets at Risk and Significantly Underfunded https://berkeleyca.gov/sites/default/files/2022- 01/Rocky-Road-Berkeley-Streets-at-Risk-and-Significantly-Underfunded.pdf 2 Audit: Fleet Replacement Fund Short Millions: https://berkeleyca.gov/sites/default/files/2022-01/Fleet-Replacement- Fund-Short-Millions.pdf
Audit Status Reports - Fleet Replacement Fund Short Millions INFORMATION CALENDAR & Rocky Road: Berkeley Streets At Risk and Significantly Underfunded November 3, 2022
The attachment provides a detailed table of audit report recommendations, steps towards corrective action, and implementation updates. The next status report will be in May.
BACKGROUND
Public Works’ Engineering Division is responsible for capital projects to maintain over 216 centerline miles of streets in Berkeley, while the Streets & Utilities Division handles day-to-day maintenance of those streets. Public Works’ Equipment Maintenance Division manages the maintenance, purchase, and replacement of the City’s 730 fleet vehicles, heavy duty trucks and large equipment, including public safety, fire, and alternative fuel vehicles and equipment. Public Works’ Administrative and Fiscal Services Division is responsible for the Department’s budget and fiscal oversight, regulatory compliance and reporting, and analytical support for routine and special projects in all Public Works operating divisions.
ENVIRONMENTAL SUSTAINABILITY AND CLIMATE IMPACTS
Public Works replaces vehicles with alternative fuel, hybrid and electric vehicles whenever possible given availability of fleet technology, available budget and charging infrastructure. Streets that are improved to benefit all users help encourage more bicycling and walking, which lowers greenhouse gas emissions. Streets that are improved to include green infrastructure help reduce pollution and clean stormwater before it reaches the Bay.
POSSIBLE FUTURE ACTION
Public Works will continue to address the remaining three partially implemented recommendations in the Streets Audit and the twelve started and partially implemented recommendations in Fleet Audit.
FISCAL IMPACTS OF POSSIBLE FUTURE ACTION
In the biennial budget adoption for FY 2023 and FY 2024, the City Council allocated an increase of $5,000,000 (FY2023) and $9,100,000 (FY2024) to street paving in the Capital Improvement Fund. The Council also passed a funding guideline to approve an $8,000,000 increase in future fiscal years. This funding is intended to raise paving funding to levels sufficient to maintain current pavement conditions. The Measure L Bond Measure, if approved by Berkeley voters on November 8, 2022, would raise $300,000,000 towards street and traffic safety improvements, including improvements that advance bicycle and pedestrian use and safety. Project funding would be allocated over several years to raise the pavement condition index (PCI) to 70 or above, which is a “Good” status.
CONTACT PERSON
Sean O’Shea, Administrative & Fiscal Services Manager (510) 981-6306 Joe Enke, Manager of Engineering (510) 981-6411
Greg Ellington, Equipment Management Superintendent (510) 981-9469
Audit Status Reports - Fleet Replacement Fund Short Millions INFORMATION CALENDAR & Rocky Road: Berkeley Streets At Risk and Significantly Underfunded November 3, 2022
Attachment:
1. Audit Findings and Recommendations Response Report – Streets
2. Audit Findings and Recommendations Response Report - Fleet
Audit Title: Rocky Road: Berkeley Streets at Risk and Significantly Underfunded Finding Recommendation Lead
Department
Expected or
Actual
Implementation
Date
Status of Audit Recommendations,
Corrective Action Plan, and Progress
Summary
Without significant
additional funding,
Berkeley streets will
continue to deteriorate
and deferred maintenance
costs will increase.
1.1 Annually, conduct a budget
analysis, based on the
deferred maintenance needs
at that point in time, to
determine what level of
funding is necessary to
achieve the desired goals of
the Street Rehabilitation
Program. Report findings to
City Council. This information
will be helpful during updates
to the Five-Year Street
Rehabilitation Plan and during
the budgeting process.
Public
Works
Ongoing Partly Implemented:
The City received a PTAP grant to fund a
consultant (PEI) to survey the entire City's
paving condition. The consultant's report is
pending. The newly adopted Street Rehab
policy says that the City will conduct funding
sufficiency analysis based on existing
deferred maintenance. This analysis will be
included as part of the biannual Paving Plan
adoption. Public Works will propose a budget
as part of the biannual CIP adoption to
address the paving needs, based on available
resources, and will present any funding
shortfalls to the Council.
Without significant
additional funding,
Berkeley streets will
continue to deteriorate
and deferred maintenance
costs will increase.
1.2 Identify funding sources to
achieve and maintain the
goals of the Street
Rehabilitation Program.
Public
Works
Ongoing Partly Implemented:
Funding sources for street improvement are
identified in the Capital Improvement
Program budget. The City Council also
approved a ballot measure for the November
2022 ballot which if passed, will provide up to
$300,000,000 to improve Berkeley’s streets,
sidewalks and bike and ped infrastructure.
Approximately $230 million would be
allocated to Street Rehabilitation and Repair.
The Streets Rehabilitation
and Repair Policy is out-of-
date and Public Works is
not following it.
2.1 Update the Street
Rehabilitation and Repair
Policy annually and define
who is responsible for
ensuring the Policy is updated,
as stated in the Policy.
Public
Works
January 2022 Implemented:
Public Works Commission approved a Street
Rehabilitation and Repair Policy March, 2021,
which was received and revised after
consideration at the FITES Commission in
May 2021, and ultimately adopted by City
Council on January 25, 2022. The Policy and
Five Year Paving Plan were considered and
adopted on the same Council agenda. The
Street and Maintenance Policy shall be
adopted by City Council at a minimum
interval of 5 years, after review by the
Transportation and Infrastructure
Commission.
The Streets Rehabilitation
and Repair Policy is out-of-
date and Public Works is
not following it.
2.2 When updating the Street
Rehabilitation and Repair
Policy, incorporate equity to
align with Vision 2050 and
clearly define how it will be
applied to the street
maintenance and
rehabilitation planning
process.
Public
Works
January 2022 Implemented:
The updated Street Rehabilitation and Repair
Policy was adopted with clear language
placing Equity as an objective: "The benefits
of good infrastructure shall be distributed
equally throughout the entire community
regardless of income, political influence, or
demographic characteristics of the residents
in the area. Equity means that disadvantaged
residents with more pressing needs
experience benefits sooner than others, as
defined by the City within the adopted Five
Year Plan." The policy also calls for the
designation of an Equity Zone, serving
neighborhoods with historic
underinvestment, which is to be prioritized to
achieve the PCI goals of 70 sooner than the
remainder of the City.
The Streets Rehabilitation
and Repair Policy is out-of-
date and Public Works is
not following it.
2.3 Define goals and performance
measures to guide the Street
Rehabilitation and Repair
Policy and Street
Rehabilitation Program that
align with other plans and
policies relevant to street
paving (e.g., Complete Streets
Policy, Vision 2050, etc.).
Regularly report to Council on
performance measures.
Public
Works
January 2022 Implemented:
Performance Metrics are included as a major
part of the adopted Specific Policy. Key areas:
1) The goal is to get to standard PCI of 70 for
roadways: Arterials, Collectors, Bus Routes,
Bikeway Network, and Equity Zone. 2)
Funding should be prioritized with Equity in
mind 3) Performance metrics reporting will
be included with the biannual Paving Plan
review.
Audit Title: Fleet Replacement Fund Short Millions
Finding Recommendation Lead
Department
Expected or
Actual
Implementation
Date
Status of Audit Recommendations,
Corrective Action Plan, and Progress
Summary
The Replacement
Fund is underfunded
by millions of dollars.
1.1 Calculate the dollar value of the
City’s replacement needs. Use
results from the recent rate study
to adjust departments’
replacement fees to cover their
share of the costs associated with
vehicle replacement, including
customization and personnel.
Public
Works
Ongoing Partly Implemented:
The current fleet replacements costs
have been updated in FUND$ Fleet
Management System to include all costs,
and have been reflected in the FY 23 &
FY 24 Operating budget and the five year
replacement schedule communicated in
the FY 23-27 CIP.
The Replacement
Fund is underfunded
by millions of dollars.
1.2 Conduct an analysis of the City’s
current fleet and determine the
optimal fleet size to provide
services efficiently and
effectively. This analysis should
include fleet units identified as
reserve,
backup, and “pool” vehicles. The
outcome of the analysis should be
a plan to achieve and provide
funding for the optimal fleet size.
Public
Works
February - May
2023
Started:
Staff issued an RFP to analyze its fleet
and received two solicitations. Public
Works has selected Mercury Associates
to be the consultant to lead the study.
The Replacement
Fund is underfunded
by millions of dollars.
1.3 Work with the City Manager’s
Office to adjust the funding
model of the Equipment
Replacement
Fund or adopt a new one to
ensure appropriate funding for
timely fleet replacement, such as
annually transferring money from
the General Fund based on an
assessment of the City’s overall
fleet needs and priorities. Expand
the current vehicle and
equipment replacement
policy to ensure transparency of
key provisions of the new or
updated model.
Public
Works
Ongoing Started:
Public Works presented an Equipment
Replacement Fund deficit reduction
proposal in its departmental budget
presentation to the Budget & Finance
Policy Committee and in submittals for
General Fund consideration to the City
Manager. While not funded in FY 23/24,
the department will keep monitoring the
fund health and make funding proposals
in future budget development cycles.
The Replacement
Fund is underfunded
by millions of dollars.
1.4 Revise the vehicle and equipment
replacement policy to include
that Public Works should
regularly assess the personnel
expenditures related to vehicle
and equipment replacement and
ensure that they are appropriate
and proportional to their duties.
Public
Works
Ongoing Started:
Draft policy has been updated and is
going through final departmental review.
The Replacement
Fund is underfunded
by millions of dollars.
1.5 Revise the vehicle and equipment
replacement policy to prevent
replacing unfunded vehicles by
ensuring that contributed funds
are available for the purchase.
Public
Works
Ongoing Started:
Draft policy has been updated and is
going through final departmental review.
The Replacement
Fund is underfunded
by millions of dollars.
1.6 Develop an Administrative
Regulation that clarifies Public
Works’ responsibilities to manage
the fleet and maintain sufficient
fleet replacement funding.
Public
Works
Ongoing Started:
The department has drafted a policy document to
use instead of an AR.
The Replacement
Fund is underfunded
by millions of dollars.
1.7 To help secure the funding
needed for transitioning to
electric vehicles by 2030, work
with the City Manager’s Office to
develop a budgetary plan to
purchase electric vehicles. The
plan should align with the City’s
fleet electrification goals and take
into consideration the current
economic downturn, funding
availability, available
infrastructure, and electric
vehicle availability.
Public
Works
Ongoing Started:
EV purchases for FY 23-24 have been
outlined in the budget. A budgetary plan
for transitioning to EVs by 2030 is not yet
available.
Public Works lacks
information on
vehicle and
equipment
replacement for
decision making.
2.1 Conduct a needs assessment of
vehicles overdue for replacement
and create a plan that documents
a timeline and cost for
replacement. Report the findings
to City Council.
Public
Works
Ongoing Started:
Backlog vehicles to be purchased have
been included in the FY 23-24 budget,
though a formal needs assessment has
not been completed.
Public Works lacks
information on
vehicle and
equipment
replacement for
decision making.
2.2 Update the vehicle and
equipment replacement policy to
include criteria for prioritizing
fleet replacement. The policy
should include a requirement to
communicate a delay in
replacement of their fleet to
affected departments. In
Administrative Regulation
described in recommendation
1.6, specify that the vehicle and
equipment replacement policy
should include
such criteria.
Public
Works
Ongoing Started:
Policy update is in draft form and awaits
final approval.
Public Works lacks
information on
vehicle and
equipment
replacement for
decision making.
2.3 Work with the vendor of the new
fleet management system to
configure it to address the data
issues identified in this report,
including:
• Tracking Replacement Funds
collected and leftover funds by
department;
• Zeroing out the balance after a
vehicle is replaced;
• Adjusting the replacement date
and reporting the rationale if a
replacement is deferred;
and
• Displaying any information
needed to prioritize replacements
based on specified criteria.
Public
Works
December 2022 Started:
Data issues have been presented to the
vendor/project management team,
though the new data system has not yet
been implemented.
Public Works lacks
information on
vehicle and
equipment
replacement for
decision making.
2.4 Clean and update the vehicle and
equipment database before
migrating it to the new fleet
management system to ensure
accuracy and data integrity.
Public
Works
December 2022 Started:
Data cleanup is underway however the
Assetworks implementation is behind
schedule and the go-live date is planned
for the future.
Public Works lacks
information on
vehicle and
equipment
replacement for
decision making.
2.5 Update the vehicle and
equipment replacement policy or
develop a separate policy to
require staff manage the City’s
data appropriately to ensure
accurate complete information to
support
management decisions.
Public
Works
Ongoing Started:
Policy update is in draft form and awaits
final approval.
Office of the City Manager
2180 Milvia Street, Berkeley, CA 94704 ● Tel: (510) 981-7000 ● TDD: (510) 981-6903 ● Fax: (510) 981-7099 E-Mail: [email protected] Website: http://www.CityofBerkeley.info/Manager
INFORMATION CALENDAR
November 3, 2022
To: Honorable Mayor and Members of the City Council
From: Dee Williams-Ridley, City Manager
Submitted by: Jennifer Louis, Interim Chief of Police
Subject: Audit Recommendation Status - Data Analysis of the City of Berkeley’s Police Response
CURRENT SITUATION AND ITS EFFECTS
The City Auditor’s report included 2 recommendations. One of the recommendations has been implemented and one of the recommendations is partly implemented. The next status update report will be in 6 months.
BACKGROUND
On July 2, 2021, the City Auditor’s Office issued its audit, Data Analysis of the City of Berkeley’s Police1 This audit report included 2 recommendations. The purpose of this report is to update the City Council on the Police Department’s progress on implementing the City Auditor’s recommendations. This is the first status report for this audit.
ENVIRONMENTAL SUSTAINABILITY AND CLIMATE IMPACTS
There are no identifiable environmental effects, climate impacts, or sustainability opportunities associated with the subject of this report.
FISCAL IMPLICATIONS
Costs are not yet known and will depend on yet to be determined contracts and other factors including staff time.
CONTACT PERSON
Captain Kevin Schofield, Police Department, (510) 981-5815 Attachment:
1. Audit Findings and Recommendations Response Report
1 City Auditor’s Office Data Analysis Audit (7/2/2021)
https://berkeleyca.gov/sites/default/files/2022-01/Data-Analysis-Berkeley-Police-Response.pdf
Audit Title: Data Analysis of Berkeley's Police Response Finding Lead
Depart
ment
Expected or
Actual
Implement
ation Date
Status of Audit Recommendations, Corrective Action Plan, and Progress Summary
The City can improve
the transparency of
Police Department
activity data on the
Open Data Portal.
1.1 To improve access to data,
we recommend the
Berkeley Police
Department make calls for
service data available on
the City’s Open Data Portal
for all call types allowable
by Berkeley Police
Department policy and
law, and update regularly
to facilitate transparency.
This data should be
published in machine
ready format, and contain
as many years of data as is
available.
Police Ongoing Status: Partly Implemented
The outside vendor assigned to this project, GTG, is still working with staff to implement the recommended solutions. As of August 12, 2022, the project is over 80% completed. This is the most recent update from the vendor:
ITEMS THAT ARE COMPLETED:
Police Department ArcGIS Hub
•AGOL Access provided
•ArcGIS Hub design and configuraƟon
oMet with Berkeley PD and will proceed with adding a new page to the existing PD Transparency Hub rather than building a whole new Hub site
oOpen Data configuraƟon to replace Socrata
•AddiƟon of web applicaƟons to Hub
Crime Mapping solution replacement
•SQL Query Update
•VerificaƟon of GIS data update from SQL
oBerkeley to create enterprise geodatabase
oUpdate to include addiƟonal fields from CAD export
•Deployment of scheduled scripts
oUpdated script to accommodate new CAD fields in export
•Publishing GIS data
oAwaiƟng necessary access from City of Berkeley to publish GIS data to the ArcGIS Server
Recommendation
• Dev
elopment of Berkeley Crime Viewer application Parcel Condition Widget
• Rebuild widget in ArcGIS Online
o Develop new GIS web application to replace the current ‘Portal’ o Rebuild custom widget in AGOL using COTS tools and Arcade expressions, rather than custom code
• Provide new web application to City of Berkeley for website and Hub • Update application reference once PROD server has been upgraded to 10.9 City-wide ArcGIS Hub
• Provided spreadsheet for content
ITEMS STILL A WORK IN PROGRESS:
• Spreadsheet filled out with Berkeley content to include in the Hub o Applications
o Open Data Layers
o Other Hub links o External Links
• ArcGIS Hub site completed with all requested content, items, links, and materials Training
• Training on deployed GIS solutions
• Documentation on deployed GIS solutions
Berkeley Police
Department can
better track mental
health and
homelessness calls.
2.1 To improve access to data,
we recommend the
Berkeley Police
Department identify all
calls for service where
there is an apparent
mental health issue and/or
homelessness component
in a manner that protects
the privacy rights of the
individuals involved.
Police 6/29/2022 Status: Implemented
Starting July 1, 2021, the department formally began utilizing “H” homeless and “MH” mental health disposition codes when closing out any call involving a homeless person or a person with mental health issues. Officers were instructed that they were not required to ask people what their housing status is unless necessary for identification purposes. Unless there are mental health issues which are related to the call, they are not required to ask them what their mental health status is either. Officers are expected to use their best judgement / perception in determining if a call is related to a homeless issue or someone suffering from a mental health issue. If so, they are directed to add the “H” and/or “MH” disposition to the CAD disposition.
Police Department
INFORMATION CALENDAR
November 3, 2022
To: Honorable Mayor and Members of the City Council
From: Dee Williams-Ridley, City Manager
Submitted by: Jennifer Louis, Interim Chief of Police
Subject: Audit Recommendation Status – 911 Dispatchers: Understaffing Leads to Excessive Overtime and Low Morale
CURRENT SITUATION AND ITS EFFECTS
The City Auditor’s report included 14 recommendations. As of this report, 11 recommendations have been implemented, 1 was dropped (in consultation with the Auditors Office) and 2 are partly implemented. Please see attachment for further details regarding individual recommendations.
BACKGROUND
On April 25, 2019, the City Auditor’s Office issued its audit, 911 Dispatchers: Understaffing Leads to Excessive Overtime and Low Morale1. This audit report included 14 recommendations. The purpose of this report is to update City Council on the Berkeley Police Department’s (BPD) progress on implementing the City Auditor’s recommendations. This is the 2nd status update report to City Council with the next update planned for May 2023.
ENVIRONMENTAL SUSTAINABILITY AND CLIMATE IMPACTS
There are no identifiable environmental effects, climate impacts, or sustainability opportunities associated with the subject of this report.
FINANCIAL IMPLICATIONS
Associated costs will depend on the outcome of the recommendations. That work is in progress and nearly completed.
CONTACT PERSON
Captain Kevin Schofield, 510-981-5815.
1 City Auditor’s Office Dispatcher Audit (04/25/19) https://berkeleyca.gov/sites/default/files/2022- 01/Dispatch-%20Workload-Fiscal-%20Year-2018.pdf
Finding Recommendation Lead
Departme
nt
Expected or
Actual
Implementa
tion Date
Status of Audit Recommendations, Corrective Action Plan, and Progress Summary
It is taking longer to
answer 911 calls and
there are not enough
call takers.
1.1 Conduct an annual staffing analysis of required
minimum staffing levels and budgeted dispatchers to
ensure budget staffing requests and scheduling efforts
meet demand and limit the use of overtime where
possible (see also Finding 2). Use the staffing analysis to communicate to Council and the public during the
annual appropriations process:
• Service level demands
• The full-burdened cost of budgeting for additional
staff
• Whether there is sufficient funding available to
budget for the additional staff or a shortfall
(quantified in dollars)
• Additional staffing requests, if needed
Police 5/10/2022 Status: Implemented
Current employees continue to be staffed during days and times that mirror call volume reports (ECats). Data on service level demands continues to be reviewed monthly. Current budget does not support additional staff, however analysis of overtime expenditures was conducted as part of Call Taker recommendation. This revealed that additional positions could be funding via overtime savings.
It is taking longer to
answer 911 calls and
there are not enough
call takers.
1.2 Use the staffing analysis performed in response to
recommendation 1.1, to determine future resource
needs of the Communications Center, including
staffing, equipment, and physical space. Take into
account planned changes to services and factors that
may influence call volume.
Police Ongoing Status: Partly Implemented
A part of Measure FF passed in 2021 provided additional funding to improve Berkeley's 9-1-1 dispatch system and implement an accredited priority dispatching and emergency medical dispatching program. The Fire Department contracted with Federal Engineering to conduct an analysis of the staffing, infrastructure, and technology needs of the Communications Center to implement these programs. Analysis work began in February 2022. The consultant's report is pending.
Audit Title: 911 Dispatchers: Understaffing Leads to Excessive Overtime and Low Morale
The Co
mmunications
Center relies on
significant overtime
leading to inadequate
training and an
unhealthy work
environment.
2.1 Open all dispatcher positions to continuous
recruitment.
Police 6/29/2022 Status: Implemented
In June of 2022 Human Resources changed the Public Safety Dispatcher I position to open and continuous hiring.
The Communications
Center relies on
significant overtime
leading to inadequate
training and an
unhealthy work
environment.
2.2 Work with Communications Center staff to create a
specific recruitment plan for dispatcher positions
including recruitment events and marketing material.
Use recruitment best practices to reach potential
applicants and increase the number of applicants.
Police 5/10/2022 Status: Implemented
Recruitment and Retention Team continues to actively recruit and implement new strategies for reaching a diverse and broad group of Communications Center applicants.
Communications Center personnel have been included in
recruitment materials, interview processes, applicant “sit alongs”, and applicant outreach. On September 24, 2019 BPD launched a recruitment-specific website,
www.joinberkeleypd.com, and accompanying social media
accounts all specifically designed for BPD by an experienced marketing firm. This included recruitment videos, language, and images specifically targeting potential Communications Center applicants.
BPD implemented a program (“Text bpdjobs to (510) 399-
1814) that leads applicants through immediate response text conversations where recruiters can gather information on applicants quickly and efficiently, and applicants can be provided testing and job information.
Another new strategy implemented during the most recent recruitment period included advertising on a worldwide
employment related search engine (indeed.com). One of the Supervising Public Safety Dispatchers personally contacted the more than 600 applicants once the application period was open to inform them of such and to provide them with POST test preparation materials and other test information. She also coordinated sit-alongs with those interested in doing so.
The Co
mmunications
Center relies on
significant overtime
leading to inadequate
training and an
unhealthy work
environment.
2.3 Identify and implement feasible option to improve
turnaround time on background checks for dispatcher
positions. This can include outsourcing background
investigations or working with Human Resources to
ensure that the Department is able to complete all
background investigations in a timely manner.
Police 5/10/2022 Status: Implemented
Two independent background investigation firms are working with BPD to complete backgrounds. Turn-around times have met promised delivery dates, with most being completed
within a month. This has relieved pressure on internal
background investigators and significantly shortened the time from application period to job offer. Data is being collected and reviewed regularly regarding turn-around times. This current pace will allow BPD to remain swift and competitive while hiring quality applicants and also ensure that we can hold multiple recruitment periods in a single year.
The Co
mmunications
Center relies on
significant overtime
leading to inadequate
training and an
unhealthy work
environment.
2.4 Design a way to retain staff that are unable to pass the Police Desk training, for example, keep staff as PSD I
and have them work as a call taker or create a new job
classification for a call taking position.
Police 5/10/2022 Status: Dropped
Call Taker proposal written and subsequently approved by the Chief. Initial meeting held with affected bargaining unit and Human Resources. Union voiced concerns about separating job duties within the Communications Center and the Call Taker position being misused. Next steps include Human Resources reviewing job classification and conducting comp survey, followed by BPD and HR meeting again with the union. Union is considering submitting counter proposal to Call Taker position, to possibly rewrite trainees. It became clear that the majority of those failing the training program were failing due to inability to pass call taking, and that the call taking training was often extending over six months. The most recent trainee who failed due to inability to pass Police Desk who would have been qualified to work in the Call Taker position was in 2011.
A determination was made to focus on improving the training program for Call Taker training (and overall training program) to increase the success rate for trainees moving from PSD I to PSD II. This would also alleviate the Union’s stated concerns.
Additionally, BPD will conduct a review of both the training program as well as the feasibility/benefit of moving forward with a Call Taker position at the next Audit Status Update.
The Communications
Center relies on
significant overtime
leading to inadequate
training and an
unhealthy work
environment.
2.5 Evaluate the results from dispatcher recruitment
routinely (e.g., annually or at the end of a recruitment cycle) to determine areas for improvement. Update
recruitment plans.
Police 5/10/2022 Status: Implemented
Personnel and Training, working in conjunction with the Communications Center, now tracks applicant progress
through the recruitment, testing, hiring and training process.
Data collected includes information regarding where the applicant/employee was “lost” and what steps are in place or required to allow the applicant (or future
applicants) to successfully move forward in the process. Data is reviewed at each stage, and at the end of each cycle will be assessed for effectiveness.
The Co
mmunications
Center relies on
significant overtime
leading to inadequate
training and an
unhealthy work
environment.
2.6 Implement an automated scheduling software that has built-in decision-making capabilities to automatically
fill shifts based on specified qualifications and staff availability.
Police Ongoing Status: Partly Implemented
Care Systems Inc. was selected and approved by City Council on May 24, 2022 for an electronic scheduling solution.
Contract completion is pending. The system integrates
scheduling and overtime management.
The Communications
Center relies on
significant overtime
leading to inadequate
training and an
unhealthy work
environment.
2.7 Decrease the concentration of overtime among
dispatchers.
Police 7/1/2022 Status: Implemented
Since the last update we have successfully promoted 3 Public Safety Dispatcher II employees. Currently there are 2 Public Safety Dispatcher I employees in training. In April 2021 we implemented the use of Google Sheets (Drive) where all shifts and overtime are readily viewable and signup is done online.
Minimum mandatory overtime hours are set for each
Dispatcher per week for equity. Voluntary overtime signup is completed in stages in order to distribute overtime equitably between all Dispatchers. Trainees who have passed Call
Taking, Fire Desk, or Records desk are able to assist and work overtime on select desks as needed. On May 25, 2022 City Council approved the hiring of Care Systems Inc. for an electronic staffing solution for the police department. The system integrates scheduling and provides timely and accurate information on overtime usage and an approval process.
Recruitment and hiring for Public Safety Dispatchers (PSD) is now open and continuous. Overtime expenditure for the
Communications Center from fiscal year 2019 through 2021 trended downward.
The Co
mmunications
Center relies on
significant overtime
leading to inadequate
training and an
unhealthy work
environment.
2.8 Develop and implement a Communications Center
training plan to ensure compliance with POST training
requirements. Evaluate training processes and update
training plans routinely.
Police 5/10/2022 Status: Implemented
Communications Center leadership, in partnership with
Personnel and Training, now monitor training hour progress annually (tied to PARs) and quarterly with a goal of training hours being completed throughout the training cycle. At the third quarter of year one of the two year cycle,
Communications Center personnel have surpassed training hours that were accomplished near the end of the last two year cycle. Plan implemented to approve a minimum of two Communications Center personnel to training each month, and complete at least two hours of online training as well.
In an effort to also improve morale and overall health, focus has been placed completing training hours in classes that provide employee wellness and development.
Working conditions
adversely affect
dispatcher morale.
3.1 Create a comprehensive stress management program
specifically for the Communications Center that
includes the following:
- Stress management training for all staff, 8 hours
minimum during career
- Access to on-site educational resources to help with
stress and related risks, e.g., directory of local
therapists specializing in treatment of stress and
traumatic stress disorders and City programs that
provide information on how and where to access help
- Procedures assuring participation of staff in critical incidence stress management activities (e.g.,
debriefing sessions when involved in traumatic call
events)
- A Peer Support Program
- Comprehensive, ongoing training on structured call-
taking processes
Police 5/10/2022 Status: Implemented
Multiple courses and online learning materials related to Communications Center/dispatcher stress management have been identified. Communications Center personnel have
begun attending this course (goal set of at least two
Communications Center personnel attending a class per
month) and the department will continue to provide these training opportunities. BPD as a whole continues to
aggressively work on improving the overall wellness and improving stress management skills of personnel. All
employees have access to a meditation app to support stress reduction, and have access to a fully-equipped gym in the building.
Work
ing conditions
adversely affect
dispatcher morale.
3.2 Develop and implement plans to address workplace
cleanliness and equipment and furniture maintenance
and replacement.
Police 5/10/2022 Status: Implemented
BPD has implemented a quarterly deep-cleaning schedule.
After reviewing the current Hepa filters, it was determined that purchasing new individual filters for each console was not financially prudent, as we have already identified that the existing console must be replaced within the next year. BPD purchased and will install two wall mounted Hepa filters that can work in conjunction with existing (or replacement systems) and are relocatable once a new
location /expansion is decided. Additionally, the carpet was replaced in the last 8 years with a low pile, sound reduction carpet that consisted of individual squares so that
dirty/stained or otherwise worn areas or squares could be switched out. Replacement timeline for that product is being monitored. Further, the individual console chairs are regularly replaced and over the last several years we have worked with the COB Occupational Health and Safety Specialist to purchase chairs to conform to the specific ergonomic needs of individual dispatchers.
Working conditions
adversely affect
dispatcher morale.
3.3 Conduct regular supervisor level meetings to share
information about operations and staffing. Use these
meetings to improve understanding of the supervisor
role, identify problems, discuss changes that may
affect operations, and establish communications plans
for distributing information to all staff.
Police 5/10/2022 Status: Implemented
The Communications Manager and supervisor group now
conduct formal weekly supervisor level meetings as well as informal group discussions regarding operational needs, project updates and current issues that need addressing.
Information from these meetings is shared out to the entire Communications Center via email from the manager or
Lieutenant.
Working conditions
adversely affect
dispatcher morale.
3.4 Routinely have Police and Fire staff meet with all
Center Supervisors to solicit feedback on Center
operations and to address any issues. Use these
meetings to improve understanding of the dispatcher
role and current policies of public safety, identify
problems that should be evaluated for further
discussion, and discuss known and expected changes
that may affect the Communications Center.
Police 5/10/2022 Status: Implemented
BFD attends the formal weekly meeting once a month, or
more frequently as needed. BFD and BPD leadership
conducted a topic specific meeting to discuss potential physical expansion needs, Emergency Medical Dispatching and the
opening of the Communications Center Manager position due to retirement.
Communications
All communications submitted to the City Council are
public record. Communications are not published directly to the City’s website. Copies of individual communications are available for viewing at the City Clerk Department and through Records Online.
City Clerk Department
2180 Milvia Street
Berkeley, CA 94704
(510) 981-6900
Records Online
https://records.cityofberkeley.info/
To search for communications associated with a particular City Council meeting using Records Online:
1. Select Search Type = “Public – Communication Query (Keywords)”
2. From Date: Enter the date of the Council meeting
3. To Date: Enter the date of the Council meeting (this may match the From Date field)
4. Click the “Search” button
5. Communication packets matching the entered criteria will be returned
6. Click the desired file in the Results column to view the document as a PDF