City Council - Successor Agency - Housing Authority
October 17, 2023

CITY OF FULLERTON

PROFESSIONAL SERVICES AGREEMENT
WITH

SYSTEMS INTEGRATED

THIS AGREEMENT is made and entered into this 18 th day of November , 2020 (“Effective Date”), by and between the CITY OF FULLERTON , a California municipal corporation (“City”), and Systems Integrated , a Limited Parternhip in the State of California (“Consultant”).

W I T N E S S E T H :

A. City proposes to utilize the services of Consultant as an independent contract or to provide SCADA Master Planning, Integration and Support Servi ces, as more fully described herein.

B. Consultant represents that it has that degree of specialized expertise contemplated wi thin California Government Code section 37103, and holds all necessary licenses to practice and perform the services herein contemplated.

C. City and Consultant desire to contract for the specific services described herein, and desire to set forth their rights, duties and liabilities in connection with t he services to be performed.

D. No official or employee of City has a financial interest, within the provisions of Sections 1090- 1092 of the California Government Code, in the subject matter of this Agreement.

NOW, THEREFORE, for and in consideration of the mutual covenants and conditions contained herein, the parties hereby agree as follows:

1.0. SERVICES PROVIDED BY CONSULTANT

1.1. Scope of Services. Consultant shall provide the professional services described in the City’s Request for Proposals (“RFP”), attached hereto as Exhibit “A,” and Consultant’s Response to City’s R FP (“Consultant’s Proposal”), attached hereto as Exhibit “B,” both incorporated herein by this reference.

1.2. Professional Practices. All professional services to be provided by Consultant pursuant to this Agreement shall be provided by personnel experienced in their respective fields and in a manner consistent with the standards of care, diligence and skill ordinarily exercised by professional consultants in similar fields and circumstances in accordance with sound professional practices. Consultant also warrants that it is familiar with all laws that may affect its performance of this Agreement and shall advise City of any changes in any laws that may affect Consultant’s performance of this Agreement.

1.3. Performance to Satisfaction of City . Consultant agrees to perform all the work to the reasonable satisfaction of the City , in accordance with the applicable professional standard of care and City specifications and within the hereinafter specified. Evaluations of the wor k will be done by the City Manager or his designee. If the quality of work is not satisfactory, City in its discretion has the right to:

(a) Meet with Consultant to review the quality of the work and resolve the Systems Integrated

matters of concern;

(b) Require Consultant to repeat the work at no addit ional fee until it is satisfactory; and/or

(c) Terminate the Agreement as hereinafter set forth.

1.4. Warranty. Consultant warrants that it shall perform the services required by this Agreement in compliance with all applicable and non conflicting Federal and California employment laws, including, but not limited to, those laws related to minimum hours and wages; occupational health and safety; fair employment and employment practices; workers’ compensation insurance and safety in employment; and all other Federal, State and local laws and ordinances applicable to the services required under this Agreement. Consultant shall indemnify and hold harmless City from and against all claims, demands, payments, suits, actions, proceedings, and judgments of every nature and description including attorneys’ fees and costs, presented, brought, or recovered against City for, or on account of any liability under any of the above- mentioned laws, which may be incurred by reason of Consultant’s performance under this Agreement.

1.5. Non-discrimination. In performing this Agreement, Consultant shall not engage in, nor permit its agents to engage in, discrimination in employ ment of persons because of their race, religion, color, national origin, ancestry, age, physical handicap, medical condition, marital status, sexual gender or sexual orientation, except as permitted pursuant to Section 12940 of the Government Code.

1.6. Non-Exclusive Agreement . Consultant acknowledges that City may enter into agreements with ot her consultants for services similar to the services that are subject to this Agreement or may have its own employees perform services similar to those services contemplated by this Agreement.

1.7. Delegation and Assignment. This is a personal service c ontract, and the duties set forth herein shall not be delegated or assigned to any person or entity without the prior written consent of City. Consultant may engage a subcontractor(s) as permitted by law and may employ other personnel to perform services contemplated by this Agreement at Consultant’s sole cost and expense.

1.8. Confidentiality. Employees of Consultant in the course of their duties may have access to financial, accounting, statistical, and personnel data of private individuals and employees of City. Consultant covenants that all data, documents, discussion, or other information developed or received by Consultant or provided for performance of this Agreement are deemed confidential and shall not be disclosed by Consultant without writt en authorization by City. City shall grant such authorization if disclosure is required by law. All City data shall be returned to City upon the termination of this Agreement. Consultant's covenant under this Section shall survive the termination of this Agreement.

2.0. COMPENSATION AND BILLING

2.1. Compensation. Consultant shall be paid in accordance with the fee schedule set forth in Exhibit C. Consultant’s total compensation for Task 1 (Master Plan) shall not exceed Eighty-Eight Thousand Eight Hundred Ninety Dollars ($ 88,890.00). Consultant’s compensation for Task 2 (Implementation of the Master Plan) shall be the subject of a separate agreement as Systems Integrated

provided in Section 2.2 herein. Consultant’s compensation for Task 3 (As-Needed Support Services) shall be billed on an hourly rate that is set forth in Exhibit C.

2.2. Additional Services . Consultant shall not receive compensation for Task 2 Services or any services provided outside the scope of services specified in the Consultant’s Proposal unless the City or the Project Manager for this Project, prior to Consultant performing the additional services, approves such additional services in writing. It is specifically understood that oral requests and/or approvals of such additional services or additional compensation shall be barred and are unenforceable.

2.3. Method of Billing . Consultant may submit invoices to the City for approval on a progress basis, but no more often than two times a month. Said invoice shall be based on the total of all Consultant’s services which have been completed to City’s sole satisfaction. City shall pay Consultant’s invoice within forty-five (45) days from the date City receives said invoice.

Each invoice shall describe in detail, the services performed , the date of performance, and the associated time for completion. Any additional services approved and performed pursuant to this Agreement shall be designated as “Additional Services” and shall identify the number of the authorized change order, where applicable, on all invoices.

2.4. Records and Audits. Records of Consultant’s services relating to this Agreement shall be maintained in accordance with generally recognized accounting principles and shall be made available to City or its Project Manager for inspection and/or audit at mutually convenient times from the Effective Date of this Agreement until three (3) years after the termination date.

2.5. W-9. Consultant must provide City with a current W -9 form, to be attached hereto as Exhibit “E .” It i s the Consultant’s responsibility to provide to the City any revised or updated W-9 form.

3.0. TIME OF PERFORMANCE

3.1. Commencement and Completion of Work . The professional services to be performed pursuant to this Agreement shall commence within five (5) days from the Effective Date of this Agreement. The professional services to be performed pursuant to this Agreement shall be completed in accordance with Exhibit A. Failure to commence work in a timely manner and/or diligently pursue work to completion may be grounds for termination of this Agreement.

3.2. Excusable Delays . Neither party shall be responsible for delays or lack of performance resulting from acts beyond the reasonable control of the party or parties. Such acts shall include, but not be limited to, acts of God, fire, strikes, material shortages, compliance with laws or regulations, riots, acts of war, or any other conditions beyond the reasonable control of a party.

4.0. TERM AND TERMINATION

4.1. Term. This Agreement shall commence on the Effective Date and continue through November 30, 2023 with an option to renew for two years with one year intervals unless terminated as provided herein.

4.2. Notice of Termination. The City reserves and has the right and privilege of canceling, suspending or abandoning the execution of all or any part of the work contemplated by this Agreement, with or without cause, at any time, by providing written notice to Consultant.

Systems Integrated

The termination of this Agreement shall be deemed effective upon rec eipt of the notice of termination. In the event of such termination, Consultant shall immediately stop rendering services under this Agreement unless directed otherwise by the City.

4.3. Compensation. In the event of termination, City shall pay Consult ant for reasonable costs incurred and professional services satisfactorily performed up to and including the date of City’s written notice of termination. Compensation for work in progress shall be prorated based on the percentage of work completed as of the effective date of termination in accordance with the fees set forth herein. In ascertaining the professional services actually rendered hereunder up to the effective date of termination of this Agreement, consideration shall be given to both completed work and work in progress, to complete and incomplete drawings, and to other documents pertaining to the services contemplated herein whether delivered to the City or in the possession of the Consultant.

4.4. Documents. In the event of termination of t his Agreement, all documents prepared by Consultant in its performance of this Agreement including, but not limited to, finished or unfinished design, development and construction documents, data studies, drawings, maps and reports, shall be delivered to t he City within ten (10) days of delivery of termination notice to Consultant, at no cost to City. Any use of uncompleted documents without specific written authorization from Consultant shall be at City's sole risk and without liability or legal expense to Consultant.

5.0. INSURANCE

5.1. Insurance Required. CONSULTANT shall procure and maintain throughout the duration of this Agreement, insurance against claims for injuries to persons or damages to property which may arise from or in connection with the performance of the work hereunder by the CONSULTANT, his agents, representatives, employees or subcontractors subject to the limitations of Civil Code Section 2782.8. CONSULTANT shall provide current evidence of the required insurance in a form acceptable to the CITY and shall provide replacement evidence for any required insurance which expires prior to the completion, expiration or termination of this Agreement.

Nothing in this section shall be construed as limiting in any way, the Indemnification and Hold Harmless clause contained herein in Section 6.8 or the extent to which CONSULTANT may be held responsible for payments of damages to persons or property.

5.2. Minimum Scope and Limits of Insurance.

A. Commercial General Liability Insurance. CONSULTANT shall maintain commercial general liability insurance coverage with a limit of not less than $2,000,000 each occurrence. If such insurance contains a general aggregate limit, it shall apply separately to the Agreement or shall be twice the required occurrence limit.

B. Business Automobile Liability Insurance. CONSULTANT shall maintain business automobile liability insurance coverage with a limit of not less than $2,000,000 each accident. Such insurance shall include coverage for owned, hired and non-owned automobiles.

C. Workers’ Compensation and Employers’ Liability Insurance. CONSULTANT shall maintain workers’ compensation insurance as required by the State of California and employers’ liability insurance with limits of not less than $1,000,000 each accident.

Systems Integrated

D. Professional Liability Insurance. CONSULTANT shall maintain professional liability insurance appropriate to CONSULTANT’s profession with a limit of not less than $2,000,000. Architects’ and engineers’ coverage shall be endorsed to include contractual liability. . If policy is written as a “claims made” policy, the retro date of the policy shall be prior to the start of the contract work.

5.3. Deductibles and Self -Insured Retentions . Any deductible or self -insured retention must be declared to and approved by the CITY.

5.4. Other Insurance Provisions. The required insurance policies shall contain or be endorsed to contain the following provisions:

A. Commercial General Liability. The CITY, its elected or appointed officials, officers, employees and volunteers are to be covered as additional insureds with respect to liability arising out of work or operations performed by or on behalf of CONSULTANT, including materials, parts or equipment furnished in connection with such work or operations. Coverage shall not extend to any indemnity coverage for the active negligence of the additional insured in any case where an agreement to indemnify the additional insured would be invalid under Civil Code Section 2782.8. Such coverage as an additional insured shall not be limited to the period of time during which the CONSULTANT is conducting ongoing operations for the CITY but rather, shall continue after the completion of such operations. The coverage shall contain no additional special limitations, outside standard coverage exclusions and coverage limits, on the scope of its protection afforded to the CITY, its officers, employees and volunteers.

B. Commercial General Liability. This insurance shall be primary insurance as respects the CITY, its officers, employees and volunteers and shall apply separately to each insured against whom a suit is brought or a claim is made. Any insurance or self -insurance maintained by the CITY, its officers, employees and designated volunteers shall be excess of this insurance and shall not contribute with it.

C. Workers’ Compensation and Employers’ Liability Insurance. Insurer shall waive their right of subrogation against CITY, its officers, employees and volunteers for work done on behalf of the CITY.

D. All Coverages. Each insurance pol icy required by this clause shall be endorsed to state that coverage shall not be canceled, except after thirty (30) days’ prior written notice by certified mail, return receipt requested, has been given to the CITY.

If the CONSULTANT maintains higher limits or has broader coverage than the minimums shown above, the CITY requires and shall be entitled to all coverage, and to the higher limits maintained by the CONSULTANT. Any available insurance proceeds in excess of the specified minimum limits of insurance and coverage shall be available to the CITY.

E. Subcontractors. CONSULTANT shall require and verify that all subcontractors maintain insurance meeting all the requirements stated herein and CONSULTANT shall ensure that CITY is an additional insured on insurance required from subcontractors.

F. Special Risks or Circumstances. CITY reserves the right to modify these requirements, including limits, based on the nature of the risk, prior experience, insurer, coverage or other special circumstances.

Systems Integrated

5.5 Acceptability of Insurers . All required insurance shall be placed with insurers acceptable to the CITY with current BEST’S ratings of no less than A, Class VII. Workers’ compensation insurance may be placed with the California State Compensation Insurance Fund. All insurers shall be licensed by or hold admitted status in the State of California. At the sole discretion of the CITY, insurance provided by non- admitted or surplus carriers with a minimum BEST’S rating of no less than A - Class X may be accepted if CONSULTANT evidences the requisite need to the sole satisfaction of the CITY.

5.6 Verification of Coverage. CONSULTANT shall furnish the CITY with certificates of insurance which bear original signatures of authorized agents and which reflect insur ers names and addresses, policy numbers, coverage, limits, deductibles and self -insured retentions. Additionally, CONSULTANT shall furnish certified copies of all policy endorsements required herein. All certificates and endorsements must be received and approved by CITY before work commences. The CITY reserves the right to require at any time complete, certified copies of any or all required insurance policies and endorsements.

6.0. GENERAL PROVISIONS

6.1. Entire Agreement. This Agreement constitutes the entire agreement between the parties with respect to any matter referenced herein and supersedes any and all other prior writings and oral negotia tions. This Agreement may be modified only in writing, and signed by the parties in interest at the time of such modification. The terms of this Agreement shall prevail over any inconsistent provision in any other contract document appurtenant hereto, including exhibits to this Agreement.

6.2. Representatives. The City Manager or his designee shall be the representative of City for purposes of this Agreement and may issue all consents, approvals, directives and agreements on behalf of the City, called for by this Agreement, except as otherwise expressly provided in this Agreement.

Consultant shall designate a representative for purposes of this Agreement who shall be authorized to issue all consents, approvals, directives and agreements on behalf of Consultant called for by this Agreement, except as otherwise expressly provided in this Agreement.

6.3. Project Managers. City shall designate a Project Manager to work directly with Consultant in the performance of this Agreement.

Consultant shall designate a Project Manager who shall represent it and be its agent in all consultations with City during the term of this Agreement. Consultant or its Project Manager shall attend and assist in all coordination meetings called by City.

6.4. Notices. Any notices, documents, correspondence or other communications concerning this Agreement or the work hereunder may be provided by personal delivery, facsimile or mail and shall be addressed as set forth below. Such communication shall be deemed served or delivered: a) at the time of delivery if such communication is sent by personal delivery; b) at the time o f transmission if such communication is sent by facsimile; and c) 48 hours after deposit in the U.S. Mail as reflected by the official U.S. postmark if such communication is sent through regular United States mail.

Systems Integrated

IF TO CONSULTANT:

IF TO CITY:

Systems Integrated
2200 North Glassell Street
Orange, CA 92865
Attn: Susan Corrales-Diaz
City of Fullerton
1580 W. Commonwealth Ave.

Fullerton, CA 92833
Attn: Dustin Ensminger

6.5. Attorneys’ Fees. In the event that litigation is brought by any party in connection with this Agreement, the prevailing party shall be entitled to recover from the opposing party all costs and expenses, including reasonable attorneys’ fees, incurred by the prevailing party in the exercise of any of its rights or remedi es hereunder or the enforcement of any of the terms, conditions, or provisions hereof.

6.6. Governing Law. This Agreement shall be governed by and construed under the laws of the State of California without giving effect to that body of laws pertaining to conflict of laws. In the event of any legal action to enforce or interpret this Agreement, the parties hereto agree that the sole and exclusive venue shall be a court of competent jurisdiction located in Orange County, California.

6.7. Assignment. Consultant shall not voluntarily or by operation of law assign, transfer, sublet or encumber all or any part of Consultant's interest in this Agreement without City's prior written consent. Any attempted assignment, transfer, subletting or encumbrance shall be void and shall constitute a breach of this Agreement and cause for termination of this Agreement. Regardless of City's consent, no subletting or assignment shall release Consultant of Consultant's obligation to perform all other obligations to be perf ormed by Consultant hereunder for the term of this Agreement.

6.8. Indemnification and Hold Harmless . To the fullest extent of the law, and consistent with Civil Code section 2782.8, Consultant agrees to defend, indemnify, hold free and harmless the Ci ty, its elected and appointed officials, officers, agents and employees, at Consultant’s sole expense, from and against any and all claims, demands, actions, suits or other legal proceedings brought against City, its elected and appointed officials, officers, agents, and employees to the extent arising out of, pertaining to, or relating to the negligence, recklessness, or willful misconduct of the Consultant, its employees, and/or authorized subcontractors, in performing design professional services pursuant to this Agreement. The defense obligation provided for hereunder shall apply without any advance showing of negligence, recklessness or willful misconduct of the Consultant, its employees, and/or authorized subcontractors, but shall be required whenever any claim, action, complaint, or suit asserts as its basis the negligence, recklessness, or willful misconduct of Consultant, its employees, and/or authorized subcontractors, and/or whenever any claim, action, complaint or suit asserts liability against the City, its elected and appointed officials, officers, agents , and employees based upon such negligence, recklessness, or willful misconduct, whether or not the Consultant, its employees, and/or authorized subcontractors are specifically named or otherwise asserted to be liable. Notwithstanding the foregoing, the Consultant shall not be liable for the defense or indemnification of the City for claims, actions, complaints or suits arising out of the sole or active negligence or willful misconduct of the C ity. Further, in no event shall the cost to Systems Integrated

defend charged to the design professional exceed the design professional’s proportionate percentage of fault, unless otherwise specified in Civil Code section 2782.8. This provision shall supersede and replace all other indemnity provisions contained either in the City’s specifications or Consultant’s Proposal, which shall be of no force and effect.

6.9. Independent Contractor . Consultant is and shall be acting at all times as an independent contractor and not as an employee of City. Consultant shall have no power to incur any debt, obligation, or liability on behalf of City or otherwise act on behalf of City as an agent. Neither City nor any of its agents shall have control over the conduct of Consultant or any of Consultant’s employees, except as set forth in this Agreement. Consultant shall not, at any time, or in any manner, represent that it or any of its or employees are in any manner agents or employees of City. Consultant shall secure, at its sole expense, and be responsible for any and all payment of Income Tax, Social Security, State Disability Insurance Compensation, Unemployment Compensation, and other payroll deductions for Consultant and its officers, agents, and employees, and all business licens es, if any are required, in connection with the services to be performed hereunder. Consultant shall indemnify and hold City harmless from any and all taxes, assessments, penalties, and interest asserted against City by reason of the independent contractor relationship created by this Agreement. Consultant further agrees to indemnify and hold City harmless from any failure of Consultant to comply with the applicable worker’s compensation laws. City shall have the right to offset against the amount of any fees due to Consultant under this Agreement any amount due to City from Consultant as a result of Consultant’s failure to promptly pay to City any reimbursement or indemnification arising under this paragraph.

6.10. PERS Eligibility Indemnification. In the event that Consultant or any employee, agent, or subcontractor of Consultant providing services under this Agreement claims or is determined by a court of competent jurisdiction or the California Public Employees Retirement System (PERS) to be eligible for enrollment in PERS as an employee of the City, Consultant shall indemnify, defend, and hold harmless City for the payment of any employee and/or employer contributions for PERS benefits on behalf of Consultant or its employees, agents, or subcontractors, as well as for the payment of any penalties and interest on such contributions, which would otherwise be the responsibility of City.

Notwithstanding any other agency, state or federal policy, rule, regulation, law or ordinance to the contrary, Consult ant and any of its employees, agents, and subcontractors providing service under this Agreement shall not qualify for or become entitled to, and hereby agree to waive any claims to, any compensation, benefit, or any incident of employment by City, including but not limited to eligibility to enroll in PERS as an employee of City and entitlement to any contribution to be paid by City for employer contribution and/or employee contributions for PERS benefits.

6.11. Cooperation. In the event any claim or action is brought against City relating to Consultant’s performance or services rendered under this Agreement, Consultant shall render any reasonable assistance and cooperation which City might require.

6.12. Ownership of Documents . All findings, reports, CAD drawings, documents, information and data, including, but not limited to, computer tapes or discs, files and tapes furnished or prepared by Consultant or any of its subcontractors in the course of performance of this Agreement, shall be and remain the sol e property of City. Consultant agrees that any such documents or information shall not be made available to any individual or organization without the prior consent of City. Any use of such documents for other projects not contemplated by Systems Integrated

this Agreement, and any use of incomplete documents, shall be at the sole risk of City and without liability or legal exposure to Consultant. City shall indemnify and hold harmless Consultant from all claims, damages, losses, and expenses, including attorneys’ fees, ari sing out of or resulting from City’s use of such documents for other projects not contemplated by this Agreement or use of incomplete documents furnished by Consultant. Consultant shall deliver to City any findings, reports, documents, information, data, in any form, including but not limited to, computer tapes, discs, files audio tapes or any other Project related items as requested by City or its authorized representative, at no additional cost to the City.

6.13. Public Records Act Disclosure. Consult ant has been advised and is aware that this Agreement and all reports, documents, information and data, including, but not limited to, computer tapes, discs or files furnished or prepared by Consultant, or any of its subcontractors, pursuant to this Agreement and provided to City may be subject to public disclosure as required by the California Public Records Act (California Government Code Section 6250 et seq.).

Exceptions to public disclosure may be those documents or information that qualify as trade secrets, as that term is defined in the California Government Code Section 6254.7, and of which Consultant informs City of such trade secret. The City will endeavor to maintain as confidential all information obtained by it that is designated as a trade secr et. The City shall not, in any way, be liable or responsible for the disclosure of any trade secret including, without limitation, those records so marked if disclosure is deemed to be required by law or by order of the Court.

6.14. Conflict of Interes t. Consultant and its officers, employees, associates and subconsultants, if any, will comply with all conflict of interest statutes of the State of California applicable to Consultant's services under this agreement, including, but not limited to, the Political Reform Act (Government Code Sections 81000, et seq.) and Government Code Section 1090. During the term of this Agreement, Consultant and its officers, employees, associates and subconsultants shall not, without the prior written approval of the Ci ty Representative, perform work for another person or entity for whom Consultant is not currently performing work that would require Consultant or one of its officers, employees, associates or subconsultants to abstain from a decision under this Agreement pursuant to a conflict of interest statute.

6.15. Responsibility for Errors. Consultant shall be responsible for its work under this Agreement. Consultant, when requested, shall furnish clarification and/or explanation as may be required by the City’s representative, regarding any services rendered under this Agreement at no additional cost to City. In the event that an error or omission attributable to Consultant occurs, without prejudice to any other remedy to which City may be entitled to at law or equity, Consultant shall, at no cost to City, provide all necessary design drawings, estimates and other Consultant professional services necessary to rectify and correct the matter to the sole satisfaction of City and to participate in any meeting requir ed with regard to the correction. In addition, Consultant shall reimburse City for any and all costs, expenses and/or damages, if any, that the City has incurred due to the aforementioned error or omission.

6.16. Prohibited Employment. Consultant will not employ any regular employee of City while this Agreement is in effect.

6.17. Order of Precedence. In the event of an inconsistency in this Agreement and any of the attached Exhibits, the terms set forth in this Agreement shall prevail . If, and to th e extent this Agreement incorporates by reference any provision of any document, such provision shall be deemed a part of this Agreement. Nevertheless, if there is any conflict among the terms and conditions of this Agreement and those of any such provisi on or provisions so Systems Integrated

incorporated by reference, this Agreement shall govern over the document referenced.

6.18. Costs. Each party shall bear its own costs and fees incurred in the preparation and negotiation of this Agreement and in the performance of its obligations hereunder except as expressly provided herein.

6.19. No Third Party Beneficiary Rights . This Agreement is entered into for the sole benefit of City and Consultant and no other parties are intended to be direct or incidental beneficiaries o f this Agreement and no third party shall have any right in, under or to this Agreement.

6.20. Headings. Paragraphs and subparagraph headings contained in this Agreement are included solely for convenience and are not intended to modify, explain or to be a full or accurate description of the content thereof and shall not in any way affect the meaning or interpretation of this Agreement.

6.21. Construction. The parties have participated jointly in the negotiation and drafting of this Agreement. In t he event an ambiguity or question of intent or interpretation arises with respect to this Agreement, this Agreement shall be construed as if drafted jointly by the parties and in accordance with its fair meaning. There shall be no presumption or burden of proof favoring or disfavoring any party by virtue of the authorship of any of the provisions of this Agreement.

6.22. Amendments . Only a writing executed by the parties hereto or their respective successors and assigns may amend this Agreement.

6.23. Waiver. The delay or failure of either party at any time to require performance or compliance by the other of any of its obligations or agreements shall in no way be deemed a waiver of those rights to require such performance or compliance. No waiver of any provision of this Agreement shall be effective unless in writing and signed by a duly authorized representative of the party against whom enforcement of a waiver is sought. The waiver of any right or remedy in respect to any occurrence or event shal l not be deemed a waiver of any right or remedy in respect to any other occurrence or event, nor shall any waiver constitute a continuing waiver.

6.24. Severability. If any provision of this Agreement is determined by a court of competent jurisdiction to be unenforceable in any circumstance, such determination shall not affect the validity or enforceability of the remaining terms and provisions hereof or of the offending provision in any other circumstance. Notwithstanding the foregoing, if the value of this Agreement, based upon the substantial benefit of the bargain for any party , is materially impaired, which determination made by the presiding court or arbitrator of competent jurisdiction shall be binding, then both parties agree to substitute such provision(s) through good faith negotiations.

6.25. Counterparts. This Agreement may be executed in one or more counterparts, each of which shall be deemed an original. All counterparts shall be construed together and shall constitute one agreement.

6.26. Corporate Authority . The persons executing this Agreement on behalf of the parties hereto warrant that they are duly authorized to execute this Agreement on behalf of said parties and that by doing so the parties hereto are formally bound to the provisions of this

EXHIBIT A

REQUEST FOR PROPOSALS

REQUEST FOR PROPOSALS (RFP)

SCADA Master Plan, Integrator and Support Services

City of Fullerton

Public Works Department

1580 W. Commonwealth Ave.

Fullerton, CA 92833

Proposal Release Date: August 5, 2020

Proposal Due Date: 5PM September 2, 2020

Request for Proposals – SCADA Master Plan Integrator and Support Services hh

NOTICE OF INVITATION

SCADA Master Plan, Integrator and
Support Services

1. GENERAL INFORMATION – PROJECT DESCRIPTION
The City of Fullerton Public Works Department (“City”), is soliciting proposals to provide: (1) a Supervisory Control and Data Acquisition (SCADA) Master Plan (2) Integration of the master plan and (3) as needed support services for SCADA/ associated telemetry. The SCADA Master Plan will provide a short and long term guide while evaluating and providing direction and recommendations including but not limited to: Human Machine Interface (HMI) software, telemetry components, improved historian, and IT requirements including cyber security in accordance with the City’s Risk and Resilience Assessment (AWWA Cybersecurity Guidance document). The integrator will execute the master plan. Support services will maintain the City’s current and future SCADA upgrades.

Background
The City operates 10 potable water wells, 15 reservoirs, pump stations, metered interconnections with other agencies, along with other distribution facilities. Most facilities contain PLCs, instrumentation and/or associated telemetry allowing for System Operators to manage the water distribution system through a HMI. The City currently utilizes Wonderware SCADA software with the last major update occurring in 2008.

Scope Of Work

Task 1 – SCADA Master Plan

The objective of this Scope of Work is to provide a framework and action plan to achieve a flexible, reliable, and comprehensive SCADA Master Plan. The Consultant is encouraged to suggest optional services that would be beneficial for a long-term planning document.

The SCADA Master Plan shall prioritize recommendations, indicate steps needed to implement, and associated costs. The plan should account for and meet any state or federal recommendations including the City’s Risk and Resiliency Assessment.

As part of the recent Risk and Resiliency Assessment, the City completed the AWWA Risk Management Guidance and Self-Assessment Tool that is used to assess cybersecurity threats. The Master plan will address and prioritize all SCADA related Priority 1-4 Controls listed in the assessment. Due to information sensitivity, these controls will be provided upon request after completion of a non-disclosure agreement.

The Master Plan will include implementation options and specific recommended actions with budgetary cost estimates and recommendations for work to be completed in outlying years once the initial project is complete.

The Master Plan will include an Information Technology section that outlines the Request for Proposals – SCADA Master Plan Integrator and Support Services hh

following implementation and governance regulation requirements:

A. Infrastructure; redundancy requirements, network topology design, and requirements for interconnection with other agencies
B. Security; requirements to implement AWWA’s Risk Assessment as it relates to Cybersecurity along with interconnectivity between water wells, reservoirs, pump stations, metered interconnections with other agencies, other distribution facilities, and the City of Fullerton’s data network a. Physical security requirements of cables, telecom closets, and computer rooms, and the protection of the data as it travels on public channels and wireless circuits
b. Content filtering and website blocking requirements
c. Identity Access Control requirements
d. Encryption and VPN requirements
C. Application; list of required applications and interfaces needed to support Master Plan implementation
D. Support; required support for ongoing application and infrastructure monitoring and maintenance including security monitoring requirements E. Identify required Service Level Agreements (SLAs)
F. Business Continuity and Disaster Recovery requirements

The Scope of Work anticipates two steps to develop the master plan:

A. Assess Current Environment
B. Deliver Final SCADA Master Plan

All deliverables will include four (4) hard bound copies and one electronic copy in MSWord, MS Excel, MSProject, etc. and a complete PDF, as appropriate for each element of each deliverable. All electronic copies must be enabled for editing by the City of Fullerton.

A. Project Management

1. Organize and lead a kickoff meeting to review the scope of work, approach, and existing system. At the meeting, the Consultant should submit an initial schedule with critical milestones. Prepare meeting minutes to the City within five working days following the meeting.

2. Submit monthly status reports and supplement with regular telephone calls, as required, to discuss the status of on-going work efforts and outstanding issues.

B. Data Gathering and Site Visits

1. Gather and review existing relevant documentation including, but not limited to:
 Record drawings
 Previous reports and studies
 Historical alarm data
 Control systems and components
 Information Technology design and Network Topology
 Operations & Maintenance manuals
 Risk, Resiliency, and Assessment (RRA) Report

2. Conduct site visits to all water relevant sites.

3. Arrange to meet with operations staff to receive input regarding system insights, deficiencies, and user-interface experience.

4. Arrange to meet with Information Technology to receive input regarding current Request for Proposals – SCADA Master Plan Integrator and Support Services hh

state and deficiencies.

C. Assessment Report
Prepare an assessment report that evaluates the current SCADA environment that includes the following at a minimum:
 Document how the current SCADA system is used by operations staff;  Identification of SCADA system deficiencies;
 Gap analysis of existing SCADA system compared against industry standards;
 Graphical presentations of each hardware (e.g., condition assessment forms), software, network, and organization component in sufficient detail to analyze performance improvement opportunities.
 Remaining life expectancy schedule, if applicable;
The report should evaluate the following components and include the respective details at a minimum:

1. Hardware
 Assets: Servers, SAN, PCs, PLCs, tablets, phones, printers, etc.  Identify brand name, model, CPU type, speed, memory, age of equipment, etc. for clients/workstations
 End of Life (EOL)/ End of Support (EOS) dates

2. Instrumentation/Final Control Elements

3. Documentation of PLC/RTU/DCU

4. Software and licensing
 Assets: OS, Office, Wonderware, CMMS, etc.
 Identify application vendor, product name, version, number of users, support dates, SLAs, etc.

5. Networks
 Assets: routers/switches, cables/radios, fiber optic cables, protocols, providers, Internet access
 Include network diagram showing media, number of channels/pairs, and protocols, list of network equipment with brand name, model, age, etc.

6. Databases
 Work, process control (SCADA), inventory, location (GIS), spreadsheets, etc.
 Include conceptual data model/dictionary showing key indices, applications, interfaces and attributes for historical data collection

7. Functions
 Work management, process control (SCADA), document
management, production, telecommunications, security, reporting, website, backups, etc.
 Include brief description of the function and necessary components

8. Remote site communications

9. SCADA Security

10. Alarm Management

11. SCADA governance

12. Disaster Recovery / Business Continuity

13. Service and System Maintenance

14. Organization
Request for Proposals – SCADA Master Plan Integrator and Support Services hh

 SCADA support assignments, internal/external labor resources)  Skills and labor required to support IT and SCADA environments

The assessment report will also present a graphical description of the current point where SCADA and IT architecture meet and recommendations to ensure security and accessibility for both.

D. Workshop I – Current SCADA Assessment
a. Meet with City staff prior to starting the assessment to provide guidance and documentation.
b. Meet with City staff upon completion of the assessment to discuss findings.

E. Deliver Final SCADA Master Plan
The Master Plan should include, but not be limited to, the following:

1. Incorporate revised assessment report;

2. Implementation Program
a. Option 1 – The minimum updates needed to bring the SCADA system and its related components up to current industry standards, address Priority 1 Controls from the AWWA Risk Management Guidance, and recommendations to keep the system up to date after the completion of the project.
b. Option 2 – Updates needed to bring the SCADA system and its related components up to industry standards, address Priority 1-4 Controls from the AWWA Risk Management Guidance, provide enhancements to improve overall user interface and reliability of the system and recommendations to keep the system up to date after the completion of the project.

Task 2. Integration of selected master plan options

The scope of services will generally consist of:

A. Procurement of required hardware, software, licenses, etc. as recommended by “Option 1” of the SCADA Master Plan.

B. Project Management

1. Organize and lead a kickoff meeting to review the scope of work and approach to integration. At the meeting, the Consultant should submit an initial schedule with critical milestones and sites to be completed. Prepare meeting minutes to the City within five working days following the meeting.

2. Submit monthly status reports and supplement with regular telephone calls, as required, to discuss the status of on-going work efforts and outstanding issues.

Task 3. As needed support services for SCADA and associated telemetry The scope of services will generally consist of the following:

Request for Proposals – SCADA Master Plan Integrator and Support Services hh

a. SCADA system integration during normal business hours (typical) b. Emergency Service Calls: The Consultant shall respond within one (1) hour following notification from a City of Fullerton representative; and, if determined by the City, provide a technician to physically be at the location within four (4) hours.
c. As needed 24/7 response for SCADA and telemetry system troubleshooting or failures (emergency situations only) d. On-site assistance as required, and/or by phone or internet remote access e. New project integration (requires working with CIP projects if requested) f. PLC and HMI programming, design, and implementation
g. Communication and network systems support for proper delivery of SCADA operations
h. Provide staff training, as needed, including any new equipment or changes to existing SCADA processes
i. Creating operations and/or control memorandums for any new equipment or changes outside of a separate CIP project
j. Systems design and instrumentation coordination with City and outside vendors k. Coordinating entry to secure City properties with City staff when needed l. Provide staff the necessary equipment, computers, connections, cabling, safety equipment, etc. necessary to perform the work on the City’s facilities m. Coordination with software support services from third parties through City- owned support agreements and with manufacturers of equipment n. Provide recommendations and support for long term SCADA infrastructure needs including technical data needed for future RFP(s) o. Review Risk and Resiliency Assessment and results from the AWWA Cyber Security tool. Provide recommendation to improve compliance.
p. Provide strategies to improve resilience, including physical security and cybersecurity. q. Other SCADA related tasks requested by the City

2. PERIOD OF PERFORMANCE
It is the intent of the City to award an Agreement with a one (1) year base term with four (4) one-year options, for a total of five (5) years.

3. PRE-BID MEETING
A mandatory pre-bid web meeting will be held on August 18, 2020 at 9am. For a link to meeting, email: [email protected]

4. PROPOSALS
The City will accept Proposals submitted via electronic mail (email). The City reserves the right, at its discretion, to pursue any or all of the following actions related to this RFP:
issue addenda; request additional information; negotiate contract on basis of original proposal and/or additional information; permit the correction of errors and waive minor deviations; reject, replace, and approve any and all subconsultants; and issue subsequent requests for proposals, based on refinements of concepts proposed in Request for Proposals – SCADA Master Plan Integrator and Support Services hh

response to this RFP.

Proposers are urged to submit concise proposals, appropriate to the scale of the project, and include only items that are relevant to this specific project. The Fee Proposal shall be submitted in a separate email, at a future date, and titled “Fee Proposal for SCADA Master Plan and Integrator and Support Services”.

Tasks 1 & 3 shall have a fee proposal itemized for each task. “Exhibit A” should be completed for Task 3, Support Services Fees.

The City of Fullerton reserves the right to reject any or all responses received as a result of this solicitation; to extend the submission due date for; to modify, amend, reissue or rewrite this document; and to procure any or all services by other means.

The City will not be liable for any costs incurred by the Proposers’ incidentals to the preparation of proposals or for developing and carrying out interview presentations, if needed.

Submission of a proposal indicates acceptance by the Proposer of the conditions contained in this Request for Proposals (RFP) and Sealed Fee Proposal unless clearly and specifically noted in the proposal submitted and confirmed in the contract between the City of Fullerton and the company selected.

5. SELECTION PROCESS
The RFP process will establish a ranking based on how each proposal meets the qualifications of the Scope of Services and the requirements of the RFP. It is important that all listed items be included in the proposal. Proposals, which do not comply with all the requirements or the proposal deadline, may not be considered.

The selected consultant shall be required to sign a Non-Disclosure Agreement (NDA) and enter into the City’s standard General Services Agreement and include in the Proposal a signed copy of the Standard Agreement Acknowledgement. All Proposers that respond to the RFP shall assume that the execution of this Agreement, without changes, will be a required condition.

At the conclusion of the evaluation, an interview may be requested with the top scoring consultants. The best-qualified company may be selected without the need for an oral presentation. Once a top-ranking company is selected, the City will enter into contract negotiations with the consultant. If negotiations with the top-ranking company are unsuccessful, negotiations will terminate, and the City will undertake negotiations with the second-rank company.

Furthermore, the City reserves the right to reject any or all proposals without qualifications, and to negotiate specific requirements and costs using the selected proposal as a basis. The City also reserves the right to waive any and all irregularities to choose the company which, in the City’s opinion, best serves the City’s interests.

The City reserves the right, at its discretion, to pursue any or all of the following actions related to this RFP: issue addenda; request additional information; negotiate contract on basis of original proposal and/or additional information; permit the correction of errors and waive minor deviations; reject, replace, and approve any and all subconsultants; and issue subsequent requests for proposals, based on refinements of concepts proposed in response to this RFP.

Request for Proposals – SCADA Master Plan Integrator and Support Services hh

6. SELECTION CRITERIA
Proposals will be evaluated based on the following criteria:

Criteria

Proposal evaluations shall be based solely on information provided in this proposal.

Be sure to include all relevant information and evidence of the firm’s record of performance and ability to perform the work. As indicated above, the Approach to Work, Specialized Experience, and Project Team are the key elements of this proposal.

1. Approach to Work. 35%
This includes the approach to the Project Description and Preliminary Project Scope understanding of the project scope, project issues,

schedule of work, proposed project management and cost control techniques, quality assurance and unique/creative approaches to work.

2. Specialized Experience, Capabilities, and References. 20% This includes specialized experience directly relating to this project and evidence of ability to complete the work within schedule and on budget, and the depth of in-house or sub-consultant support.

Comments from references regarding proposer’s responsiveness to customer requirements, compliance with the contract terms, conditions, and work quality. Include a list of all SCADA software that the project team has experience in supporting.

3. Project Team. 25%
This includes the commitment of key personnel (Project Manager, Project Engineer(s), Lead Discipline Engineers, Sub-consultant Lead Engineers and Field Technicians) and their experience in the areas assigned.

4. Overall Proposal Quality and Other Considerations. 10% This includes comments received from references, proposal quality, general responsiveness, clarity of presentation, exceptions, if any, to the City’s standard agreement.

5. Fee Proposal.

This includes the fee proposals for Tasks 1 & 3.
10%

100%

Request for Proposals – SCADA Master Plan Integrator and Support Services hh

7. QUESTIONS
Questions regarding the information contained in the RFP document must be submitted in writing, by email, or by fax, and addressed to:

City of Fullerton
Public Works Department
1580 W. Commonwealth Ave.

Fullerton, CA 92833-2728
Attention: Dustin Ensminger – Water Systems Manager
Email: [email protected]
Ph: (714) 738-5337
Fax: (714) 738-3100

All questions must be received by 5:00 p.m. on August 26, 2020. Questions will be responded to in writing. Written summaries of all questions and answers will be distributed to each consultant. Anonymity of the source of specific written questions will be maintained in the written responses. A clarification addendum will be issued, if necessary.

Telephone requests for information or inquiries will be allowed only if the nature of the request or inquiry does not lend itself to formulation into a written question.

Verbal inquiries, however, are discouraged and calling parties may be requested to submit written questions in lieu of receiving a verbal response. The intent behind this requirement is to ensure that proposers have available to them the same information and no inconsistent, incomplete, or misinformation is communicated to any team.

Request for Proposals – SCADA Master Plan Integrator and Support Services hh

(EXHIBIT A) RATES - SCADA SUPPORT SERVICES

The Consultant’s work under this Agreement shall be compensated based on the fee schedule shown below.

Schedule of Hourly Billing Rates
“Emergency Work” is generally defined as any work which requires (as determined by the City) response or completion either onsite or remotely within four hours after initial notification after the hours of: (Mon – Fri 7am – 5PM).

Team Member
Type of
Work/Classification
Hourly Billing
Rate for Non-
Emergency
Work
Hourly Billing
Rate for
Emergency
Work

SCADA Support Contact Information:

Primary Contact
Name:

Telephone Number:

Email Address:

Secondary Contact
Name:

Telephone Number:

Email Address:

Additional Contact
Name:

Telephone Number:

Email Address:

EXHIBIT B

CONSULTANT’S PROPOSAL

RFP - SCADA Master Plan, Integrator and
Support Services
Due Date: September 2, 2020

Submitted by:

Systems Integrated
2200 North Glassell Street
Orange, CA 92865
Tel: 714/998-0900
Fax: 714/998-6059

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services i

Copyright © 2020
Systems Integrated
All rights reserved

The contents of this proposal are protected under copyright and other intellectual property laws. All rights reserved by Systems Integrated and its affiliated companies.

This document is intended for the City of Fullerton ’s review associated with the Request for Proposal for the SCADA Master Plan, Integrator and Support Services. No part of this document may be disclosed in any manner to a third party without the prior written consent of Systems Integrated.

This document contains proprietary and confidential information to Systems Integrated, which are considered Trade Secrets that are excluded from Public Records Requests.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services ii

TABLE OF CONTENTS

COVER LETTER ....................................................................................................................... 1 APPROACH TO WORK ............................................................................................................. 2 Project Scope ......................................................................................................................... 2 Master Plan (Task 1) ........................................................................................................... 2 Implementation of the Master Plan (Task 2) ........................................................................ 6 As-Needed Support Services (Task 3) ................................................................................ 9 Project Issues ........................................................................................................................10 Issues Associated with the Master Plan Development .......................................................11 Issues During Integration of the Master Plan ......................................................................13 Schedule Work ......................................................................................................................13 Development of the Master Plan ........................................................................................13 Task 2 - Integration ............................................................................................................14 Project Management and Cost Control ..................................................................................14 Quality Assurance .................................................................................................................15 Project Approach ...................................................................................................................16 SCADA Master Plan ..........................................................................................................16 Innovative Approaches.......................................................................................................17 SPECIALIZED EXPERIENCE, CAPABILITIES AND REFERENCES ........................................19 SPECIALIZED EXPERIENCE ...............................................................................................19 CAPABILITIES ......................................................................................................................20 REFERENCES ......................................................................................................................24 ELSINORE VALLEY MUNICIPAL WATER DISTRICT (EVMWD)......................................................24 SEATTLE PUBLIC UTILITY (SPU) .............................................................................................. 26 CITY OF SANTA BARBARA .......................................................................................................28 MASSAPEQUA WATER DISTRICT ..............................................................................................30 CITY OF CHULA VISTA .............................................................................................................32 BETHPAGE WATER DISTRICT ...................................................................................................33 PROJECT TEAM ...................................................................................................................35 ATTACHMENTS .......................................................................................................................56  Standard Agreement Acknowledgement of City of Fullerton Professional Services Agreement. ............................................................................................................................56  Sample Systems Integrated Maintenance Agreement with Task Order. .........................56

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services iii

 Sample Master Plan performed by Mr. Maris Janson .....................................................56  General Overview of Systems Integrated .......................................................................56

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 1 COVER LETTER

Systems Integrated is pleased to submit this response to the City of Fullerton’s RFP for the development of the SCADA Master Plan, integration of the SCADA Master Plan, and as -needed support services.

Systems Integrated is conveniently located to the City of Fullerton, with its corporate office located in the City of Orange, less than 10 miles from Fullerton and our manufacturing offices in San Diego, CA.

Systems Integrated believes that we are uniquely qualified to provide the City of Fullerto n with the Master Plan and ha s the expertise to i ntegrate the Master Plan and provide as-needed services for the SCADA system. The City’s process is closely related to the requirements of Design/Build projects, which Systems Integrated has performed for over 40 years.

Systems Integrated is proposing Mr. Maris Janson, Control System Professional Engineer, as the senior design engineer for the project. Mr. Janson is only one of a few California licensed Control System Engineers. Why is this important? Because unlike licensed electrical or civil engineers, a licensed control system engineer is the only class of professional engineer who’s primary engineering training was control systems. Other engineering disciplines touch on how to implement, specify and ensure correct control of the system, but only a licensed control system engineer has had all the formal training. And in the case of Mr. Janson, besides his training, he has more than 30 years of real- world experience designing control systems for the water industry. City of Fullerton should not accept second best, rather demand that SCADA control system be designed by licensed Control System Engineer . Systems Integrated can provide this highest level of quality for the engineering of the Master Plan.

Systems Integrated in addition to providing the licensed control system engineer, is also a licensed electrical contractor. Why is the important? Because with Systems Integrated providing both the engineering and the construction work, there is only one company with the professional liability and construction bonding responsibility. There is no finger pointing that the engineering company did not specify the correct solution. No matter what is wrong, Systems Integrated is responsible and will make it work. In over 40 years of providing these types of services , SI ha s never been in litigation or walked away from a job. Our references are impeccable, and we encourage you to contact them.

Systems Integrated has been in business of designing and integrating SCADA systems and network communication for more than 40 years. The company has never been sold and for more than thirty years been owned by Susan Corrales-Diaz. Systems Integrated’s staff of engineers that will support the City’s project , range from engineers that have more than 40 years working for the company, to engineers recently graduated from college. This provides an additional value with this range of engineers, the City can be guaranteed that the SCADA solution provided has the creativeness of youth and the reliability of age. No one at Systems Integrated designs solutions that has not also installed them in the field. It is a hallmark of Systems Integrated that every engineer working in the company is required to work with the electrician during installation to understand what is required to make the system operational. This ensures that our engineers do not design systems that cannot easily be operated by operators or maintained by electricians.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 2 Systems Integrated’s project approach is to complete the Master Plan in under six months providing all the deliverables identified in the RFP. Additionally, Systems Integrated has added an additional workshop to ensure that the City of Fullerton has the opportunity to fully understand the various options and the impact of each option.

SI is one of the few integration companies that ha s designed and implemented SCADA systems with over 500,000 points to systems with less than a thousand. Our customers range in size from the Metropolitan Water District of Southern California (MWD ) one of the largest water districts in the US, to Massapequa Water District, located in Long Island, New York, a small water district that has no electricians, nor SCADA technicians and SI provides them with 7 days a week, 24 hours a day support with 2 hour response time. Systems Integrated has been supporting MWD for more than 26 years and Massapequa for more than 9 years.

This type of long-term support, regardless of location is a testament to Systems Integrated ability to design and integrated resilient, expandable SCADA systems and has all the capabilities to support the City of Fullerton with their requirements . As identified by the RFP, the project is mapped out into three elements : development of the Master Plan, i ntegration of the Master Plan, and as-needed support.

Mr. Janson will be the principle engineer for Master Plan phase of the project. He has significant experience developing more 30 master plans during his tenure at Boyle Engineering, AECOM and ADE (a subsidiary of Systems Integrated ). Attached as an appendix to our RFP response are two partial samples of Mr. Janson’s master plans. One represents part of a small water system and the other for a medium size control system.

For this project there will be a team of engineers that will be assigned to work Mr. Janson, including Mr. James Pham ( Computer Engineer, responsible for computer equipment and operating system software) ; Mr. Arde Kirka ( Electrical Engineer, responsible for the PLC and SCADA master software ), Janice Ruszczyk ( Computer Engineer, responsible for the HMI screen development) and Larry Pomatto ( Electrical Engineer, responsible for the w ireless and wired network engineering). This will be the core team for Task 1 of the project. Each person identified is a senior engineer with a supporting staff.

Mr. Pomatto will be the project manager during the integration of the Master Plan. During this phase of the project, Mr. Pomatto will lead the team of engineers to support the implementation of the three possible project elements of the implementation : Communications infrastructure, SCADA System and the field equipment. Based upon the results of the Master Plan the team will be assembled. While the specifics of the implementation phase cannot be fully defined until the completion of the Master Plan, regardless, Systems Integrated has both the manpowe r and capability to meet the schedules presented.

Systems Integrated is an Engineering company, and Integration company and provide long term support for critical infrastructure and is prepared to support the City of Fullerton with all aspects of their project.

Susan Corrales-Diaz
President, Systems Integrated

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 2 APPROACH TO WORK

PROJECT SCOPE
The scope of this project has three main tasks: develop a master plan, implementation of the City’s selected master plan options, and provide long term support for the City’s SCADA system.

Systems Integrated (SI) is uniquely qualified to provide the solution to the SCADA upgrade for the City of Fullerton. SI is one of the few integrators that:
 Has a California professional engineer that holds a control system engineering license (CA # 2913). Unlike other engineering companies, with professional engineering licenses for civil or electrical engineering (these licenses do not have the specialized training needed for control systems), the Systems Integrated team will include a control system professional engineer as a key member on this project.
 Has its headquarters less than 15 miles from the City of Fullerton.  Has been providing SCADA systems to water districts locally and across the U.S. for more than 40 years.
 Holds both a California electrical (C-10) and general (B) contractors’ licenses.  Has both Professional Errors and Omissions insurance and $40 million dollars of bonding capacity.
 Has a complete development staff of software i ntegrators that supports every major SCADA vendor in the United States.

MASTER PLAN (Task 1)
Systems Integrated is one of the few integrating companies that has the technical expertise to develop and deliver a SCADA master plan. The elements that the City described for the Master Plan in the RFP are all a normal part of Systems Integrated’s development of this plan, and we will provide the City with our recommendations and discuss the options with the City to collectively determination the best plan forward for the City. This Task would have a schedule of performance to allow the City to track the progression of the work. Systems Integrated normally opens a SharePoint site to support the easy exchange of data and it allows easy access to all the participants working on the project.

The development of the SCADA Master Plan includes:
1) Workshop 1. Systems Integrated believes that it is important for the City to identify all of their goals and objectives as well as issues with their existing SCADA system to ensure that the Master Plan is complete based upon the information identified by the City.

Systems Integrated has identified a number of elements for the first workshop of Task 1 that may be incorporated into the fact-finding element of the work. During this phase it is requested that the City identify who within the City SI should contact for the various elements associated

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 3 with the SCADA system . The listing below identifies both items identified by the City and several elements not addressed by the City but would have a bearing on the outcome of the SCADA Master Plan:
 Identifying the person(s) who prepared the cyber security self-assessment.  Capital and operations budget objectives / limitations.  Determination of the amount of support available within the City and the amount of support that will need to be contracted out (if any) to maintain the SCADA system and associated communications infrastructure.
 Short term and medium term retirement impacts on the Fullerton City personnel.  Ways of reducing overall, long term upgrade costs.
 Implementation methods for the SCADA system such as a rip out and replace; upgrades to the existing system and/or phased-in change over a period (months or years). If phased- in, what part(s) of the control system are the City’s priority.  Impacts of upgrades to the water operation during the SCADA upgrade.  Secure wireless high speed and possibly redundant communications infrastructure.  SCADA maintenance program which would allow the City to control its yearly operational cost for the SCADA System, including a fixed yearly operational and maintenance cost for the system.
 Redundancy and reliability of the SCADA system.
 Choosing the correct SCADA systems and the associated cost of ownership (capital cost plus 5 or 10 years of operating cost).
 Design and implementation objectives to:
o Minimize overall cost of ownership.
o Minimize and define the impact to the City during the SCADA upgrade process.  Review a variety of SCADA systems, their pros and cons.  Level of support which the City wishes to accept versus contracting the support functions.

Prior to holding the workshop, Systems Integrated will publish a suggested agenda which will be provided to the City for review.

At the conclusion of the workshop, Systems Integrated will prepare a report with the results of the workshop which will capture all the comments. (Systems Integrated normally records the proceedings to ensure that the report correctly reflects all of what was discussed).

2) Gathering Information Regarding the Existing System. During this phase of the SCADA Master Plan development, Systems Integrated will work on- site to collect information including:
 System assets and associated licenses.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 4  Drawings of the control equipment at all the sites.  Drawings of the existing communication network.
 Perform an analysis of the existing Wonderware system.  Copy the existing Wonderware configuration.
 Copy the existing O&M manuals for the installed control system.  Copy of the PLC programs.
 Radio configurations.
 Age and supportability of the installed assets.
 Yearly maintenance cost for the existing system.
 Downtime and overtime cost for maintenance of the existing system.  The SCADA system’s ability to provide the needed functionality and reporting.  Expected growth or changes to the existing water infrastructure system (such as new facilities, upgrade of existing facilities, or changes in electrical equipment).  Level of existing training on the maintenance of the existing SCADA system.  IT comments, recommendations, and requirements.

To accomplish this task, SI is planning to do a visual inspection of all the City’s SCADA assets, determine what other assets are impacting the operation of the existing SCADA system, review of the overtime maintenance and cost records, and operational impact of the existing SCADA system. Overtime and maintenance cost can provide insight as to the overall reliability of the SCADA system and the types of issues associated with the SCADA system.

The results of these tasks will provide the City with an assessment report that addresses the information that was collected, and provide a variety of analysis of the information gathered, including the following:
• How the existing SCADA system is used.
• SCADA system deficiencies.
• Analysis of SCADA system compared to industry standards. • Analysis of the following elements in the system addressing various attributes including reliability, cybersecurity exposure, end of life, age of the hardware or software:
o Hardware:
 Server and workstation equipment.
 Instrumentation and output devices.
 Network equipment.
o Software:
 Licensing.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 5  Type of software included:
• Operating system, support programs, SCADA application programs.
 Databases:
• Configuration and limitations of the databases, including both the configuration database and the historical database.  Recovery.
 Security.
 System maintenance.
 Organization of the software.
o Functionality:
 Alarm processing / escalation.
 Operator’s ability to access the system both remotely and locally.  Level of security associated with access.
 Report generation and reporting.
 Demarcation points between administrative services (IT) and the SCADA system.
3) Workshop 2. The purpose workshop 2 is to review Systems Integrated’s assessment report and our findings. In particular, SI will present and discuss the various types of SCADA systems available today and the pros / cons of each with the objective of reaching an agreement on the type of SCADA system and communications network that should be implemented .

Address the cybersecurity issues associated with the control s ystem and communications network.

4) Development of the Master Plan. This phase will incorporate all the data collected, and based upon the input, prepare a Master Plan with two implementation approaches based upon the level of cyber security controls for the system. Priority 1 controls will address the minimum level of acceptable security for PCS and enterprise systems, and the other will address Priorities 1-4 which will layout a completely cyber secure system, that would be in compliant with the AWWA, NIST and Department of Homeland Security for Industrial Control Systems recommendations. For each approach, a schedule, an engineer’s cost estimate and risk assessment. Systems Integrated can make recommendations on the optimum transition of the upgrade, such that the City could perform the work in phases which may provide flexibility in regards to budgetary issues. Once the master plan is completed, a final review copy will be provided to the City.

Once the City has completed their review of the preliminary Master Plan, a final workshop 3 will be held to review the City’s comments, at which time SI will incorporate the changes / recommendations made by the City and provide the City with the final master plan. As part of the final master plan, SI will provide, in addition the Engineer’s estimate for the

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 6 implementation cost, a firm fixed price cost if Systems Integrated were to perform Task 2 - the implementation/integration.

The final step would be the delivery of the final Master Plan and all the associated documents to the City. Systems Integrated normally delivers these types of documents in an electronic format because it is more economical for our customers but will also provide the requested physical copies.

IMPLEMENTATION OF THE MASTER PLAN (TASK 2)
The scope of the implementation of the SCADA system is dependent upon the results of the Master Plan.

SCADA systems have three major components, field control equipment, communications, master SCADA system, and cyber-security implications of the existing system. As part of the Master Plan each of these components will be addressed as well as the recommendations as to what would need to be upgraded; recommended approach for the upgrade, the overall time to implement and the estimated cost.

Systems Integrated would work with the City to determine the implementation schedule that would designate the milestones and sites for the project and uses MSProject for schedule tracking. SI would participate in the monthly status calls and reports to ensure that the City can track the progress and be apprised of any issues. Systems Integrated normally opens a SharePoint site to support the easy exchange of data and it allows easy access to all the participants working on the project.

For planning purposes, the scope of work presented assumes that all three elements require upgrades. The following is the overall scope of the implementation of the project.

FIELD CONTROL EQUIPMENT
The field control equipment consists of the PLCs located in the field, the enclosures for the PLCs and the I/O connected to the PLCs.

In a water system, the PLC has two components inputs and outputs.

The digital outputs are used to operate motors and valves, whereas the analog output points are used to control chemical dosing systems, flow control valves, and pressure sustaining facilities.

The digital inputs range from security inputs, to status inputs (such as HOA switch status, power available, pump running, valve position) and volume inputs (pulse counts from flowmeters) and the analog inputs consists of flow rate information (from a flow transmitter), speed information (from a VFD), tank or reservoir level information and system pressure (from a pressure sensor).

Finally, there is a third type of I/O which consists of distributed I/O. This type of I/O has become popular over the last several years and is used to provide additional information regarding the status of the field equipment as well as a providing an alternate m ethod of controlling the equipment. The distributed I/O uses a serial communications interface (with Ethernet being the newest method). While this has become popular, in most cases it has not become significant, as the vendors of the equipment have not agr eed upon a set of communications standards or methods of collecting information or controlling the equipment. At present, if distributed I/O is used, it introduces two results: first, it forces a sole source support for the field equipment. This

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 7 means that whatever equipment has the ability to be controlled, it will be based upon the manufacture of the equipment and unless the City is willing to reprogram the field PLC each time a replacement device is installed, the replacement device must be sole- sourced to the specific vendor. Manufactures of distributed control equipment favor this approach as it allows them to obtain a reoccurring revenue stream for replacement equipment. From an end user’s standpoint an evaluation should be made to determine the impact of this type of I/O.

Systems Integrated will, as part of the Master Plan evaluate all the I/O and provide recommendations with the associated cost benefits (including recommendations on replacements of sensors).

For the scope of work related to the implementation SI is assuming that it will provide a firm fixed price for the implementation of this portion of the Master Plan, provide all replacement equipment identified in the Master Plan, install and test the installation of the equipment and provide a 1 year warranty for all equipment, configuration and implementation of the system. In addition, as an option, SI will assume software maintenance as well as after-hours support for the existing system during the implementation phase of the project.

COMMUNICATIONS EQUIPMENT
There have been significant advances in the use of wireless communications equipment over the past 20 years from the predominant communications being serial communications at over the air speeds in the range of 56Kbs to 256Kbs at frequency bands in either the 400 MHz or 900 MHz frequency bands, to new communications systems with over the air speeds ranging to 800 Mbps using 2.4 GHz, 4.9 GHz, 5-6 GHz and some 700 MHz frequency bands.

In addition to the improvements in speed, there has recently been a significant cost reduction using the new technology equipment. The old, lower frequency equipment (below 1GHz) cost in the range of $2,000 for each radio, to the new equipment is in the range of $1,200 per unit. There are advantages to both types of communications, however with the new cyber security and physical security requirements, the newer equipment has the ability to support the SCADA applications as well as video surveillance and centralized access control systems (both are becoming mandated for water protection (particularly at a reservoir site). An additional benefit of the newer equipment is that it is provided with full AES 256 encryption as a standard feature of the radio equipment.

For development of the scope of work associated with the Master Plan, the effort assumes that the radio equipment will need to be replaced. SI would provide a firm fixed price for the implementation of this portion of the Master Plan, which would include: all replacement equipment identified in the Master Plan; install and test the install ed equipment; provide a 1 year warranty for all equipment; configuration and implementation of the system. In addition, as an option, SI will assume software maintenance as well as after -hours support for the existing system during the implementation phase of the project.

MASTER SCADA SYSTEM
There have been a number of Department of Homeland Security requirements as well as AWWA recommendations on what is a secure SCADA system. A s the City o f Fullerton completed the

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 8 AWWA self-inspection, many issues may have been uncovered. In order to be compliant with these new requirements and recommendations, the various manufactures of SCADA systems have been implementing upgrade solutions to support these requirements.

As a result of these new requirements, new classes of SCADA systems are being introduced based on the concept that the SCADA system is provided as an appliance. The concept of the appliance is that the software is modular in nature and is provided as a complete system that requires no IT support to install, implement or maintain. This concept is similar to what has been provided for years with routers, switches and other network devices. The major difference is the SCADA appliance can be provided as a “load in” module onto a server provided by the City , or as a complete hardware software solution. The major advantage of the appliance approach is compliance with many of the cybersecurity requirements. Using an appliance, the manufacture assumes all the responsibility for evaluating the cyber risks; publishes its recommendations and provides updates to the appliance software. As all components of the appliance software are under the control of the manufacture, the compliance requirement cost s are contained and the effort to maintain a compliant system can be provided at a fixed price to the City. For example, the City currently has a Wonderware system, which, if under maintenance, is provided with upgrades to the Wonderware system. However, it is up to the City to perform the upgrade include providing new servers, installing and configuring the operating system, installing the Wonderware upgrades, then testing the new upgrade to confirm that the existing functionality is still available.

The City has two choices to implement the upgrade: do it internally or rely on a integration vendor to handle the upgrade. Cities have had varying success with this model, however in most cases the cost and time impact of the upgrade restricts the City from im plementing the upgrades in a timely manner or at all.

With the concept of an appliance, the process is straight forward – the existing appliance is replaced with a fully configured, up to date replacement system which takes between 45 minutes and 2 hours to install and test. Further, if there are any issues, the fall back to the prior system is accomplished in minutes. The manufacture takes full responsibility for the upgrade process and provides support to allow the City, a local integrator or the manufacture to implement the upgrade.

This new approach changes the overall concept of cost of ownership as the City is provided a fixed price cost of SCADA maintenance with the manufacture standing behind the process and providing a solution whereby the SCADA sy stem can be upgraded without ever having to shut down the SCADA system.

For purposes of determining the implementation scope of work it will be assumed that the SCADA master station is being replaced. For development of the scope of work associated with the Master Plan the effort assumes that the SCADA master station will be replaced, SI is assuming that it will provide a firm fixed price for the implementation of this portion of the master plan, provide all replacement equipment identified in the master plan, install and test the installation of the equipment and provide a 1 year warranty for all equipment, configuration and implementation of the system. In addition, as an option SI will assume software maintenance as well as after-hours support for the existing system during the implementation phase of the project.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 9 ASSUMPTIONS TO THE SCOPE OF IMPLEMENTATION
In order to define the overall scope of the implementation process, the following are the assumptions:

1. Replacement of the SCADA master station, communications equipment, field equipment.

2. That the order in which the implementation will be performed will minimize the operational impacts with the proposed order being as follows:
a. Upgrade the existing radio system and provide the ability for the existing system to operate on the new radio system.
b. Upgrade the SCADA master system to provide existing operation of the system using a new SCADA master.
c. Replace / upgrade the field equipment in a process agreed to by SI and the City to ensure that no more than one site is down at a time and the entire system will remain operational during the replacement process.

3. That any control system changes requested by the City will be identified during the Master Plan development (changes to the way the system operates), will be defined in the Master Plan and agreed to by the City.

4. There are existing drawings for the remote sites that can be used for the upgrade.

5. That the Master Plan will identify the approach for the upgrade (in particular provide information regarding what will be replaced and what will be reused).

With the assumptions that have been identified above the overall implementation of the Master Plan would require between 12 and 24 months.

AS- NEEDED SUPPORT SERVICES (TASK 3)
Systems Integrated is experienced at providing support services for critical systems such as the City’s water system. If requested by the City, a s part of Task 3, Systems Integrated will provide SCADA system support for the existing system during the upgrade process as well as long term support for the new control system once the warranty period for the new system has been exhausted.

Systems Integrated’s typical maintenance contract provides the City with the ability to issue tasks to perform everything from obtaining and installing replacement hardware, to providing the hardware and associated software to support the implementation of a new site. (A sample of our typical support services contract is provided in the proposal appendix).

The scope of the maintenance contract can be tailored to meet the City’s specific requirements.

For example, some of Systems Integrated’s customers request that the fixed price maintenance contract provide both software and hardware including providing after-hours (7X24) support to troubleshoot and repair both the software and hardware including the servers, workstations, communications equipment, and field equipment. This level of support is also available on a per

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 10 event cost approach. This means that the City can budget a fixed amount per year for all SCADA support requirements and it is covered or can pay for support on an event cost basis.

The same maintenance contract can be used to support CIP implementation of new controls, evaluation and providing recommendations on system component replacements, root cause analysis of the failures of the control system, provide on-call support to augment the existing staff in case of illness, vacation, etc.

Because of Systems Integrated’s location to the City of Fullerton, the response time can typically be measured in minutes when on -site responses are required a nd the ability of the SI support staff, maintenance can be provided 7 X 24.

Systems Integrated has implemented a maintenance approach whereby the customer provides Systems Integrated cybersecure remote access to their SCADA system. T his remote access allows Systems Integrated the ability to quickly diagnose the root cause of any problem thereby being able to advise the City of the situation or dispatch the correct support personnel to the site.

Systems Integrated has a complete support staff of software engineers, hardware engineers, communications engineers and electricians that are trained to support instrument and control issues. Our electricians can perform trouble shooting as well as replacement of many MCC components, repair or replacement of instrumentation including pressure and level transmitters.

In addition, our support staff are qualified to perform installation and maintenance of ultrasonic level transmitters, and a variety of flow sensors.

SI’s staff can support the 7 X 24 hour requirements and have staff on standby to support our customer base on-site any time there is a control system requirement.

PROJECT ISSUES

Based upon the RFP, the City is requesting that the responder provide the hourly rate structure for normal and emergency services after the new control system is completed. This structure means that the City anticipates that the support will be on an as-needed basis, however the RFP’s list of the City’s desired support services suggested a more regular support relationship which could be achieved through SI’s fixed price support services contract which includes a not to exceed task order budget.

Systems I ntegrated is accustomed to assuming overall system responsibility of the existing system during the integration of the Master Plan. If requested by the City, SI could also assume the support responsibility for the existing system during the development of the Master Plan as well as during the integration of the Master Plan.

The City has requested two different implementation solutions for the Master Plan: one to meet the minimum cybersecurity specific requirements of Priority 1 and one to achieve more global long-term goals (Priority 1-4) for the SCADA system . Task 2 indicates that the City may have already determined that Option 1 of the cybersecurity assessment of the Master Plan is what will be implemented.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 11 Systems Integrated suggests, that at such time that the Master Plan is finalized it may be that the City’s global objectives (meaning Option 2) could be accomplished in another way. The City may want to consider that the upgrade implementation be phased in over a period of time. Systems Integrated has significant experience implementing “phased in” types of SCADA solutions and understands how to meet both budgetary requirements as well as operational requirements.

ISSUES ASSOCIATED WITH THE M ASTER PLAN DEVELOPMENT

While SI has not performed a survey of the various sites, the City of Fullerton has indicated that they are using a wireless communications infrastructure. Wireless communication infrastructure can be very reliable, however there have been many new uses found for the limit ed radio frequency resources and as such, the City may have encountered one of the major long term problems with wireless solutions - interference and changes in licensed channel assignments. SI will perform an in-depth analysis of the existing wireless infrastructure and provide recommendations of upgrades should be made to the wireless infrastructure. It may not be apparent, but an upgrade to the communications infrastructure may significantly reduce the overall overtime and afterhours calls out. With the new communications technologies, remote repair of field equipment could be made from a centralized point which either would eliminate after-hours call out or significantly reduce it.

SI will be addressing , during the Master Plan development, the possibility of changing the way the SCADA system operates to allow the system to have failures without impacting the operation of the system or more efficiently operating the system. For example, at the Elsinore Valley Municipal Water District (EVMWD) SI was asked to develop a Master Plan for the operation of the one of their ground water treatment plants. The plant was designed to operate with a production rate of 5 million gallons per day, however it was unable to achieve any more than 3 million gallons per day. During SI’s evaluation process of this problem, it was determined that the existing sand filters had limitations as the flow rate changes: when the filters did not have to vary the flow, the system worked well, but if the flow rate had to vary then turbidity control could not be maintained. SI proposed a change in the control of the plant. Th is change resulted in EVMWD being able to reduce its staff from two full-time persons on-site at the plant, to one person for half a day. A reduction of manpower by a factor of 4 and the ability to continuously produce 5 million gallons per day, accomplished multiple goals for EVMWD.

A project issue may be the control of chloramines. The City of Fullerton uses water from its own wells and water from the Metropolitan Water District (MWD). Chloramines are created with a combination of chlorine and ammonia, and the blending process can get “out of control” if too much ammonia be injected. As a result, many water districts find that this control system has to be manually tuned and maintained based upon either well flow changes or types of water in the system, causing operators to go out and manually adjust these systems. This requirement has an operational cost impact. Systems Integrated could evaluate the control of the chemical injection systems at the well sites and provide recommendations if this is an issue.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 12 Inability to take a site out of service may be a nother issue during the upgrade process. SI will address this issue during the Master Plan development and identify methods to mitigate the impact to the system.

SI has found, when developing a Master Plan, that there is generally a lack of drawings available of the field equipment. While exact “ as currently wired” drawings are not required, there is a requirement to define a demarcation point of responsibility during the integration phase, in order to create a firm fixed priced integration contract. This is another factor that needs to be defined during the Task 1 process.

During the initial development of the SCADA system and subsequent upgrades to the SCADA system, the overall operational control of the SCADA system may not have been clearly defined or updated. The industry standard method of defining the SCADA control r equirements is to provide a control system narrative as well as P&ID drawings for each site (or group of sites) that would be required to operate in concert (for example, the well operation is used to fill a tank or is operated continuously using the imported water to augment the water demand requirements). SI will look for opportunities to improve the system control during the development of the Master Plan.

The City may also have certain operational issues regarding the importation of water that needs to be incorporated into the Master Plan. Typically, there is a scheduling process whereby the City agrees to a specific (or range) of flow during periods of each day. Some of these contracts have certain costs based upon either following or not following the agreed upon flow schedule. Other operational issues may be related to Time of Use (TOU) agreements with the electric utilities. And there are fire issues regarding the minimum level of tanks in order to meet fire flow requirements during different times of the year. Our goal would be to identify these types of issues.

There may be redundancies in the City’s water system which needs to be identified. Typically, redundancies are multiple tanks / reservoirs available which provide excess capacity which could be used to mitigate other operational constraints in the system. Also, identifying levels of SCADA system redundancies required to determine system impact. Such as an event of any one radio lost, what is the impact?

Other areas for consideration are the level of automation required by the City. Is there a requirement for the SCADA system to look at historical data to determine by season of the year, day of the week and possibly average daily temperature (usually by week) to create recommended pumping / importing schedules of water by hour for the next few days.

SI has identified the aforementioned items as possible issues, all of which are solvable, but will impact the overall cost of the final integration of the Master Plan. Provided that the City is willing to engage in the workshop process , most if not all the City’s issues can be identified and addressed as part of the Master Plan.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 13 ISSUES DURING INTEGRATION OF THE M ASTER PLAN

One of the major issues with the implementation of the Master Plan is minimalizing the impact on the operational personnel, which can be addressed by determining the sequence of work for the project.

Another issue is associated with addressing unknown issues. For example, if there is a requirement for the replacement of the existing PLC enclosure, can the existing PLC enclosure be used as a marshalling cabinet and a new PLC be provided in a new enclosure or is there a requirement to replace the existing PLC with a new PLC and implement it in the existing enclosure?

In regard to the work schedule, are there specific times that work can be done (specifically days of the week, hours of the day)? Does the City require an escort while the contractor as at a site? Which is more important to the City - cost or schedule?

These afore-delineated issues should be addressed prior to the commencement of Task 2 - the integration phase of the work during the development of the Master Plan.

SCHEDULE WORK

DEVELOPMENT OF THE M ASTER PLAN

Systems Integrated is estimating that the development of the Master Plan will take approximately 16 weeks to complete. (The caveat to our estimates are any unforeseen impact caused due to the ongoing covid-19 situation and/or local community unrest as it may inject delay). This time estimate is based upon the following assumptions:
 Drawings of the field control equipment are available.  Network diagram (including radio configuration details) is available.  PLC programs are available.
 Access to the sites for physical assessment is provided.

Workshop 1: This task would be performed in 1 week.

Data collection / assessment of the existing system: This should take 6 weeks, including publishing the findings report.

Workshop 2: This would take either 1 or 2 days – depending upon the City’s availability.

Development of the Master Plan: The time for this task would be approximately 6 weeks.

Review of draft Master Plan: This is the City’s task and has tentatively scheduled 2 weeks for the City’s review.

Workshop 3: The objective is to discuss changes / recommendations to the draft Master Plan.

This would take either 1 or 2 days – depending upon the City’s availability.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 14 Development of the final Master Plan: This will take approximately 2 weeks after the completion of workshop 3.

TASK 2 - INTEGRATION
Systems Integrated envisions multiple implementation / integration approaches dependent upon the outcome of the Master Plan. Without further scope identified, based upon the number of sites in the City’s existing control system, this system should be able to upgraded (all components) within a 12 to 24 month period.

If the City’s primary objective is compliance with cybersecurity only, Systems Integrated believes that this timeframe could be significantly reduced.

PROJECT MANAGEMENT AND COST CONTROL

If the City actively participates during the Master Plan development the scope can be well defined which will result in the cost being better defined. The more information that the City can provide to SI during the development of the Master Plan, the lower the implementation / integration costs.

However, it may be better to allow for a higher implementation cost and reducing the Master Plan costs. For example, if there is a requirement to change ou t field equipment and there is a requirement to replace existing field wiring, who is responsible if the existing conduit cannot be reused? As part of the Master Plan, a field evaluation could be made to determine if the conduit is reusable or request the contractor to provide a cost (per foot) to replace the conduit. In this example, providing a cost per foot for conduit replacement may be the lower cost solution.

During the Master Plan development process, the City’s willingness to provide all the available information is one of the ways to significantly control cost. The Master Plan development process is the opportunity for the City to identify all their requirements for the system, and to address all the other issues associated with the SCADA system. In particular, operational issues with:
 The existing system not working correctly:
o requires rebooting
o not producing the required reports
o unable to correctly control the operation of the system o requires an operator to control the system from a control room o unsecure remote access
o alarm processing / notification issues
 Overtime issues
 Hardware failures
 Types and length of time that the SCADA system is not operational  Communications issues – such as failures with the existing communications system which requires operator intervention

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 15  New security requirements (for example alarming when people enter the site, building or enclosure).

From Systems Integrated per spective, the best way to control cost is to provide a project management team that understands both the technical aspects of the project as well as the commercial aspects of the project.

Systems Integrated’s project managers are degreed engineers with extensive advanced training on project control and project management. A dditionally, there is a support staff within Systems Integrated that provides schedule monitoring, status report generation, monthly progress reports and billings and coordination support. In addition to managing the implementation of the project, Systems Integrated has found that one of the best ways to control cost is to ensure that the City engages with the implementation of the project. Weekly status meetings, identification of issues, interaction with all members of both Systems Integrated’s team and the City’s team, is one of the best ways to ensure control of both costs and schedule.

QUALITY ASSURANCE
Quality assurance is a company mandate, as an ISO 9000 company, development of systems is accomplished using a well -defined, formalized quality program. In the development of SCADA systems provided by Systems Integrated, testing and validation is a fundamental requirement as well as the documentation of the testing performed.

ISO 9000 is a methodology which requires all aspects of projects be tracked, documented, and provides a trail to determine the root cause of any failure. A t hird party company evaluates Systems Integrated’s process to ensure that quality is maintained.

Systems Integrated uses regression testing to ensure that implemented solutions are fully functional with a minimum of bugs or errors. Regression testing is performed by creating reproducible test procedures which allows the team to re-test the entire system each time there is a modification to the system. In order to minimize the cost of this process, SI has developed a variety of simulation tools that are used to simulate the field environment. Systems Integrated has many examples of the regression testing process which has minimized in field design errors.

For this project, Systems Integrated intends to use a variety items to ensure the quality of the final SCADA system, including the following:
 Sample screens
 Database details
 Factory Acceptance Test for PLC and SCADA system
 Regressive testing results

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 16 PROJECT APPROACH

Systems Integrated’s approach for this project will use some unique capabilities that are not normally found in a single organization. In addition, we will be using standard implementation for parts of the project.

SCADA MASTER PLAN
Systems Integrated’s approach for the SCADA Master Plan is fairly traditional, however our extensive SCADA experienced; current technology knowledge and understanding; wireless network expertise; with hands-on field understanding will make the final product (Master Plan) a valuable repository of information and accurately define all aspects of future SCADA upgrades .

SI will execute this part of the contract as indicated in the sequence.

A. Have workshop to discuss the City’s existing SCADA issues and determine how the assessment process will proceed.

B. Perform the data collection assessment by:
• Gathering all data and drawings.
• Perform a physical survey of all the field equipment
• Perform a physical survey of all the SCADA equipment
• Determine the version and evaluate all the software on the servers and workstations • Locate and evaluate the existing PLC software
• Develop an assessment report

C. Workshop to discuss the results of the data collection assessment process • Develop a list of extensions / changes to the SCADA system envisioned by the City • Develop a list of the issues with the existing:
o SCADA master station
o Radio system
o PLC / field equipment
o Priorities for issues with the system
• Determine the goals and objective of the project
• Determine the funding type (capital or operational), and amount • Review of cybersecurity audit completed by the City
• Determine scheduling requirements

D. Develop the draft of the SCADA Master Plan

E. Review the draft of the SCADA Master Plan with City

F. Provide the final SCADA Master Plan

G. Provide cost proposal for the integration / implementation of the SCADA Master Plan.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 17 INNOVATIVE APPROACHES
Systems Integrated has several innovative approaches for this project. It is our mission to provide solutions that will reduce the overall cost of SCADA system ownership; deliver a cyber secure system; minimize the change impact to the City and their operators during the transition, and ultimately provides a SCADA system that can evolve with the City’s requirements and technology for the next decade.

SI believes that there is a way whereby all of the updates; cybersecurity testing; patch review; patch installation; system backup and continuous operation can be accomplished for a fixed monthly support cost.

MASTER PLAN
The following are some innovative ways to approach this project:

 Perform a radio survey using pathloss to determine what frequency options and proposed method of site interconnect. Generally, engineering companies that prepare Master Plans do not have the engineering staff that understands how to perform this aspect of the work.

Systems Integrated has the radio engineers that have the ability to prepare a radio analysis of the City’s system. This would be included as part of our Master Plan.

 Provide, as part of the Master Plan, an approach whereby all the equipment is upgraded and the system is never unavailable. This solution does not require that two master stations be operational during the upgrade process (one using the old SCADA master system and the other using the new SCADA master system ). The approach would be 1) to make the new SCADA system work with the existing PLCs, 2) make the new communication infrastructure work with both the old and new PLCs, and 3) after the new SCADA system is operational change out the field PLCs.

Provide the option of a SCADA solution based upon the appliance architecture which would allow the maintenance of the software to be accomplished by the manufacture of the software, which would eliminate any City resources to ensure that the SCADA system is always updated with the latest cybersecurity patches with little or no downtime.

 Evaluate the benefit of a redundant master system (the City did not identify any redundancy).

 Determine if, b y changing the control algorithms for water production, the system could support the loss of one or more sites and still allow full functionality (reduces the cost of overtime to repair failed equipment).

 Evaluate changes in the system to make it a distributed control system which would allow the entire system to continue to operate even if the master station were to fail.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 18  Evaluate the possibility of providing control of the system such that there would no longer be the requirement for a centralize control room to operate the system (reduc ing operational cost).

 Provide a SCADA solution that would allow for centralized or remote access for programming of field devices ( further reducing support cost by analyzing the root cause of a problem before going to the field).

MASTER PLAN IMPLEMENTATION / INTEGRATION

During Task 2 – the integration of the Master Plan - Systems Integrated will be proposing a number of approaches that will reduce the overall time to complete this task.

Implementation in parallel. Assuming that the SCADA master, communication system and field equipment were all to be replaced, a parallel effort will be executed that would allow the new master to be installed and communicate with the existing PLCs. The co ncurrent upgrade of the communication infrastructure and the SCADA master implementation would allow the old SCADA master to communicate with the existing PLCs over the new communications network.

Using this parallel approach, two of the three major system components could be upgraded in parallel with the installation of the PLC’s being performed one site at a time. This approach allows the SCADA master to be upgraded and the communications system to be upgraded without any system downtime. And when the field equipment is upgraded it is completed, one site at a time, causing at most one site down. Systems Integrated has done this approach a number of times with a 100% success rate, without ever exposing the customer to a “no SCADA” situation or having the adapt to dual SCADA systems (old and new running concurrently with each system supporting part of the system).

Reuse of existing infrastructure. One of the major costs of a field equipment upgrade is the cost of rewiring the existing enclosures. If the approach is taken to add an enclosure to house just the PLC, an adaptor board can be provided that would allow the existing field wiring terminations to the existing PLC to be plugged into an adaptor board that allows a direct connection to the new PLC in the new enclosure. The net result is there is no “ring out” time for validating the wiring of the new PLC (none of the field wiring would change). In addition to the reduction of installation cost of the new PLC, the documentation task would be significantly reduced as it would not require redrawing and relabeling of the existing field wiring.

Serial / Ethernet wireless communications. The approach consists of upgrading the existing serial communications infrastructure to Ethernet and providing Ethernet to serial converters at each remote location. Using this approach, the existing SCADA system and the new SCADA system can continue to use the existing field equipment without impact until the new field equipment is installed and made operational. The net impact should be that an existing field site will be out of communication with the SCADA system for at most a few hours.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 19 SPECIALIZED EXPERIENCE, CAPABILITIES AND REFERENCES

SPECIALIZED EXPERIENCE

Systems Integrated is proud of its qualifications and certifications. In particular, SI’s team members are all outstanding in their respective engineering disciplines with members involved in the various industry organizations, to developing patents associated with automation and control.

For example, Mr. Kirka has been awarded multiple patents for automated processes associated with the production of various milk products, and Mr. Pomatto has multiple patents for automated control of processes including automated substation control , to implementing a variety of measurement techniques for the control of power and the flow of energy. Mr. Janson has been a member of the AWWA for more than 40 years being the chair of many committees associated with SCADA, automation, and process control.

C

ERTIFICATIONS
In addition to the various patents associated with automation and control , SI has a number of certifications for its hardware; software and integration services . In particular the listing below is reflective of standards that Systems Integr ated has either been certified and standards that are followed for our hardware; software and integration services:

Certification Standard Description
IEC 62243-4-1:2018 Secure Product Development Life Cycle Process, Verification and Validation Requirements
ISO 9001:2015 Quality Management System
ISO 27001:2013 Information Security Management System
IEC 61508 Software Life Cycle Process, Safety Life Cycle Requirements, Verification, Validation and Functional Safety Requirements
IEC 61511 Software Life Cycle Process, Safety Life Cycle Requirements, Verification, Validation and Functional Safety Requirements
IEEE 1332:2012
Reliability program for the development and production of electronics products and associated Systems and software engineering – life cycle processes including risk management
ISO/IEC 16085:2006
Reliability program for the development and production of electronics products and associated Systems and software engineering – life cycle processes including risk management
Additional industry standards/guides that Systems Integrated follows:

Standard Description
ISA 101 HMI and its lifecycle
ISA 99 Industrial Automation and Control Systems Security ISA 62443
The ISA/IEC 62443 series of standards, developed by the ISA99 committee and adopted by the International Electrotechnical Commission (IEC), provides a flexible framework to address and mitigate current and future security vulnerabilities in industrial automation and control systems (IACSs).

NIST SP 800-82 R2 Federal guide to Industrial Control Systems Security ANSI 18.2-2016 Management of Alarm Systems for the Process Industries IEC 62682 Alarm Management Standard
IEC 61131-3 Programing Languages

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 20 CAPABILITIES

Systems Integrated is a full-service engineering, construction and support services company focused on the water, wastewater and hydroelectric power control industries.

The company has offices in California in the cities of Orange, San Diego, San Jose and out of state offices in Seattle, Washington, Boston Massachusetts, and Bethpage, New York .

Internationally, we have an office in Croatia, with distributor support in Europe and Asia.

Within the company, Systems Integrated has degreed electrical engineers, software engineers, and a control system professional engineer . Additionally, four of SI’s engineers completed a variety of Department of Homeland Security’s Cybersecurity and Infrastructure Security Agency (CISA) training programs as well as programs for Department of Defense security clearance, Department of Interior cybersecurity certifications, and National Electric Reliability Corporation Critical Infrastructure Protection (NERC CIP) certification.

Systems Integrated has the follow capabilities:

 Cybersecurity:
• Asset analysis
• Audit
• Validation
• Network threat testing
• Network design
• SCADA master station threat analysis
• SCADA master station patch analysis (typically done monthly)

 Control System Design:
• Licensed Control System Engineer
 Evaluate existing control systems and provide recommendations for changes to:
• Improve efficiency
• Reduce total energy cost
• Improve reliability
 Perform energy audits and provided recommendations for system changes to determine impeller efficiency

 Design Engineering Services:
• Development of:
 P&ID drawings
 Control system drawings including:
• Schematic
• Wiring
• Interconnects
• PLC control logic development for:

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 21  Rockwell – PLC 2, PLC5, SLC500 Family
 Rockwell – CompactLogix, ControlLogix
 GE 9030, GE Rx7i,
 Emerson Rx3i
 Modicon Quantum Family
 Siemens S7 Family
 SATT Control
 Omron Cj1, Omron Cj2
 IDEC
• SCADA system development for:
 Rockwell – PLC 2, PLC5, SLC500 Family
 Rockwell – CompactLogix, ControlLogix
 GE 9030, GE Rx7i, GE Rx3i
 Modicon Quantum Family
 Siemens S7 Family
 SATT Control
 Omron Cj1, Omron Cj2
 IDEC
 ONSITE®
• Radio surveys & wireless communications analysis
 RF engineering design support
 RF radio surveys
 RF mast and mounting

 UL 509 panel shop for manufacturing

 SCADA Installation
• Licensed electrical contractor (multiple states) and general contractor • Licensed journeyman electrician

 Wireless network
• Wireless Ethernet Radios
 Keywest
 Proxim
 MDS
 Cambium
 Phoenix

• Wireless serial radios
 MDS
 Phoenix

The following is a matrix identifying some of Systems Integrated’s customers and the type of systems that were delivered. As can be seen, SI has significant experience in all of the major SCADA systems and can provide to the City of Fullerton an unbiased evaluation of all of these

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 22 SCADA systems as well as recommendations to the City based upon the support staff available to the City and the City’s long term support goals.

Project /
SCADA Packages
GE iFIX
GE Proficy Machine
Edition
GE Proficy Plant Edition
Wonderware Intouch
Wonderware System
Platform
ONSITE
Emerson Ovation
Ignition
AB FactoryTalk
InduSoft
Harris SCADA
City of Redding,
CA ✔
City of Reedley, CA ✔
City of Ontario, CA ✔ ✔
City of Santa
Barbara, CA
✔
City of Idaho Falls,
Idaho
✔
City of Chula Vista,
CA
✔
US Army Corps of
Engineers (USACE),
MO
✔
Elsinore Valley
Municipal Water
District (EVMWD), CA
✔ ✔
AG Yellowknife,
Canada ✔ ✔
City of Carson, CA ✔
Bethpage, NY ✔
Massapequa Water
District, NY ✔
Seattle Public Utility,
WA ✔
Los Angeles Dept of
Water and Power
(LADWP) Castaic, CA
✔
Metropolitan Water
District (MWD) of
Southern California,
CA
✔
City of Lake Elsinore,
CA
✔
Suffolk County Water
Authority (SCWA),
NY
✔
US Bureau of
Reclamation, AZ ✔ ✔

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 23 Project /
SCADA Packages
GE iFIX
GE Proficy Machine Edition
GE Proficy Plant Edition
Wonderware Intouch
Wonderware System
Platform
ONSITE
Emerson Ovation
Ignition
AB FactoryTalk
InduSoft
Harris SCADA
San Lorenzo Water
District, CA ✔
Oklahoma City, OK ✔
Monte Vista ✔
LAX Cogen Power
Plant, CA
✔
Chicago AT&T 911
Centers, IL
✔
Christ Hospital
Chicago, IL
✔
John Wayne Airport
Cogen Power Plant,
CA
✔
Beale AFB, CA ✔
Camp Roberts, CA ✔

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 24 REFERENCES

ELSINORE VALLEY MUNICIPAL WATER DISTRICT (EVMWD)

Organization Name: Elsinore Valley Municipal Water District (EVMWD) Contact Person: Jim Ollerton, Director of Information Technology Contact Information: Address: 31315 Chaney Street
Lake Elsinore, CA 92531
Phone: 951/674-3146 ext. 8277
E-mail: [email protected]
Background: Elsinore Valley Municipal Water District is 97 square miles providing both water and wastewater services. The water portion of the system consists of well, booster, pressure sustaining, and reservoir sites with ground water treatment plant and a surface water treatment plant. The wastewater system consists of 50 lift stations and three wastewater treatment plants.

The old SCADA control system was based upon a 450 MHz Motorola wireless communications system and a Wonderware SCADA master. The overall response time of the system (from the time the command was issued to the response showing on the SCADA system) was in the range of 10 minutes.

Services Provided : Systems Integrated was awarded an engineering services contract to perform an assessment of all the existing equipment, provide recommendations and multiple options for the upgrade. During the first phase of the project Systems Integrated did an assessment of the existing c ommunications network as well as determining what would be required to provide an overall response time (from command issued to response shown) in the range of ½ second. EVMWD also requested the ability to have remote HMI’s installed in the field that would allow EVMWD the ability to access the control system independent of the status of the server. Systems Integrated proposed a solution that would support multiple redundant servers as well as able to operate the system even if the field
devices cannot get access to the se rver. The
design concept was to provide a solution that
would allow any field location to dynamically
access any other field location and in addition, all
of the field sites could communicate to provide a
common HMI interface system wide.

Key Outcomes: The system was designed
around the concept of a distributed system that
would provide all typical control room functions to
operators using a high- speed microwave
wireless network. Enabling Ethernet to every
device in the system allowed for a fully peer-to-
peer design where PLCs and RTUs could be programmed to share data asynchronously and without the need for a central server as was the traditional architecture. This allowed the operators to have the full capability of the SCADA system in the field, and they were no longer bound to the control room.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 25 The SCADA system automatically downloads PLC software to the application framework enabled PLCs. All standard SCADA applications are bundled including data visualization through process graphics, visual/audible/email/text based alarming, historical data storage, trending, event detection and many other features. EVMWD has over 201,603 points in their water, wastewater and agriculture service connections.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 26 SEATTLE PUBLIC UTILITY (SPU)

Organization Name: Seattle Public Utilities (SPU)
Contact Person: Robert Keenan, Operations Technology Manager Contact Information: Address: Water Quality and Supply Division 2700 Airport Way South
Seattle, WA 98134
Phone: (206) 386-9089
E-mail: [email protected]
Specific Services Provided: Seattle Public Utilities (SPU) is the largest gravity feed water district in the United States, and until recently the largest untreated water system in the United States. SPU has a large watershed located east of the city that provides 98% of all the water for the district. Systems Integrated was awarded a design build contract as both the manufacture of the control system
ONSITE® as well as manufacture of the hardware for the system.

The project consisted of replacing a tone telemetry system used to control the levels of lakes and reservoirs by controlling a system of valves, pump stations and treatment plants, monitoring and controlling a number of existing treatment facilities interfacing to Siemens PLCs, providing all of the hardware and software fo r the control room, emergency center control room, and the large screen display system. The project was implemented in phases to ensure that the control system would transfer from the tone system to the SCADA system seamlessly (in other words the new system had to be installed while the old system remained in control). To support the transfer process, SI, as the manufacture of the SCADA system, provided additional special hardware interfaces that
allowed both the
existing tone
equipment and the
new SCADA
equipment to
operate in parallel
even though the
two systems were
dissimilar.

During Phase I of the project the overall design was completed and the hardware for the field installation was manufactured at SI’s San Diego facilities and shipped to SPU for field installation.

SI coordinated the installation process, so the new communication equipment was installed concurrently with the new SCADA field equipment. Once the communications and SCADA field equipment was installed, the parallel interconnects were made and parallel operation was tested.

This was repeated at all field sites. After Phase I was completed, the new SI control system was able to control the SPU System. Phase II was operator training on the new system while maintaining the backup of the benchboard control system. Once the training was completed and the operators were comfortable with the new SCADA system Phase III was allowed to start.

Phase III consisted of turning the power off of the benchboard control system (remained as a cold standby for a period of time, before it was demolished) and the new control room was constructed.

Upon completion of phase III, the operators were relocated, large screen displays were activated and the primary control room / SCADA system was fully operational. Phase IV duplicated the

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 27 control room functionality at another facility to provide SPU with an emergency secondary control center for control of the system. At the completion of the project there were two sets of redundant servers in lock step to ensure full control could be maintained by SPU.

Unique elements of this system are the requirement to move water from the reservoirs located in the East into the City. SPU had to manage the flow of water to ensure the tanks and reservoirs in the City did not overflow as a result of improper operation of the various pipeline and canal controls. The system controls and monitors everything including pump stations, control valves, chlorination systems, pressure regulating structures, and pressure monitoring facilities. The total number of tags in the system exceed 200,000, with one of the significant uses of the tags is to allow site to site control used to move water from East to West (the SPU system is similar to MWD’s aqueduct system).

SI provided a turnkey water distribution SCADA system using ONSITE for control and monitoring
of the potable water distribution system throughout the greater Seattle metropolitan region. The system consists of a main Operations Control Center, a backup Network Operations Center and 120 Allen Bradley PLC control panels connected via frame relay network.

Systems Integrated was responsible for the system design, engineering, PLC panel manufacturing, installation, and start-up for the system. The scope of supply includes computers, software, PLCs, instrumentation, communications, and network LAN/WAN appliances. The SCADA computers, network appliances and software were first installed and preconfigured to start acquiring data for all remote sites. A remote site was upgraded with new PLC panel, instrumentation, and communications interface. All components were tested with SPU personnel for proper operation before scheduling a cutover.

During the day of site cutover, the tone telemetry equipment was retired and operations moved to the new systems screens for monitoring and controlling the new site. This resulted in no loss of site visibility by SPU during any part of the cutover sequence.

System Upgrade: SI upgraded the SPU servers and SCADA software in 2015. The upgrade included upgrading the server hardware to new HP Proliant servers with VMWare virtualization software and Linux operating systems.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 28 CITY OF SANTA BARBARA

Organization Name: City of Santa Barbara
Contact Person: Kelly Greeley, Maintenance Supervisor
Contact Information: Address: 1150 San Roque Road
Santa Barbara, CA 93105
Phone: 805/451-5990
Project Name: Ortega Ground Water Treatment Plant
Rehabilitation and Improvement Project (OGTP)
Overview: The City owns and operates the Ortega Groundwater Treatment Plant (OGTP) located at 220 E. Ortega Street, Santa Barbara. The OGTP was designed to treat water from 4 City production wells. The original OGTP was put in service in 1976, and had a design capacity of 2.6 MGD. The plant capacity was increased in 1978 to a total of 3.9 MGD by upgrading the chemical feed system and adding one pressure filter. The OGTP was designed for iron and manganese removal, using dual media pressure- type filters. Manganese greens (constant regeneration type) and anthracite coal constitute the basic filter media.

The OGTP Rehabilitation and Improvements Project included the following features: The addition of a filter tank, raising the total to four on- site filter tanks, new backwash system, new chemical injection systems, Wonderware HMI and historian system and a new Allen-Bradley ControlLogix PLC control panel. The PLC panels were designed and manufactured in Systems Integrated’s UL 508 control panel manufacturing facility in San Diego.

Project Work Plan: Systems Integrated was part of the team that consisted of City engineering staff, construction manager, plant supervisors and technicians, the general contractor and various subcontractors. We participated in the entire process from the control system design to construction of the plant, manufacturing the control panels, supervising the installation of the control system, site commissioning, acceptance testing, as -built documentation and training of the City staff.

Systems Integrated worked closely with the City project team to develop the architecture for the new control system. We brought our experience with similar projects and developed the control system processes and specific control strategies for the new filtration and chemical feed systems, motor controls and instrumentation. Working closely with the City we were able to incorporate elements that tailored the system to match how the plant was going to be operated. During the PLC software programming phase we held workshops to discuss the specifications and make sure that the implementation incorporated real feedback on how each process needed to be controlled. We conducted similar workshops for the development of the HMI screens and worked with the operators to capture their specific methods of interacting with the control system. During the process we incorporated features that helped integrate the wells into the plant control system.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 29 Our scope of work included:
 Engineer the control System
 Design, manufacture, configure, and program a new Allen- Bradley ControlLogix PLC control panel. The panel was manufactured at SI’s UL 508 panel shop in San Diego and delivered to the site for installation by the electrical contractor.  Furnish and configure a new plant communications network including a secure high speed link to the Cater WTP.
 Program the new PLC to automate the new contactors, filters and chemical feed systems.  Provide, configure, and program new redundant Dell servers and Wonderware Historian software.
 Provide, configure and program a new SCADA Alarm remote alarm dialer system.  Design and program new Wonderware InTouch SCADA interface screens to automate the new plant systems and provide remote operation from the Cater WTP.  Configure the system database, alarms and reports for the new processes.  Provide associated testing, documentation, licensing, com munications support and training.

Equipment/Software:

PLCs: Allen-Bradley ControlLogix PLC
HMI Workstation: Logic Supply hardened solid- state CPU w/Hope Industrial Systems touchscreen
Software: Wonderware HMI
Networking: Layer 3 Ethernet Switches, fiber optic link to City offices.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 30 MASSAPEQUA WATER DISTRICT
Organization Name: Massapequa Water District
Contact Person: Stan Carey, Superintendent
Contact Information: Address: 84 Grand Ave.,
Massapequa, New York 11758
Phone: 515/798-5266
Email: [email protected]

Background: Massapequa Water District is
located in Long Island, New York with a
population of over 55,000 people. Massapequa
is a well water system which has 12 wells, six
booster stations and tanks and reservoirs.

Massapequa Water District was formed in 1930
and has grown by more than 800% since its
inception.

Description of Work Performed: As a result of
Hurricane Irene in August 2011, the storm
caused a failure of the communications network
for the Massapequa Water District's
(Massapequa) water SCADA system.

Massapequa awarded a contract to Systems
Integrated in 2011 to (1) evaluate the existing
system and provide Master Plan for addressing
the SCADA system for the next 10 years, (2) provide recommendations to address the communications issues, and (3) implement the recommendations for resolving the communications issues.

At the time Massapequa had an Emmerson SCADA system consisting of a redundant SCADA servers with remote sites connected using communications systems provided by the internet service providers. Systems Integrated’s master plan recommended a number of changes , but the highest priority was to provide a redundant communications system. Other recommendations included (1) upgrade the SCADA system within the next 5 years (EOL), (2) separate the redundant SCADA servers (the system was installed in the basement of the operations center), (3) implement video surveillance at all of the sites, (4) add monitoring of all building doors, and (5) audit trail monitoring of SCADA system changes. Based upon the se recommendations, SI was directed to implement a redundant communications system consisting of Internet server network services and a wireless network service. SI provided a high speed (100 mbps) wide area, hybrid communications system that consisted of a combination of a high speed wireless system and now supports over 30 cameras and SCADA network (triple redundancy) . During the last nine years Massapequa has had sixteen hurricanes with winds in excess of 100 Mph with a communication up time of 100%. SI also provided support for separating the redundant servers to relocate them

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 31 into separate facilities, and in 2019 replaced the existing Emmerson system with an Allen Bradley PLCs based system.

Systems Integrated has been under contract with Massapequa for the entire time (2011 to present) and has implemented all the recommendations associated with their master plan. During the SCADA replacement the process was done to ensure that, at no time, was there loss of control of the system. The SCADA upgrade was completed in 2020. Of note was the implementation of the changes was accomplished based upon an incremental funding approach that allowed the District to upgrade various components of the system over a multi-year funding cycle.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 32 CITY OF CHULA VISTA
Company Name: City of Chula Vista
Contact Person: Joe Allshouse, Pump Maintenance Supervisor Contact Information: Address: 1800 Maxwell Road
Chula Vista, CA 91911
Phone: (619) 952-2409
Background: City of Chula Vista, an incorporated city located in the southern part of San Diego County has a population of approximately 225,000 people making it the second largest city in the county. The system consists of 15 sewage lift stations, two sewer line monitoring stations and miscellaneous sites including parks, a nature center, and two city pools.

Description of Work Performed: Systems Integrated was contracted to provide a master plan and implement the master plan under a design / build contract. The sc ope included doing an assessment of the existing system and providing a path forward to upgrade the existing system to provide a high reliability solution. As a result of the master plan development a number of recommendations were made. The recommendati ons that were implemented consisted of (1) implementing a wireless communications network, (2) replacing all of the existing control and monitoring equipment at all of the remote sites with a PLC based solution, (3) replacing the existing SCADA master system with a redundant SCADA master system. subsequent to the initial upgrade, Systems Integrated upgraded the original system to incorporate an additional 5 lift stations into the system.

Maintenance Support: Chula Vista has opted to use a broad form maintenance support program offered by SI. In this program we take care of both the ONSITE SCADA software as well as the
field hardware and software. Chula Vista provides a 7 X 24 hour remote access to their system for SI to evaluate issues. Whenever there is a problem, SI is contacted to diagnose the problem and provides recommendations on how to fix the problem (Chula Vista personnel do the repair) or SI sends out support personnel. Over the past 5 years, the City’s service requests have been related to field hardware issues not SCADA server or PLC issues.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 33 BETHPAGE WATER DISTRICT

Organization Name: Bethpage Water District
Contact Person: Michael J. Boufis, Water District Superintendent Contact Information: Address: 25 Adams Avenue
Bethpage, NY 11714
Phone: 516/931-0093
E-mail: [email protected]
District Overview: Established in 1923, Bethpage
Water District is one of the oldest water districts on Long Island, NY. Their water comes from 8 wells on 5
pumping sites, with a total pumping capacity of over
11,000 gallons of water per minute. All wells combined pump approximately 1.4 billion gallons of water per year.

Their 3 large storage tanks can store 4.25 million gallons of water for periods of peak usage. All their wells and distribution system comply with New York State
Department of Health standards for public drinking
water. All the District’s water comes from underground
wells. Unlike New York City, Long Island does not use
surface water nor is it a part of larger supply system. The District maintains 9 deep underground wells. There are also 2 elevated water storage tanks and 2 ground
storage tanks located at 7 plant sites throughout the
District’s service area.

Today, the Bethpage Water District is still a relatively small water supplier, but it now has more than 8,800 accounts, a full-time staff of 12 and 107 miles of water mains within the District. The District serves Bethpage, Old Bethpage, Plainview, Farmingdale and Levittown.

The District has all the efficiencies and technology of any modern municipal water system including standby generators at all wells in the event of a power failure. Every gallon of water consumed by District users is recorded by computer and billed accordingly.

Specific Services Provided: Systems Integrated was awarded an engineering services contract to perform an asset analysis and an assessment of the requirements to determine the correct SCADA solution which would allow Bethpage to continue to expand its water production capability. The services included the ability to provides all levels of support (the Bethpage support contract includes all SCADA hardware, communications hardware, field hardware and all software). Bethpage selected an appliance SCADA solution that would allow their system to operate without a central control room. Local HMI’s are provided at all the field sites, and from any HMI anywhere in the system they are able to view and control the entire system. In addition, the system provides the ability to access the SCADA using tablets, smart phones or laptops.

Systems Integrated’s control system has been in service for several years and was implemented to allow for better control of their water distribution system. As the District has grown (mainly in terms of ensuring safe water), new proc esses have been implemented with the overall goal of taking well water and making it safe to drink. Bethpage is located in an area that, during WWII, Grumman manufactured airplanes for the war effort. During the manufacturing process, large

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 34 amounts of organic solvents were dumped onto the ground and over time have now infiltrated the aquifer.

The SCADA system has become the primary method whereby the organics can be removed from the water as the process is so complex it cannot be operated manually. There are a total of 4 treatment plants associated with Bethpage, with each treatment plant addressing organic solvent removal (via air blowers), activated charcoal, and chlorine to purify the water and, with the use of chlorine ensures that it is safely deliver ed to all of its customers. In addition to the 4 treatment plants that processes all the well water, there are multiple elevated tanks.

SI, as with its other customers, provides automation engineering support services to allow Bethpage the ability to communicate with all its remote sites using a wireless infrastructure.

Bethpage implemented a wireless infrastructure to allow for higher reliability as the local communications carriers do not provide high reliability communications circuits at reasonable prices. The wireless infrastructure is designed and is used to support the SCADA, security and an automated meter reading requirement.

Key Outcomes: The key outcomes of the project are (1) ability to control the system from any site. (2) A wireless communications infrastructure. (3) The ability to operate the system even if the redundant servers are not able to communicate to the field. (4) Full outsource of all the maintenance of the SCADA system (Bethpage has no SCADA personnel to support the system). (5) Completely cyber secure solution meeting all of the latest AWWA cyber requirements and is fully compliant with Homeland Security cyber requirements. (6) Multiple layers of redundancy to allow full operation of the system 100% of the time for the last several years. (7) Secure remote access and control of the system using cell phones / tablets.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 35 PROJECT TEAM

Systems Integrated’s engineers have years of experience developing systems that will achieve sustained benefits for our customer. We evaluate hardware, software and communications for the system taking into consideration long- term supportability; reliable and proven technology; security; expandability, and user-friendly operation. SI designs are standards based, ensuring that our customers can expand/upgrade their systems, and we always seek commercial off the shelf (COTS) products to reduce end-user costs and maintenance. Systems Integrated’s control systems are designed to grow with our customer’s requirements and evolve with changing technologies providing a life expectancy of at least twenty years.

Systems Integrated’s success in delivering control systems is due to the depth of experience of our engineering and construction team. Most of the key members for this project individually have decades o f experience and a minimum of 7 years of experience working on similar SCADA projects with Systems Integrated. For the City of Fullerton, SI’s project team will include the following people:

Larry Pomatto
Maris Janson
Arde Kirka
Janice Ruszczyk
James Pham
Thomas Waldowski
Shawn Belmore

A

RDE KIRKA
Mr. Kirka has over 25 years of experience delivering SCADA systems and is an expert in number of areas needed to support the project. Mr. Kirka will primarily be responsible for the design and implementation of the PLC software and support the HMI development. Mr. Kirka was the developer of the PLC and HMI software for more than 100 customers and was involved in all the reference sites identified in this proposal. Arde is the manager and chief design engineer for PLC implementation. His team consists of a number of degreed engineers that are responsible for the development, deployment, testing and documentation of the PLC software.

PLC: PLC and SCADA programming and configuring. He will oversee the PLC development that requires ladder logic. Mr. Kirka has more than 13 years with Systems Integrated and has been developing PLC /PAC based systems for more than 25 years. He is proficient in programming all the IEC 61131-3 languages and is certified on PLC(s) identified in this proposal.

SCADA HMI: In the area of SCADA systems, Mr. Kirka is certified on all the SCADA HMI systems identified in this proposal.

JAMES PHAM
Network and Hardware Equipment: Mr. Pham will be responsible for the selection, purchase and configuration of the computer and network hardware for the project. Mr. Pham has achieved his U.S. Department of Homeland Security Cybersecurity and Infrastructure Security Agency (CISA) 301V Industrial Control System s (ICS) Cybersecurity certification , and he is NERC CIP certified for development and evaluation of the software and networks. Mr. Pham is also Adtran certified for routers and switches and SonicWall certified for firewall implementation.

SHAWN BELMORE
Panel Layout: Mr. Belmore is an electrical engineer and his focus is on preparing all of the hardware submittals and drawings required for the implementation of projects. Shawn will be involved in the Master Plan process to collect field information. For the Master Plan integration process he will be principally involved in the development of the drawings, panel layout and bills of material. He oversees all of the panel construction done in the shop and provides quality control to support the UL508A standards and ISO 9000 requirements for what is manufactured. In

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 35 addition, he ensures that the panels are built to the drawings and prepares the Factory Acceptance Test.

JANICE RUSZCZYK
Screen Development: Ms. Ruszczyk will be responsible for the development of the HMI screens for the project. She has more than 25 years of GE DataViews ® design and implementation experience, is the chief design engineer for the USBR iFIX system development and has developed HMI interfaces for almost all the SCADA systems available on the market today.

TOM WALDOWSKI
Mr. Waldowski has more than 30 years of experience and has been working at Systems Integrated for more than 23 years. Mr. Waldowski will be responsible to ensure that all the software implemented meets all the cybersecurity requirements for network communications as well as overseeing all the screen and control strategy development.

L

ARRY POMATTO
Mr. Pomatto has more than 40 years developing and implementing SCADA systems and has been awarded various patents within the electric and communications areas. For this project, Mr.

Pomatto will be the project manager and the principle engineer during the Master Plan integration phase of the project. Mr. Pomatto will be responsible with coordinating both the engineering efforts as well as the construction efforts. Mr. Pomatto was the project manager for all the referenced projects included in this proposal.

Mr. Pomatto has his U.S . Department of Homeland Security Cybersecurity and Infrastructure Security Agency (CISA) 301V Industrial Control Systems (ICS) Cybersecurity certification; he is NERC CIP certified for development and evaluation of the software and networks, and he has his DOD cybersecurity certifications.

Maris Janson, P.E.

Mr. Janson has been working with Systems Integrated for over twenty years (Boyle Engineering / AECOM) before joining SI and continuing his work as a Principle Engineer developing Master Plans, Design / Build specifications and SCADA implementation specifications. He brings a wealth of knowledge as he has developed Master Plans for many water districts throughout the US.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 36 LARRY POMATTO
Role on Project
Project Manager - Senior Design
Engineer
In his role as a project manager, Mr. Pomatto brings
over 40 years of experience designing and
managing large -scale automation and control
system projects (projects exceeding $20 Million). His
technical expertise, breadth and depth of experience
with mechanical, electrical and software systems,
hands-on field ability coupled with a practical
approach to design and production, ensure that the
control system uses current leading technology and
exceeds customer expectations. Complete customer
satisfaction, cos t-effective systems, and meeting
customer requirements are his top priorities. Mr.

Pomatto is responsible for insuring that the project is moving forward at all times. This includes everything
from project scheduling to billing to development of
drawings and specifications.

As the Senior Design Engineer, Mr. Pomatto has
significant expertise in the field of automation with
more than a 12 patents in everything from
automating electrical substations, to detecting
capacitors on distribution lines, to controlling the
traffic lights. Mr. Pomatto is a subject matter expert
in the disciplines of (1) wide area network design and
topology, (2) distributed automated control systems
(patent on distributed control systems for substation
automation), (3) cybersecurity with respect to
SCADA deployments that provide high level of
redundancy, (4) development of long term,
supportable, SCADA systems with a minimum of
spares and labor to support the system, and (5)
deployment of SCADA upgrades that minimize or
eliminates any down time of any field systems during
the upgrade.

In addition to the technical areas, Mr. Pomatto is also SI’s chief safety officer. Systems Integrated makes
safety a priority both in the office and in the field and has never had any safety violations.

Expertise:
 40+ years SCADA & systems
experience
 Project Engineering Management
 System Design
 Wired & Wireless Communication
Networks
 Critical Utility Control Systems
 Oversight of large-scale projects
from conception through completion
Contact Information
Phone: 714-338-3241

Years of Experience:
40+

Certification:

Proxim Wireless Certified
Adtran Network Certified
Adtran VoIP Network Certified
Company Facility Security Officer
(SFO)

Professional Affiliations:

IEEE, AWWA, ITSA
Security Certification:
 Transportation Worker Identification
Credential (TWIC)
 Department of Homeland Security
 Department of Interior
 Department of Defense
Publications/Patents:

Mr. Pomatto, has filed for and
received over 12 patents on a variety
of automation control devices and
systems
Education:

B.S., Electrical Engineering,
Stanford University, 1973
Years with Firm:
36+

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 37 Relevant Experience
Los Angeles Department of Water and Power
Castaic Power Plant Control System
Castaic, CA
Project Description: As the Project Manager and Senior Design Engineer for the $11 million control system upgrade of the 9 th largest pumped storage system in the United States, Mr.

Pomatto was responsible for implementing the project scope which included: the control system upgrade for the seven 270 Megawatt generator / pumps; all of the balance of plant support equipment (including the 230KV switchyard, the 4160V switchyard, and the penstock protection system); and the interfaces to the dispatch control system (ECC-SCADA). And ensured that the control system was fully compliant with the NERC, NIST and FIPS cyber-security requirements for critical cyber -asset infrastructures. This prime contract required that the engineering and software engineering firm was responsible for the design, engineering, supervision, startup, documentation and training for the project. LADWP technicians were responsible for the installation of the control system within the plant under the supervision of Systems Integrated.

SI’s responsibilities included system engineering; network engineering; detailed electrical and mechanical design engineering; autom ation engineering; relay protection, and project coordination.

Role and Responsibilities: Mr. Pomatto’s project responsibility included the management of over $6 million dollars in subcontracts for exciters, governors and protection equipment as well as c oordinating with LADWP’s field construction group during the system installation. He developed a distributed control system and the associated network communications infrastructure to provide a high availability system such that the plant can continue to operate even if the redundant SCADA servers are off line.

Mr. Pomatto was also directly involved with the development of the interface standards that allows all of the IEC61850 and DNP devices to interact in such a way as to allow for “one button starting” of the generators in the plant. Mr. Pomatto was on the project from beginning of the project through the completion of the project, which occurred in 2018.

County of Los Angeles, Department of Public Works
Wireless Communications System for the Intelligent Traffic Management System Los Angeles County, CA
Project Description: This was a $10.2 million project to design, engineer, install and manage the deployment of a wireless communication network infrastructure used to synchronize the traffic signals for over 1,300 intersections within the County of Los Angeles. This project had two phases: Phase 1 was a demonstration of Systems Integrated’s design, consisting of 50 intersections, and as a result of the successful demonstration of the design, LA County released the remaining 1,250 intersections to SI to implement the network across the County.

The communications system uses a combination of fiber optic, wireless and copper communications technologies to implement the solution. For the wireless system, Mr. Pomatto was the project manager responsible for coordinating the radio surveys and the integrated network communications system that relied on a combination of media to accomplish the overall communications task to provide the County with the ability to ac cess all 1,300 intersections

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 38 every second, 24 hours a day, 7 days a week. In his engineering role, Mr. Pomatto developed the IP network scheme to allow all of the traffic intersections to allow both the County and outside consultants to access all of the t raffic data while restricting only authorized users the ablity to change the operation of the signals. This project was started in 2007 and continues with expected completion in 2020.

Role and Responsibilities: SI is a leading supplier of these types of communication systems as a direct result of Mr. Pomatto’s field- proven abilities and the utilization of value-engineering methodology during the implementation of this project. Under his direction, the SI staff developed the entire radio survey for the entir e project as well as assigning all of the IPs associated with the project and developing the various routing protocols to ensure that the network was both secure and reliable. As part of the project, Mr. Pomatto took the initiative to propose to the County that it would be in the County’s long- term best interest to use their personnel for the installation process. The reason for this approach was to ensure that the County maintenance crews would be fully trained to provide long- term support of the system.

To ensure that there were no issues associated with damaged equipment during the installation process, Mr. Pomatto proposed the concept that any damage to any equipment caused by the County crews would be warranted by SI. In other words, if the County’s per sonnel made a mistake and damaged the radio equipment, SI would replace it. The County accepted the proposal, and this partnership approach provided valuable field training to the County crews as they deployed the network under SI’s supervision. SI’s project responsibility shifted from the original contract, to one that SI designed the network system; provided the equipment, and supported the County crews during the installation of the system.

Mr. Pomatto was the Project Manager during the implementation of the communications network working with the County’s field technicians.

Elsinore Valley Municipal Water District
Water Distribution SCADA System
Lake Elsinore, CA
Project Description: This design- build project for a water SCADA system used several new innovations including high-speed microwave communications, intelligent Remote Telemetry Units and parallel operation during installation and system cutover to minimize disruption during the transition. EVMWD consists of more than 200 remote sites which includes water booster stations, well sites and tanks; lift stations; and water treatment plants.

The EVMWD project consists of a number of contracts staring in 2005 and continues today. The first contract was for more than $3 million and is currently in excess of $8 million since the system was expanded from less than 50 sites to more than 200 sites.

Role and Responsibilities: Mr. Pomatto was the chief technologist responsible for developing and deploying a distributed SCADA control system that allowed the remote sites to continue to operate even if there is a complete failure of the redundant servers. To support the SCADA deployment, develop a redundant wireless communications system that supports the control; VoIP and Video Surveillance requirements of the system.

Mr. Pomatto is the project manager, has been overseeing this project since inception and continues to support all of the upgrades to the EVMWD system.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 39 Seattle Public Utilities
Water Distribution SCADA System
Seattle, WA
Project Description: This design- build project for a water SPU system used an intelligent Remote Telemetry Units (PAC based) solution and supported parallel operation during installation and system cutover to minimize disruption during the transition. The SPU system consisted of more than 130 remote sites that included water booster stations, well sites, PRVs, treatment plants and reservoirs. SPU is one of the largest gravity feed water systems, using a very large water shed East of the City to feed the entire system. The water is transferred from the watershed to the City via a combination of open canals and tunnels, all of which are controlled by the SCADA system. As part of the SPU system, the Tolt river plant is used to control the water flow from the water shed to the City. This site requires that it be fully operational even if there is a communications system failure, and as such, the ultimate design implementation included providing a SI
TEVIEW® node at this location as well as an operator interface. The design allows the Tolt facility to be controlled locally or remotely.

Role and Responsibilities: Mr. Pomatto was project manager and design engineer in charge of the team that did the design, installation of the replacement SCADA system.

As part of this effort, Mr. Pomatto was the licensed electrical contractor and oversaw all of the installation work performed by the installation team.

Mr. Pomatto provided on -site support during the installation and startup of the project and provided the coordination with the remainder of the SI team.

Suffolk County Water Authority
Water Distribution SCADA System
Long Island, NY
Project Description: This design- build project for a water SCADA system use an intelligent Remote Telemetry Units (PAC based) solution and supported parallel operation during installation and system cutover to minimize disruption during the transition. The SCWA system consisted of a total of more than 400 remote sites that included water booster stations, well sites, treatment plants, PRVs and reservoirs.

The project replaced the existing custom SCADA system, which used a hard- wired communications system, with a wireless distributed SCADA system. SI provided the design and manufactured all of the SCADA hardware, installed all of the field PLCs, and interfaced to the existing MCC enclosures. In addition SI developed all the configuration software to support automated control of all the sites, developed all the HMI screens, installed and tested the entire SCADA system.

Mr. Pomatto was the project manager responsible for ensuring that the overall design met all of the requirements and was implemented in a manner whereby SCAWA never was without control of the water system.

Role and Responsibilities: Mr. Pomatto was project manager and design engineer in charge of the team that did the design, installation of the replacement SCADA system.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 40 As part of this effort, Mr. Pomatto was the licensed electrical contractor and oversaw all of the installation work performed by the installation team.

Mr. Pomatto provided on -site support during the installation and startup of the project and provided the coordination with the remainder of the SI team.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 41 MARIS JANSON, P.E.

Role on Project
Principle System Control Engineer
Mr. Janson has extensive experience in
construction administration, start -up, and
debugging of instrumentation and controls for
water and wastewater treatment plants, sewage
collection systems, and water distribution
systems. As a principal engineer, he has been
involved with the quality assurance review for
many of the companies I&C design projects
including constructability and operability
considerations.

Mr. Maris Janson is experienced in the design,
installation, construction administration, start-up,
and debugging of instrumentation and controls for
water and wastewater treatment plants, sewage
collection systems, and water distribution
systems. Experienced with instrumentation
sensors, analyzers, transmitters, and receivers;
measurement and control principles; analog and
digital control systems -conventional and
microprocessor based; distributed control
systems; and data acquisition telemetry systems
- land line, radio, and microwave.

Relevant Experience
North Canadian River Dam SCADA
System
City of Oklahoma City, Oklahoma
Project Description: Provided design and
construction phase services for three fully -
automated low -level dams across the North
Canadian River for Oklahoma City’s MAPS
project. Each dam site utilizes top -operated
hinged crest gates to maintain upstream pools
(lakes) for recreational use. Additionally, two of
the dam sites have boat lock systems. AECOM
designed a SCADA system for the project
consisting of primary and back -up SCADA
servers, historical database server, closed circuit
TV for monitoring upstream and downstream dam
user activity, three master PLC/RTU associated
with the dam sites, 22 remote monitoring well
sites. The communication system for this project
consisted of 5.2 GHz mic rowave radios and

Expertise:
 40+ years SCADA experience
 Project Engineering Management
 System Design
 Automation Engineering
 Utility Control
 Management of large-scale projects
from conception through completion

Contact Information
Phone: 909-579-3971
Years of Experience:
40+
Professional License:

CA Control System Engineer - 2913
Education:

B.S., Business Administration,
University of Buffalo, 1971
AAS, Industrial Instrumentation,
State University of New York, 1968
Publications:

Janson, Maris, “Elsinore Valley MWD – 21st
Century Wireless SCADA System Upgrade
Project”, Presented at the American Water Works
Association, Spring Conference, Hollywood,
California, April 2008.

Janson, Maris, “EVMWD – Wireless SCADA
Network – Case Study,” Presented at the
Southern California Association of
Governments, Municipal Wireless Initiatives
Conference, Los Angeles, California,
November 2007.

Janson, Maris, “SCADA System Cost, Benefit
Issues,” Coordinator/Moderator at the
American Water Works Association Fall
Conference, Sacramento, California, October
2004.

Janson, Maris, “SCADA Technology from
Leased Lines to Broadband Radio,”
Coordinator/Moderator at the American Water
Works Association Spring Conference, Las
Vegas, Nevada, April 2004.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 42 unlicensed spread spectrum 902- 928 MHz radios from the monitoring wells to the Dam master PLCs.

SCADA System, Elsinore Valley Municipal Water District
Lake Elsinore, California
Project Description: Mr. Janson served as the Owners Repres entative, Lead I&C Design Engineer, and project manager for the construction management of a microprocessor -based distributed SCADA system that monitors and controls the District’s water distribution system, consisting of 56 remote reservoir sites (25 with solar power), 60 pumping stations, 25 wells, 5 reclaimed pumping stations, 3 major turnout metering structures, and 2 water treatment plants.

Scope of work included, prequalification of system integrators, construction administration, QA, inspection, system start-up and debugging, and final system commissioning.

High Mountain Reservoir Satellite SCADA System
Greeley, CO
Project Description: The city of Greeley, CO owns and maintains a system of six high mountain reservoirs and dams west of Fort Collins, C olorado. The reservoirs store and deliver water to the Bellevue Water Treatment Plant, which delivers treated water to the City of Greeley via pipeline. Since the reservoir sites are all in mountainous areas, site visits by operational personnel was very t ime consuming and extremely difficult during winter months. Because of the mountainous terrain, AECOM designed a solar powered satellite telemetry system to allow the City to monitor reservoir levels, spillway flow and upstream level, release structure flows, toe drain flows and dam piezometer levels.

Siphon Drop Power Plant
Yuma, AZ
Project Description: Yuma County Water User’s Association’s project consisted of a computer- based SCADA system utilizing radio telemetry for monitoring and control. Two 2.5 -megawatt generators were remotely controlled and monitored. In addition, slide gates on the All-American Canal and Yuma Main Canal were monitored and controlled. Flow through the Colorado River siphon and waste way was monitored along with the Walapai Canal system.

South San Joaquin Irrigation District Canal SCADA System Manteca, CA
Project Description: Scope of services included preparing the design criteria for the design of a radio based SCADA telemetry system to monitor and control an 18 mile canal system with 14 check structures and two spillways. The SCADA system consisted of PC computers for human machine interface, PLC based RTU’s for remote monitoring and control with 900 MHz radios, automatic alarm telephone dialer with voice synthesizer, laptop computer with dial up modem, and industry standard off the shelf SCADA software.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 43 ARDE KIRKA
Role on Project
Senior SCADA System Engineer
Mr. Kirka has over 25 years of experience in
engineering design, SCADA systems for control
systems, project management and R & D
projects. Arde is an experienced electrical
engineer with an extensive background in the
design and implementation of complex SCADA
systems using PLCs integrated with various
SCADA systems. Mr. Kirka will be responsible for
the design PLCs implementation and HMI/GUI
applications.

Relevant Experience
Old Lower Powerhouse Rehabilitation
City of Idaho Falls, Idaho
Project Description: Implementation of a
SCADA system which provides the control
system for the power house and allows operator
interface for each unit control panel through the
local Operator Interface Terminals and from the
local HMI workstation at the plant and interact
with the power dispatch center.

Role and Responsibilities: Mr. Kirka was
responsible for the implementation of the SCADA
system and the associated communications
network. The SCADA system provides the full
automated control of the plant while the fiber optic
communications system provides a reliable
network for full remote control of the plant.

Ortega Ground Water Treatment
Plant Rehabilitation and Improvement
Project Upgrade
City of Santa Barbara, CA
Project Description: The Ortega Groundwater
Treatment Plant (OGTP) was designed to treat
water from four City production wells. The original
OGTP was put in service in 1976 and had a
design capacity of 2.6 MGD. The plant capacity
was increased in 1978 to a total of 3.9 MGD by
upgrading the chemical feed system and adding
one pressure filter. The OGTP was designed for
iron and manganese removal, using dual media
Expertise:
 Wireless and Wired Network Design
 Certified Cisco CCNP switch, CCNP
route, CCNA security
 Control System Design
 Project Start-Up & Commissioning
Contact Information:

Phone: 858-810-0708
Years of Experience:
25+
Certifications:
 Cisco, multiple certifications
 Adtran, multiple certifications
 Proxim (certified for 10100, 800,
5054) licensed and unlicensed
radios
 Rockwell Plant PAX
 Rockwell PLC and Motion
 iFix SCADA System
 GE PLC 9030, 9070, Rx3i, Rx7i
 Wonderware SCADA System
 InduSoft SCADA System
Professional Affiliations:

IEEE, AWWA, ITSA
Security Certification:

Department of Interior
Education:

B.S., Electrical Engineering,
South Dakota State University
Years with Firm:
13+

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 44 pressure-type filters. Manganese greens (constant regeneration type) and anthracite coal constitute the basic filter media.

The OGTP Rehabilitation and Improvements Project included the following features:

Development of the fiber optic communications network and wireless communications interconnect to allow communications to the other treatment plants. Within the plant, Arde was responsible for the design of the PLC software, selection of the PLC hardware, selection of the SCADA HMI software and integration of the SCADA HMI to the PLCs.

Role and Responsibilities: Mr. Kirka worked closely with the City to develop the overall system architecture for the new processes and specific control strategies for the new filtration and chemical feed systems. Responsible for:
 Programed the new PLC to automate the new chemical feed systems.  Configured the system database, alarms, and reports for the new processes.

Elsinore Valley Municipal Water District
Water Distribution SCADA System
Lake Elsinore, CA
Project Description: This design- build project for a water SCADA system used several innovations including high- speed microwave co mmunications, intelligent RTU’s and parallel operation during installation and system cutover. EVMWD consists of 250 water booster stations, well sites and tanks; 35 lift stations; 3 waste water treatment plants, and 2 water treatment plants.

Role and Responsibilities: Mr. Kirka designed and developed the PLCs and HMI’s/GUI’s to have a dynamic network interface that ensured secure site to site communications over the wireless network as well as protecting the network reliability. He performed validation tes ting, system start-up and commissioning.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 45 TOM WALDOWSKI
Role on Project
Senior Software Engineer
Mr. Waldowski has over 25 years of experience in
developing and implementing software solutions
for monitoring and controlling wireless
infrastructure. Mr. Waldowski currently manages
and directs the efforts of the software group
responsible for maintaining all of the network
monitoring and cyber security monitoring
programs that support the various cyber security
infrastructure requirements.

His major achievements in support of the
communications network security and monitoring
was the development of a fully integrated wireless
Network Monitoring System that would detect
failures in the system; able to work with both
wireless and wired networks, and incorporate
network reliability and network security into a
single suite of applications that can be used to
provide a comprehensive monitoring and
management of Wide Ar ea wireless and wired
networks.

Relevant Experience
Los Angeles Department of Water and Power
Castaic Power Plant Control System
Castaic, CA
Project Description: This was an $11 million
control system upgrade of the 9th largest pumped
storage system in the United States, and
included: the control system upgrade for the six
270 Megawatt generator / pumps; all of the
balance of plant support equipment (including the
230KV switchyard, the 4160V switchyard, and the
penstock protection system); the interfaces to the
dispatch control system (ECC -SCADA), and the
control system had to be fully compliant with the
NERC, NIST and FIPS cyber security
requirements for critical cyber asset
infrastructures.

Role and Responsibilities: As the senior
software engineer , Mr. W aldowski was
responsible for the development and
Expertise:
 Software Development
 Network communications
infrastructure
 Cyber security monitoring system
implementation
 Project Start-Up & Commissioning

Contact Information:

Phone: 858-810-0710

Years of Experience:
25+

Education:

B.S., Electrical Engineering, 1984
Arizona State University, Tempe

Years with Firm:
23+

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 46 implementation of the SCADA system interfaces as well as supporting the integration of SCADA systems into wide area networks used to support large-scale water SCADA systems.

To support the cyber security as pects of the project, Mr. Waldowski was responsible for developing and deploying a variety of cyber monitoring tools to determine if there are any intrusions into the network. The system deployed, monitors all of the activity associated with all of the net work equipment, wireless equipment, Windows workstations and Linux / Windows servers with the goal of providing physical security intrusion detection, a network intrusion detection and a long-term audit trail of the network activity.

The system provided meets both the NEC, DOD and Homeland Security cyber requirements.

Elsinore Valley Municipal Water District
Water Distribution SCADA System
Lake Elsinore, CA
Project Description: This design & build project for a water SCADA system used several innovations including high- speed microwave communications, intelligent RTU’s and parallel operation during installation and system cutover. EVMWD consists of 250 water booster stations, well sites and tanks; 35 lift stations; 3 waste water treatment plants, and 2 water treatment plants.

Role and Responsibilities: Mr. Waldowski designed and developed the major portion of the SCADA system deployed at EVMWD.

City of Chula Vista
Wastewater Lift Station SCADA System
Chula Vista, CA
Project Description: SI was selected to provide a turnkey SCADA system to monitor and control sewage lift stations, sewer line monitoring stations and miscellaneous sites including parks, a nature center, and city pools.

The system communication broadband microwave radios are arranged in a point to multipoint configuration linking the City’s operation/IT facility to each remote site. Systems Integrated was awarded a contract to upgrade the original system to incorporat e new redundant SCADA servers, provide enhancements to increase the reliability of the radio communications network and incorporate additional sites into the system.

Role and Responsibilities: Mr. Waldowski developed and implemented the SCADA control system and implementation of the configurable PLC platform that supports centralized configuration using the SCADA system.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 47 County of Los Angeles, Department of Public Works
Wireless Communications System for the Intelligent Traffic Management System Los Angeles County, CA
Project Description: Systems Integrated was selected for the design engineering and management of the deployment of 1,300 intersection’s communication network infrastructure used to synchronize the traffic signals within the County of Los Angeles. The communications system used fiber optic, wireless and copper communications technologies to implement the solution to accomplish the overall task of the network to provide the County the ability to access all 1,300 intersections every second, 24 hours a day, 7 days a week.

Role and Responsibilities: Mr. Waldowski designed and developed the communications interface server software for the deployment of high- speed microwave communications network used to manage traffic controls at over 1,300 intersections throughout the County of Los Angeles.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 48 JANICE RUSZCZYK
Role on Project
HMI Development
Ms. Ruszczyk has 30+ years’ experience with the
HMI software and dynamic data visualization
tools on UNIX/LINUX/Windows operating
systems. Ms. Ruszczyk is a solutions- focused,
customer centric; team oriented Senior Software
Engineer with broad- based experience and
hands-on skill in the management of a software
product including product feature development ,
marketing and sale analysis, and customer and
technical support.

Ms. Ruszczyk works to define the product
roadmap for Systems Integrated’s
ONSITE®
DataViews® SCADA automation software client
and server solution and manages the software
development cycle to complete product releases
with quality and efficiency for customers and
markets.

Ms. Ruszczyk communicates with the SI
customer base to reach their goals and provide
solutions for their customized systems. Ms.

Ruszczyk conducts the research to define and
develop future enhancements to maintain the
state of the art ONSITE  DataViews® automation
software solution.

Ms. Ruszczyk manages the UNIX and Windows
hardware and software licensing and upgrades
for product release porting and maintenance, and
manages the developer team through all aspects
of software development cycle from definition of
requirements through specifications and coding,
testing, RTM, and maintenance.

Ms. Ruszczyk creates specifications; designs
and implements the data structures and c oding
for software product features; communicates with
cross-functional teams; writes preliminary
documentation to educate and train teams;
manage and schedule service packs for released
products; sets up external beta test sites and
manages feedback with beta sites and engineers.

Expertise:
 HMI Systems Design
 Software Development & Testing
 System Analyst
 Database Design
 RDBMS Development
 LINUX/Windows OS
 Project Management
 DataViews® - Product Technology
Manager
Contact Information:
858 810-0725
Years of Experience:
30+

Technical Skills:
 Linux/Windows
 C/C++
 Visual Basic
 Java
 InstallShield
 GraphOn
 Microsoft Visual Studio
2008/2010/2012 Microsoft
 XWindows-Motif
 DataViews®
 ONSITE®

Education:

B. S.,Computer Science
Merrimack College
North Andover, MA
1986

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 49 Relevant Experience
Los Angeles Department of Water & Power
Castaic Modernization Project
Castaic, CA
Project Description: This was an $11 million control system upgrade of the 9th largest pumped storage system in the United States, and included: the control system upgrade for the six 270 Megawatt generator / pumps; all of the balance of plant support equipment (including the 230KV switchyard, the 4160V switchyard, and the penstock protection system); the interfaces to the dispatch control system (ECC-SCADA), and the control system had to be fully compliant with the NERC, NIST and FIPS cyber security requirements for critical cyber asset infrastructures.

Role and Responsibilities: Ms. Ruszczyk was the lead on the HMI development for the project.

She worked with the Castaic management and operators to develop the various screens depicting the I/O used for the plant equipment. She managed the implementation of the screens; the validation of the screens with the plant equipment, and the HMI.

Metropolitan Water District of Southern California
SCADA Control System Upgrade
Los Angeles, CA
Project Description: The Metropolitan Water District of Southern California (MWD) upgraded their control system hardware which included the replacement of over 300 special purpose RTU’s used to control MWD infrastructure: the six water treatment plants; the aqueduct which pumps water from Parker Dam to the treatment plants located throughout the LA Basin; all the pressure reducing stations system wide; hydro power plants, and turnouts.

MWD selected Systems Integrated under a Design-Build contract to provide the solution because of our history of providing water SCADA systems; our ability to provide a standards -based solution, and our demonstrated capability to provide long-term support.

The scope of the project was to upgrade the six treatment plants and the central monitoring center.

This stage of the project included approximately 2,000 HMI screens and 6 redundant server pairs.

During follow on phases, additional servers were installed to support MWD’s aqueduct control system.

Role and Responsibilities: Ms. Ruszczyk was responsible for the team t hat handled the 2016 upgrade of Systems Integrated’s
ONSITE® DataViews®, which included the design, development and implementation of the HMI software for the MWD SCADA system project for one of the largest water wholesale agencies in the United States.

Professional Experience
Ms. Ruszczyk was part of the original development team for the DataViews ® software product while working with the DataViews Corporation. When GE purchased DataViews, she continued to manage the DataViews product for GE Intelligent Platforms and worked with the GE development group to implement customer’s DataViews requirements. While at GE, she managed the testing of each software enhancement/upgrade prior to release to ensure that it met GE quality standards.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 50 JAMES PHAM
Role on Project
Network & Hardware Integration
Mr. Pham is a software engineer with experience
in software application development, system
engineering, server configuration and
management including virtualization; cloud
computing and relational database management.

Mr. Pham is an expert in NERC Critica l
Infrastructure Protection (CIP) standards and US
DOD Security Technical Implementation Guide
(STIG) for cyber-security protection.

Relevant Experience
Los Angeles Department of Water & Power
Castaic Modernization Project
Castaic, CA
Project Description: This was an $11 million
control system upgrade of the 9th largest pumped
storage system in the United States, and
included: the control system upgrade for the six
270 Megawatt generator / pumps; all of the
balance of plant support equipment (including the
230KV switchyard, the 4160V switchyard, and the
penstock protection system); the interfaces to the
dispatch control system (ECC -SCADA), and the
control system had to be fully compliant with the
NERC, NIST and FIPS cyber security
requirements for critical cyber asset
infrastructures.

Role and Responsibilities: As software
engineer, he was responsible for the development
and implementation of the NERC CIP standards
for cyber-security protection. As part of this effort,
Mr. Pham was responsible for the team t hat
collected the asset data for each CIP device;
determined if the device was complaint and if not,
developed both the Technical Feasibility
Exception (TFE) request and the associated
mitigation plan for the device. Mr. Pham also
developed the automated m onitoring programs
required under section 7 of the CIP, as well as
developed the various reporting procedures

Expertise:
 System Analyst
 LINUX/Windows Operating
Systems
 Server Virtualization and Cloud
Computing
 Software Development and
Testing
 Database Design, RDBMS
development
 NERC Critical Infrastructure
Protection
 US DOD Security Technical
Implementation Guide (STIG)
Contact Information:
858 810-0716

Years of Experience:
7 years

Technical Skills:
 Python
 Java
 C
 MIPS
 VHDL
 Assembly Language
 Digital Logic
 Orcad/PSPICE
 Mac OSX
 Windows OS
 Linux

Education:

Bachelor of Science
Computer Engineering
University of California, Irvine
2013

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 51 required by the CIP. Mr. Pham was responsible for the configuration and administration of the SCADA system servers and developing and installing the VM of the servers.

US Army Corps of Engineers, Omaha District
Server Upgrade & Cyber Security
Project Description: Systems Integrated was awarded the SCADA automation project to design the control system that provided the ability to, from a central location, dispatch / control the six power plants along the Missouri River. The design of the system was to provide the ability at each plant to fully control the plant locally, as well as control of the plant using the dispatch center. SI provide its
ONSITE® DataViews® system with redundant servers located at each of the plants and at the dispatch center. SI was responsible for providing all PLCs, servers, workstations, as well as enclosures to support the hardware provided. The original project was completed in 2003 and in 2012, SI was awarded the contract to upgrade all the server and workstation hardware and install VM on the servers.

Role and Responsibilities: As software engineer, he was responsible for the development and implementation of the US DOD STIG standards for cybersecurity protection. Mr. Pham was responsible for the configuration and administration of the SCADA system server upgrade project involving upgrading six hydro plants on the Missouri River and was responsible for installing the VM on the servers.

Seattle Public Utilities (SPU)
Water Quality and Supply Division
Project Description: Systems Integrated (SI) provided a turnkey Water Distribution SCADA system for control and monitoring of the potable water distribution system throughout the greater Seattle metropolitan region. SPU services 2.7 million customers utilizing water from the Cedar River Watershed and the Tolt River Watershed. The initial project was completed in 2007, and in 2016 SPU engaged SI to upgrade and provide al l the SCADA equipment and to replace the obsolete hardware.

Role and Responsibilities: As software engineer, he was responsible for the upgrade from a Solaris-based server to a new redundant server pair using VMware and Red Hat Linux operating system. Mr. Pham was responsible for the configuration and administration of the SCADA system servers.

Elsinore Valley Municipal Water District (EVMWD)
Water Distribution SCADA System
Project Description: This design- build project for a water SCADA system used several innovations including high- speed microwave communications, intelligent RTU’s and parallel operation during installation and system cutover. EVMWD consists of 250 water booster stations, well sites and tanks; 35 lift stations; 3 waste water treatment plants, and 2 water treatment plants.

Role and Responsibilities: As software engineer, he was responsible for the upgrade from a Windows-based server pair to a new redundant server pair using VMware and Red Hat Linux operating system.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 52 DEREK BIRD
Role on Project
HMI Development
Mr. Bird has 35+ years’ experience with software
development and dynamic data visualization tools
on UNIX/LINUX/Windows operating systems. He
has 18 years of experience working with the
DataViews® software performing technical
support; software maintenance; developing ports
to new operating systems and writing custom data
acquisition modules. In regards to DataViews, Mr.

Bird wrote the driver for the Windows GDI
graphics system to improve graphics
performance. He is an expert with the DataViews
dynamic data visualization toolkit and supports
customer’s requirements. He wrote GE’s
Cimplicity SCADA product PLC alarm sequence
of events data gatherer.

Relevant Experience
Systems Integrated
DataViews® Development Group
Description: Systems Integrated’s Northampton,
MA office is the product operations for DataViews
software. This office is responsible for software
patches; identifying and developing upgrades as
requested by users; and providing software
maintenance to the users. This office supports
the DataViews distributors around the world.

Role and Responsibilities: Mr. Bird is
responsible for the development of patches and
upgrades to the DataViews software. He works
with users to understand the upgrades determine
their requirements. He works with users
participating in Beta testing of new products and
collects the results. He is a Senior Software
Engineer with eighteen years of experience
designing code for DataViews and has an indepth
knowledge of the software.

Expertise:
 HMI Systems Design
 Software Development & Testing
 Windows OS
 Project Management
 Training
 User Warranty Support
 Maintenance
 Beta Testing Upgrades
Contact Information:
858-810-0726
Years of Experience:
35+
Technical Skills:

Languages:
 C++/C#
 Visual Basic
 Java & Java Script
 HTML
 CSS
Operating Systems:
 Windows
 Red Hat
 Solaris
 OSX
 CentOS
Development Tools:
 Visual Studio
 gmake
 TeamCity
 Rally
 Sencha
 Confluence
 DataViews®
Education:

B. S., Computer Science
University of Strathclyde
Glasgow, Scotland 1981

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 53 Professional Experience
As a Senior Software Engineer, he has worked with industrial CNC equipment developing the graphics editor CNC code generation; data communications scripts and cable standards. He has worked with the DataViews software for over 25 years, originally with the development of the product and subsequently with GE Digital. He developing products from requirement definitions through successful deployment into technical support and maintenance.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 54 DAVID DE LEEUW
Role on Project
Cyber Security Engineer
Mr. De Leeuw is an electrical and computer
engineer with over 30 years experience in
providing secure systems for multi -million dollar
high-technology operations within engineering
and product development firms focused on both
commercial and government business.

He has a wealth of experience providing
oversight for all facets of Cyber -Security system
design and implementation for both fixed and
mobile facilities and platforms. Mr. De Leeuw is
an expert at implementation of NERC Critical
Infrastructure Protection (CIP) standards as well
as US DOD Security Technical Implementation
Guide (STIG) for cyber-security protection.

Relevant Experience
DOI, U.S. Bureau of Reclamation
Lower Colorado Region
Water Management Information SCADA
Upgrade
Project Description: Systems Integrated is
performing the SCADA replacement system to
control and monitor the equipment located at
eight power plant sites across 4 states in the
Southwest. SI is to provide the communications
systems; associated hardware, s oftware and
support services. As part of this project, the
National Institute of Standards and Technology
Framework (NIST) must be implemented to
manage and reduce cybersecurity risk to the
power plants and industrial control systems.

Role and Responsibili ties: Mr. De Leeuw is
responsible for interfacing with the Bureau of
Reclamation to assure personnel and system
security requirements are met. This includes
submitting government background checks,
cybersecurity training, insider threat training as
well as yearly security refresher courses. In
addition, Mr. De Leeuw works closely with
software and hardware engineers to develop a
Expertise:
 IS-CERT Cyber Security Certified
by DHS
 DOD Security Clearance
 Facility Security Officer
 Transportation Worker
Identification Credential (TWIC)
 Project Engineering
 Network Design
 Wired & Wireless Communication
Networks
 Oversight of large-scale classified
projects from conception through
completion
 Electronic and Computer
Engineering
 NERC Critical Infrastructure
Protection
 US DOD Security Technical
Implementation Guide (STIG)

Contact Information:
858-810-0703

Years of Experience:
30+ yrs.

Education:

Masters of Science in Engineering
Computer Information & Control
Engineering
University of Michigan, Ann Arbor
1976
Bachelors of Science in Engineering
Electrical and Computer Engineering
University of Michigan, Ann Arbor
1975

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 55 system architecture that assures the NIST framework as well as NERC Critical Infrastructure Protection (CIP) and US DOD STIG standards for cyber-security protection are implemented and tested.

Defense Advanced Research Project Agency (DARPA)
Classified At-Sea Projects
Project Description: Mr. De Leeuw was responsible for the development and installation of secure data and communication networks at both engineering test facilities and on multiple research vessels.

Multiple at-sea exercises were conducted on both US Naval Vessels as well as chartered private ships. These classified projects were responsible for development and testing of high -tech sensors and systems related to Anti-Submarine Warfare (ASW).

Role and Responsibilities: Mr. De Leeuw acted as both Test Director and Program Manager for DARPA Projects during multiple phases, which included both in-lab testing as well integrated sea tests. As Test Director, Mr. De Leeuw was responsible for writing and reviewing secure test plans and reports as well as developing cyber -security procedures for in-lab and shipboard networks.

This required Mr. De Leeuw to ride the ship as a crewmember while executing at-sea operations to assure strict adherence to security standards, frameworks, laws and policies.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 56 ATTACHMENTS

 Standard Agreement Acknowledgement of City of Fullerton Professional Services Agreement.
 Sample Systems Integrated Maintenance Agreement with Task Order.  Sample Master Plan performed by Mr. Maris Janson
 General Overview of Systems Integrated

CITY OF FULLERTON

PROFESSIONAL SERVICES AGREEMENT
WITH
[FULL NAME OF CONSULTANT]
THIS AGREEMENT is made and entered into this __ day of _________, 202_ (“Effective Date”), by and between the CITY OF FULLERTON, a California municipal corporation (“City”), and _______________, a [State and type of entity] (“Consultant”).

W I T N E S S E T H :

A. City proposes to utilize the services of Consultant as an independent contractor to provide ___________________________, as more fully described herein.

B. Consultant represents that it has that degree of specialized expertise contemplated within California Government Code section 37103, and holds all necessary licenses to practice and perform the services herein contemplated.

C. City and Consultant desire to contract for the specific services described herein, and desire to set forth their rights, duties and liabilities in connection with the services to be performed.

D. No official or employee of City has a financial interest, within the provisions of Sections 1090-1092 of the California Government Code, in the subject matter of this Agreement.

NOW, THEREFORE, for and in consideration of the mutual covenants and conditions contained herein, the parties hereby agree as follows:

1.0. SERVICES PROVIDED BY CONSULTANT

1.1. Scope of Services. Consultant shall provide the professional services described in the City’s Request for Proposals (“RFP”), attached hereto as Exhibit “A,” and Consultant’s Response to City’s RFP (“Consultant’s Proposal”), attached hereto as Exhibit “B,” both incorporated herein by this reference.

1.2. Professional Practices. All professional services to be provided by Consultant pursuant to this Agreement shall be provided by personnel experienced in their respective fields and in a manner consistent with the standards of care, diligence and skill ordinarily exercised by professional consultants in similar fields and circumstances in accordance with sound professional practices. Consultant also warrants that it is familiar with all laws that may affect its performance of this Agreement and shall advise City of any changes in any laws that may affect Consultant’s performance of this Agreement.

1.3. Performance to Satisfaction of City. Consultant agrees to perform all the work to the reasonable satisfaction of the City, in accordance with the applicable professional standard of care and City specifications and within the hereinafter specified. Evaluations of the work will be done by the City Manager or his designee. If the quality of work is not satisfactory, City in its discretion has the right to:
(a) Meet with Consultant to review the quality of the work and resolve the [Name of Consultant]

matters of concern;
(b) Require Consultant to repeat the work at no additional fee until it is satisfactory; and/or
(c) Terminate the Agreement as hereinafter set forth.

1.4. Warranty. Consultant warrants that it shall perform the services required by this Agreement in compliance with all applicable and non conflicting Federal and California employment laws, including, but not limited to, those laws related to minimum hours and wages; occupational health and safety; fair employment and employment practices; workers’ compensation insurance and safety in employment; and all other Federal, State and local laws and ordinances applicable to the services required under this Agreement. Consultant shall indemnify and hold harmless City from and against all claims, demands, payments, suits, actions, proceedings, and judgments of every nature and description including attorneys’ fees and costs, presented, brought, or recovered against City for, or on account of any liability under any of the above-mentioned laws, which may be incurred by reason of Consultant’s performance under this Agreement.

1.5. Non-discrimination. In performing this Agreement, Consultant shall not engage in, nor permit its agents to engage in, discrimination in employment of persons because of their race, religion, color, national origin, ancestry, age, physical handicap, medical condition, marital status, sexual gender or sexual orientation, except as permitted pursuant to Section 12940 of the Government Code.

1.6. Non-Exclusive Agreement. Consultant acknowledges that City may enter into agreements with other consultants for services similar to the services that are subject to this Agreement or may have its own employees perform services similar to those services contemplated by this Agreement.

1.7. Delegation and Assignment. This is a personal service contract, and the duties set forth herein shall not be delegated or assigned to any person or entity without the prior written consent of City. Consultant may engage a subcontractor(s) as permitted by law and may employ other personnel to perform services contemplated by this Agreement at Consultant’s sole cost and expense.

1.8. Confidentiality. Employees of Consultant in the course of their duties may have access to financial, accounting, statistical, and personnel data of private individuals and employees of City. Consultant covenants that all data, documents, discussion, or other information developed or received by Consultant or provided for performance of this Agreement are deemed confidential and shall not be disclosed by Consultant without written authorization by City. City shall grant such authorization if disclosure is required by law. All City data shall be returned to City upon the termination of this Agreement. Consultant's covenant under this Section shall survive the termination of this Agreement.

2.0. COMPENSATION AND BILLING

2.1. Compensation. Consultant shall be paid in accordance with the fee schedule set forth in Exhibit __. Consultant’s total compensation shall not exceed _______ Dollars ($ _____.00).
[Name of Consultant]

2.2. Additional Services. Consultant shall not receive compensation for any services provided outside the scope of services specified in the Consultant’s Proposal unless the City or the Project Manager for this Project, prior to Consultant performing the additional services, approves such additional services in writing. It is specifically understood that oral requests and/or approvals of such additional services or additional compensation shall be barred and are unenforceable.

2.3. Method of Billing. Consultant may submit invoices to the City for approval on a progress basis, but no more often than two times a month. Said invoice shall be based on the total of all Consultant’s services which have been completed to City’s sole satisfaction. City shall pay Consultant’s invoice within forty-five (45) days from the date City receives said invoice.

Each invoice shall describe in detail, the services performed, the date of performance, and the associated time for completion. Any additional services approved and performed pursuant to this Agreement shall be designated as “Additional Services” and shall identify the number of the authorized change order, where applicable, on all invoices.

2.4. Records and Audits. Records of Consultant’s services relating to this Agreement shall be maintained in accordance with generally recognized accounting principles and shall be made available to City or its Project Manager for inspection and/or audit at mutually convenient times from the Effective Date of this Agreement until three (3) years after the termination date.

2.5. W-9. Consultant must provide City with a current W-9 form, to be attached hereto as Exhibit “D.” It is the Consultant’s responsibility to provide to the City any revised or updated W-9 form.

3.0. TIME OF PERFORMANCE

3.1. Commencement and Completion of Work. The professional services to be performed pursuant to this Agreement shall commence within five (5) days from the Effective Date of this Agreement. The professional services to be performed pursuant to this Agreement shall be completed in accordance with Exhibit __. Failure to commence work in a timely manner and/or diligently pursue work to completion may be grounds for termination of this Agreement.

3.2. Excusable Delays. Neither party shall be responsible for delays or lack of performance resulting from acts beyond the reasonable control of the party or parties. Such acts shall include, but not be limited to, acts of God, fire, strikes, material shortages, compliance with laws or regulations, riots, acts of war, or any other conditions beyond the reasonable control of a party.

4.0. TERM AND TERMINATION

4.1. Term. This Agreement shall commence on the Effective Date and continue for a period of _________________ unless terminated as provided herein. [Add renewal language if applicable.]

4.2. Notice of Termination. The City reserves and has the right and privilege of canceling, suspending or abandoning the execution of all or any part of the work contemplated by this Agreement, with or without cause, at any time, by providing written notice to Consultant.

The termination of this Agreement shall be deemed effective upon receipt of the notice of termination. In the event of such termination, Consultant shall immediately stop rendering [Name of Consultant]

services under this Agreement unless directed otherwise by the City.

4.3. Compensation. In the event of termination, City shall pay Consultant for reasonable costs incurred and professional services satisfactorily performed up to and including the date of City’s written notice of termination. Compensation for work in progress shall be prorated based on the percentage of work completed as of the effective date of termination in accordance with the fees set forth herein. In ascertaining the professional services actually rendered hereunder up to the effective date of termination of this Agreement, consideration shall be given to both completed work and work in progress, to complete and incomplete drawings, and to other documents pertaining to the services contemplated herein whether delivered to the City or in the possession of the Consultant.

4.4. Documents. In the event of termination of this Agreement, all documents prepared by Consultant in its performance of this Agreement including, but not limited to, finished or unfinished design, development and construction documents, data studies, drawings, maps and reports, shall be delivered to the City within ten (10) days of delivery of termination notice to Consultant, at no cost to City. Any use of uncompleted documents without specific written authorization from Consultant shall be at City's sole risk and without liability or legal expense to Consultant.

5.0. INSURANCE

5.1. Insurance Required. CONSULTANT shall procure and maintain throughout the duration of this Agreement, insurance against claims for injuries to persons or damages to property which may arise from or in connection with the performance of the work hereunder by the CONSULTANT, his agents, representatives, employees or subcontractors. CONSULTANT shall provide current evidence of the required insurance in a form acceptable to the CITY and shall provide replacement evidence for any required insurance which expires prior to the completion, expiration or termination of this Agreement.

Nothing in this section shall be construed as limiting in any way, the Indemnification and Hold Harmless clause contained herein in Section 6.8 or the extent to which CONSULTANT may be held responsible for payments of damages to persons or property.

5.2. Minimum Scope and Limits of Insurance.

A. Commercial General Liability Insurance. CONSULTANT shall maintain commercial general liability insurance coverage in a form at least as broad as ISO Form #CG 00 01, with a limit of not less than $2,000,000 each occurrence. If such insurance contains a general aggregate limit, it shall apply separately to the Agreement or shall be twice the required occurrence limit.

B. Business Automobile Liability Insurance. CONSULTANT shall maintain business automobile liability insurance coverage in a form at least as broad as ISO Form # CA 00 01, with a limit of not less than $2,000,000 each accident. Such insurance shall include coverage for owned, hired and non-owned automobiles.

C. Workers’ Compensation and Employers’ Liability Insurance. CONSULTANT shall maintain workers’ compensation insurance as required by the State of California and employers’ liability insurance with limits of not less than $1,000,000 each accident.

D. Professional Liability Insurance. CONSULTANT shall maintain professional liability insurance appropriate to CONSULTANT’s profession with a limit of not less than [Name of Consultant]

$2,000,000. Architects’ and engineers’ coverage shall be endorsed to include contractual liability. If policy is written as a “claims made” policy, the retro date of the policy shall be prior to the start of the contract work.

E. Employee/Officer Fidelity Bond. CONSULTANT shall maintain a fidelity bond with a minimum limit of $1,000,000, providing coverage for the acts of all employees, officers and directors of CONSULTANT.

5.3. Deductibles and Self-Insured Retentions. Any deductible or self-insured retention must be declared to and approved by the CITY.

5.4. Other Insurance Provisions. The required insurance policies shall contain or be endorsed to contain the following provisions:

A. Commercial General Liability. The CITY , its elected or appointed officials, officers, employees and volunteers are to be covered as additional insureds with respect to liability arising out of work or operations performed by or on behalf of CONSULTANT, including materials, parts or equipment furnished in connection with such work or operations. Such coverage as an additional insured shall not be limited to the period of time during which the CONSULTANT is conducting ongoing operations for the CITY but rather, shall continue after the completion of such operations. The coverage shall contain no special limitations on the scope of its protection afforded to the CITY, its officers, employees and volunteers.

B. Commercial General Liability. This insurance shall be primary insurance as respects the CITY, its officers, employees and volunteers and shall apply separately to each insured against whom a suit is brought or a claim is made. Any insurance or self-insurance maintained by the CITY, its officers, employees and volunteers shall be excess of this insurance and shall not contribute with it.

C. Professional Liability. If the Professional Liability policy is written on a “claims made” form, CONSULTANT shall maintain similar coverage for three consecutive years following completion of the project and shall thereafter, submit annual evidence of coverage.

Additionally, CONSULTANT shall provide certified copies of the claims reporting requirements contained within the policies.

D. Workers’ Compensation and Employers’ Liability Insurance. Insurer shall waive their right of subrogation against CITY, its officers, employees and volunteers for work done on behalf of the CITY.

E. Employee/Officer Fidelity Bond, CITY shall be named as third party beneficiary for losses arising from work done on behalf of CITY.

F. All Coverages. Each insurance policy required by this clause shall be endorsed to state that coverage shall not be canceled, except after thirty (30) days’ prior written notice by certified mail, return receipt requested, has been given to the CITY.

If the contractor maintains higher limits or has broader coverage than the minimums shown above, the CITY requires and shall be entitled to all coverage, and to the higher limits maintained by the CONTRACTOR. Any available insurance proceeds in excess of the specified minimum limits of insurance and coverage shall be available to the CITY.

G. Subcontractors. CONSULTANT shall require and verify that all [Name of Consultant]

subcontractors maintain insurance meeting all the requirements stated herein and CONSULTANT shall ensure that CITY is an additional insured on insurance required from subcontractors.

H. Special Risks or Circumstances. CITY reserves the right to modify these requirements, including limits, based on the nature of the risk, prior experience, insurer, coverage or other special circumstances.

5.5 Acceptability of Insurers. All required insurance shall be placed with insurers acceptable to the CITY with current BEST’S ratings of no less than A, Class VII. Workers’ compensation insurance may be placed with the California State Compensation Insurance Fund. All insurers shall be licensed by or hold admitted status in the State of California. At the sole discretion of the CITY, insurance provided by non-admitted or surplus carriers with a minimum BEST’S rating of no less than A- Class X may be accepted if CONSULTANT evidences the requisite need to the sole satisfaction of the CITY.

5.6 Verification of Coverage. CONSULTANT shall furnish the CITY with certificates of insurance which bear original signatures of authorized agents and which reflect insurers names and addresses, policy numbers, coverage, limits, deductibles and self-insured retentions. Additionally, CONSULTANT shall furnish copies of all policy endorsements required herein. All certificates and endorsements must be received and approved by CITY before work commences. The CITY reserves the right to require at any time complete, certified copies of any or all required insurance policies and endorsements. [For Design Professional Services pursuant to Civil Code section 2782.8 – Architects and Engineers – Use the following paragraph and delete the one above.]

5.0. INSURANCE

5.1. Insurance Required. CONSULTANT shall procure and maintain throughout the duration of this Agreement, insurance against claims for injuries to persons or damages to property which may arise from or in connection with the performance of the work hereunder by the CONSULTANT, his agents, representatives, employees or subcontractors subject to the limitations of Civil Code Section 2782.8. CONSULTANT shall provide current evidence of the required insurance in a form acceptable to the CITY and shall provide replacement evidence for any required insurance which expires prior to the completion, expiration or termination of this Agreement.

Nothing in this section shall be construed as limiting in any way, the Indemnification and Hold Harmless clause contained herein in Section 6.8 or the extent to which CONSULTANT may be held responsible for payments of damages to persons or property.

5.2. Minimum Scope and Limits of Insurance.

A. Commercial General Liability Insurance. CONSULTANT shall maintain commercial general liability insurance coverage with a limit of not less than $2,000,000 each occurrence. If such insurance contains a general aggregate limit, it shall apply separately to the Agreement or shall be twice the required occurrence limit. [Name of Consultant]

B. Business Automobile Liability Insurance. CONSULTANT shall maintain business automobile liability insurance coverage with a limit of not less than $2,000,000 each accident. Such insurance shall include coverage for owned, hired and non-owned automobiles.

C. Workers’ Compensation and Employers’ Liability Insurance. CONSULTANT shall maintain workers’ compensation insurance as required by the State of California and employers’ liability insurance with limits of not less than $1,000,000 each accident.

D. Professional Liability Insurance. CONSULTANT shall maintain professional liability insurance appropriate to CONSULTANT’s profession with a limit of not less than $2,000,000. Architects’ and engineers’ coverage shall be endorsed to include contractual liability. . If policy is written as a “claims made” policy, the retro date of the policy shall be prior to the start of the contract work.

5.3. Deductibles and Self-Insured Retentions. Any deductible or self-insured retention must be declared to and approved by the CITY.

5.4. Other Insurance Provisions. The required insurance policies shall contain or be endorsed to contain the following provisions:

A. Commercial General Liability. The CITY , its elected or appointed officials, officers, employees and volunteers are to be covered as additional insureds with respect to liability arising out of work or operations performed by or on behalf of CONSULTANT, including materials, parts or equipment furnished in connection with such work or operations. Coverage shall not extend to any indemnity coverage for the active negligence of the additional insured in any case where an agreement to indemnify the additional insured would be invalid under Civil Code Section 2782.8. Such coverage as an additional insured shall not be limited to the period of time during which the CONSULTANT is conducting ongoing operations for the CITY but rather, shall continue after the completion of such operations. The coverage shall contain no additional special limitations, outside standard coverage exclusions and coverage limits, on the scope of its protection afforded to the CITY, its officers, employees and volunteers.

B. Commercial General Liability. This insurance shall be primary insurance as respects the CITY, its officers, employees and volunteers and shall apply separately to each insured against whom a suit is brought or a claim is made. Any insurance or self-insurance maintained by the CITY, its officers, employees and designated volunteers shall be excess of this insurance and shall not contribute with it.

C. Workers’ Compensation and Employers’ Liability Insurance. Insurer shall waive their right of subrogation against CITY, its officers, employees and volunteers for work done on behalf of the CITY.

D. All Coverages. Each insurance policy required by this clause shall be endorsed to state that coverage shall not be canceled, except after thirty (30) days’ prior written notice by certified mail, return receipt requested, has been given to the CITY.

If the CONSULTANT maintains higher limits or has broader coverage than the minimums shown above, the CITY requires and shall be entitled to all coverage, and to the higher limits maintained by the CONSULTANT. Any available insurance proceeds in excess of the specified minimum limits of insurance and coverage shall be available to the CITY.

E. Subcontractors. CONSULTANT shall require and verify that all subcontractors maintain insurance meeting all the requirements stated herein and [Name of Consultant]

CONSULTANT shall ensure that CITY is an additional insured on insurance required from subcontractors.

F. Special Risks or Circumstances. CITY reserves the right to modify these requirements, including limits, based on the nature of the risk, prior experience, insurer, coverage or other special circumstances.

5.5 Acceptability of Insurers. All required insurance shall be placed with insurers acceptable to the CITY with current BEST’S ratings of no less than A, Class VII. Workers’ compensation insurance may be placed with the California State Compensation Insurance Fund. All insurers shall be licensed by or hold admitted status in the State of California. At the sole discretion of the CITY, insurance provided by non-admitted or surplus carriers with a minimum BEST’S rating of no less than A- Class X may be accepted if CONSULTANT evidences the requisite need to the sole satisfaction of the CITY.

5.6 Verification of Coverage. CONSULTANT shall furnish the CITY with certificates of insurance which bear original signatures of authorized agents and which reflect insurers names and addresses, policy numbers, coverage, limits, deductibles and self-insured retentions. Additionally, CONSULTANT shall furnish certified copies of all policy endorsements required herein. All certificates and endorsements must be received and approved by CITY before work commences. The CITY reserves the right to require at any time complete, certified copies of any or all required insurance policies and endorsements.

6.0. GENERAL PROVISIONS

6.1. Entire Agreement. This Agreement constitutes the entire agreement between the parties with respect to any matter referenced herein and supersedes any and all other prior writings and oral negotiations. This Agreement may be modified only in writing, and signed by the parties in interest at the time of such modification. The terms of this Agreement shall prevail over any inconsistent provision in any other contract document appurtenant hereto, including exhibits to this Agreement.

6.2. Representatives. The City Manager or his designee shall be the representative of City for purposes of this Agreement and may issue all consents, approvals, directives and agreements on behalf of the City, called for by this Agreement, except as otherwise expressly provided in this Agreement.

Consultant shall designate a representative for purposes of this Agreement who shall be authorized to issue all consents, approvals, directives and agreements on behalf of Consultant called for by this Agreement, except as otherwise expressly provided in this Agreement.

6.3. Project Managers. City shall designate a Project Manager to work directly with Consultant in the performance of this Agreement.

Consultant shall designate a Project Manager who shall represent it and be its agent in all consultations with City during the term of this Agreement. Consultant or its Project Manager shall attend and assist in all coordination meetings called by City.

6.4. Notices. Any notices, documents, correspondence or other communications concerning this Agreement or the work hereunder may be provided by personal delivery, [Name of Consultant]

facsimile or mail and shall be addressed as set forth below. Such communication shall be deemed served or delivered: a) at the time of delivery if such communication is sent by personal delivery; b) at the time of transmission if such communication is sent by facsimile; and c) 48 hours after deposit in the U.S. Mail as reflected by the official U.S. postmark if such communication is sent through regular United States mail.

IF TO CONSULTANT: IF TO CITY:

6.5. Attorneys’ Fees. In the event that litigation is brought by any party in connection with this Agreement, the prevailing party shall be entitled to recover from the opposing party all costs and expenses, including reasonable attorneys’ fees, incurred by the prevailing party in the exercise of any of its rights or remedies hereunder or the enforcement of any of the terms, conditions, or provisions hereof.

6.6. Governing Law. This Agreement shall be governed by and construed under the laws of the State of California without giving effect to that body of laws pertaining to conflict of laws. In the event of any legal action to enforce or interpret this Agreement, the parties hereto agree that the sole and exclusive venue shall be a court of competent jurisdiction located in Orange County, California.

6.7. Assignment. Consultant shall not voluntarily or by operation of law assign, transfer, sublet or encumber all or any part of Consultant's interest in this Agreement without City's prior written consent. Any attempted assignment, transfer, subletting or encumbrance shall be void and shall constitute a breach of this Agreement and cause for termination of this Agreement. Regardless of City's consent, no subletting or assignment shall release Consultant of Consultant's obligation to perform all other obligations to be performed by Consultant hereunder for the term of this Agreement.

6.8. Indemnification and Hold Harmless. To the fullest extent of the law, Consultant agrees to defend, indemnify, hold free and harmless the City, its elected officials, officers, agents, and employees, at Consultant’s sole expense, from and against claims, actions, suits or other legal proceedings brought against the City, its elected officials, officers, agents, and employees arising out of the performance of the Consultant, its employees, and/or authorized subcontractors, of the professional services undertaken pursuant to this Agreement. The defense obligation provided for hereunder shall apply without any advance showing of negligence or wrongdoing by the Consultant, its employees, and/or authorized subcontractors, but shall be required whenever any claim, action, complaint, or suit asserts as its basis the negligence, errors, omissions or misconduct of Consultant, its employees, and/or authorized subcontractors, and/or whenever any claim, action, complaint or suit asserts liability against the City, its elected officials, officers, agents, and employees based upon the work performed by Consultant, its employees, and/or authorized subcontractors under this Agreement, whether or not Consultant, its employees, and/or authorized subcontractors are specifically named or otherwise asserted to be liable. Notwithstanding the foregoing, the Consultant shall not be liable for the defense or indemnification of the City for claims, actions, complaints, or suits arising out of the sole or active negligence or willful misconduct of the City. This provision shall supersede and replace all other indemnity provisions contained either in the City’s specifications or Consultant’s Proposal, which shall be of no force and effect. [Name of Consultant]

[For Design Professional Services pursuant to Civil Code section 2782.8 – Architects and Engineers – Use the following paragraph and delete the one above.] To the fullest extent of the law, and consistent with Civil Code section 2782.8, Consultant agrees to defend, indemnify, hold free and harmless the City, its elected and appointed officials, officers, agents and employees, at Consultant’s sole expense, from and against any and all claims, demands, actions, suits or other legal proceedings brought against City, its elected and appointed officials, officers, agents, and employees to the extent arising out of, pertaining to, or relating to the negligence, recklessness, or willful misconduct of the Consultant, its employees, and/or authorized subcontractors, in performing design professional services pursuant to this Agreement. The defense obligation provided for hereunder shall apply without any advance showing of negligence, recklessness or willful misconduct of the Consultant, its employees, and/or authorized subcontractors, but shall be required whenever any claim, action, complaint, or suit asserts as its basis the negligence, recklessness, or willful misconduct of Consultant, its employees, and/or authorized subcontractors, and/or whenever any claim, action, complaint or suit asserts liability against the City, its elected and appointed officials, officers, agents, and employees based upon such negligence, recklessness, or willful misconduct, whether or not the Consultant, its employees, and/or authorized subcontractors are specifically named or otherwise asserted to be liable. Notwithstanding the foregoing, the Consultant shall not be liable for the defense or indemnification of the City for claims, actions, complaints or suits arising out of the sole or active negligence or willful misconduct of the City.

Further, in no event shall the cost to defend charged to the design professional exceed the design professional’s proportionate percentage of fault, unless otherwise specified in Civil Code section 2782.8. This provision shall supersede and replace all other indemnity provisions contained either in the City’s specifications or Consultant’s Proposal, which shall be of no force and effect.

6.9. Independent Contractor. Consultant is and shall be acting at all times as an independent contractor and not as an employee of City. Consultant shall have no power to incur any debt, obligation, or liability on behalf of City or otherwise act on behalf of City as an agent. Neither City nor any of its agents shall have control over the conduct of Consultant or any of Consultant’s employees, except as set forth in this Agreement. Consultant shall not, at any time, or in any manner, represent that it or any of its or employees are in any manner agents or employees of City. Consultant shall secure, at its sole expense, and be responsible for any and all payment of Income Tax, Social Security, State Disability Insurance Compensation, Unemployment Compensation, and other payroll deductions for Consultant and its officers, agents, and employees, and all business licenses, if any are required, in connection with the services to be performed hereunder. Consultant shall indemnify and hold City harmless from any and all taxes, assessments, penalties, and interest asserted against City by reason of the independent contractor relationship created by this Agreement. Consultant further agrees to indemnify and hold City harmless from any failure of Consultant to comply with the applicable worker’s compensation laws. City shall have the right to offset against the amount of any fees due to Consultant under this Agreement any amount due to City from Consultant as a result of Consultant’s failure to promptly pay to City any reimbursement or indemnification arising under this paragraph.

6.10. PERS Eligibility Indemnification. In the event that Consultant or any employee, agent, or subcontractor of Consultant providing services under this Agreement claims or is determined by a court of competent jurisdiction or the California Public Employees Retirement System (PERS) to be eligible for enrollment in PERS as an employee of the City, Consultant shall indemnify, defend, and hold harmless City for the payment of any employee and/or [Name of Consultant]

employer contributions for PERS benefits on behalf of Consultant or its employees, agents, or subcontractors, as well as for the payment of any penalties and interest on such contributions, which would otherwise be the responsibility of City.

Notwithstanding any other agency, state or federal policy, rule, regulation, law or ordinance to the contrary, Consultant and any of its employees, agents, and subcontractors providing service under this Agreement shall not qualify for or become entitled to, and hereby agree to waive any claims to, any compensation, benefit, or any incident of employment by City, including but not limited to eligibility to enroll in PERS as an employee of City and entitlement to any contribution to be paid by City for employer contribution and/or employee contributions for PERS benefits.

6.11. Cooperation. In the event any claim or action is brought against City relating to Consultant’s performance or services rendered under this Agreement, Consultant shall render any reasonable assistance and cooperation which City might require.

6.12. Ownership of Documents. All findings, reports, CAD drawings, documents, information and data, including, but not limited to, computer tapes or discs, files and tapes furnished or prepared by Consultant or any of its subcontractors in the course of performance of this Agreement, shall be and remain the sole property of City. Consultant agrees that any such documents or information shall not be made available to any individual or organization without the prior consent of City. Any use of such documents for other projects not contemplated by this Agreement, and any use of incomplete documents, shall be at the sole risk of City and without liability or legal exposure to Consultant. City shall indemnify and hold harmless Consultant from all claims, damages, losses, and expenses, including attorneys’ fees, arising out of or resulting from City’s use of such documents for other projects not contemplated by this Agreement or use of incomplete documents furnished by Consultant. Consultant shall deliver to City any findings, reports, documents, information, data, in any form, including but not limited to, computer tapes, discs, files audio tapes or any ot her Project related items as requested by City or its authorized representative, at no additional cost to the City.

6.13. Public Records Act Disclosure. Consultant has been advised and is aware that this Agreement and all reports, documents, information and data, including, but not limited to, computer tapes, discs or files furnished or prepared by Consultant, or any of its subcontractors, pursuant to this Agreement and provided to City may be subject to public disclosure as required by the California Public Records Act (California Government Code Section 6250 et seq .).

Exceptions to public disclosure may be those documents or information that qualify as trade secrets, as that term is defined in the California Government Code Section 6254.7, and of which Consultant informs City of such trade secret. The City will endeavor to maintain as confidential all information obtained by it that is designated as a trade secret. The City shall not, in any way, be liable or responsible for the disclosure of any trade secret including, without limitation, those records so marked if disclosure is deemed to be required by law or by order of the Court.

6.14. Conflict of Interest. Consultant and its officers, employees, associates and subconsultants, if any, will comply with all conflict of interest statutes of the State of California applicable to Consultant's services under this agreement, including, but not limited to, the Political Reform Act (Government Code Sections 81000, et seq .) and Government Code Section 1090. During the term of this Agreement, Consultant and its officers, employees, associates and subconsultants shall not, without the prior written approval of the City Representative, perform work for another person or entity for whom Consultant is not currently performing work that would require Consultant or one of its officers, employees, associates or [Name of Consultant]

subconsultants to abstain from a decision under this Agreement pursuant to a conflict of interest statute.

6.15. Responsibility for Errors. Consultant s hall be responsible for its work under this Agreement. Consultant, when requested, shall furnish clarification and/or explanation as may be required by the City’s representative, regarding any services rendered under this Agreement at no additional cost to City. In the event that an error or omission attributable to Consultant occurs, without prejudice to any other remedy to which City may be entitled to at law or equity, Consultant shall, at no cost to City, provide all necessary design drawings, estimates and other Consultant professional services necessary to rectify and correct the matter to the sole satisfaction of City and to participate in any meeting required with regard to the correction. In addition, Consultant shall reimburse City for any and all costs, expenses and/or damages, if any, that the City has incurred due to the aforementioned error or omission.

6.16. Prohibited Employment. Consultant will not employ any regular employee of City while this Agreement is in effect.

6.17. Order of Precedence. In the event of an inconsistency in this Agreement and any of the attached Exhibits, the terms set forth in this Agreement shall prevail. If, and to the extent this Agreement incorporates by reference any provision of any document, such provision shall be deemed a part of this Agreement. Nevertheless, if there is any conflict among the terms and conditions of this Agreement and those of any such provision or provisions so incorporated by reference, this Agreement shall govern over the document referenced.

6.18. Costs. Each party shall bear its own costs and fees incurred in the preparation and negotiation of this Agreement and in the performance of its obligations hereunder except as expressly provided herein.

6.19. No Third Party Beneficiary Rights. This Agreement is entered into for the sole benefit of City and Consultant and no other parties are intended to be direct or incidental beneficiaries of this Agreement and no third party shall have any right in, under or to this Agreement.

6.20. Headings. Paragraphs and subparagraph headings contained in this Agreement are included solely for convenience and are not intended to modify, explain or to be a full or accurate description of the content thereof and shall not in any way affect the meaning or interpretation of this Agreement.

6.21. Construction. The parties have participated jointly in the negotiation and drafting of this Agreement. In the event an ambiguity or question of intent or interpretation arises with respect to this Agreement, this Agreement shall be construed as if drafted jointly by the parties and in accordance with its fair meaning. There shall be no presumption or burden of proof favoring or disfavoring any party by virtue of the authorship of any of the provisions of this Agreement.

6.22. Amendments. Only a writing executed by the parties hereto or their respective successors and assigns may amend this Agreement.

6.23. Waiver. The delay or failure of either party at any time to require performance or compliance by the other of any of its obligations or agreements shall in no way be deemed a waiver of those rights to require such performance or compliance. No waiver of any provision of

__________________________________
Richard D. Jones, City Attorney

EXHIBIT A

REQUEST FOR PROPOSALS

EXHIBIT B
CONSULTANT’S PROPOSAL

EXHIBIT C

CERTIFICATES OF INSURANCE

EXHIBIT D
W-9

Systems Integrated ONSITE® Support Services Agreement
1 SI CUSTOM HARDWARE/SOFTWARE SYSTEM
ONSITE® SUPPORT SERVICES AGREEMENT

THIS AGREEMENT (“Agreement”) is by and between (“Customer”), with a principle place of business at and Systems Integrated, LLC, located at 2200 North Glassell Street, Orange, California 92865 (“SI or Support Vendor”), collectively the “Parties.” Whereas, wishes to extend its SI Custom Hardware/Software System Support Services Contract with Systems Integrated for the annual maintenance of the ONSITE SCADA system (“System” or “Systems"), and

Whereas, also wishes to engage the services of Systems Integrated to perform various tasks on an “as needed” basis (“Task Orders”), associated with the operation of the Customer’s SCADA system during the period of this Agreement; and

Whereas, in order for to provide for specific work not included in the annual maintenance of the ONSITE SCADA system, this Agreement amount shall also reflect the total of the annual maintenance cost and a not -to-exceed Task Order value. The Task Order value shall be encumbered only upon Customer’s execution of a Task Order; and

Now, therefore, the Parties, in consideration of the premises, agree as follows in the Agreement and Exhibits:

EXHIBITS:

Exhibit 1 General Terms & Conditions Revision
Exhibit 2 System Description Revision
Exhibit 3 Maintenance Services & Charges Revision
Exhibit 4 Invoice & Services Information Revision
Exhibit 5 ONSITE System Support Revision

ATTACHMENTS:

The SI ONSITE software support services are furnished only for the ONSITE software system that Customer previously purchased from SI, unless otherwise expressly agreed by the Parties.

SI unilaterally may revise its support services as described in the attached Exhibits, provided only that SI has forwarded a revised Exhibit describing such revised service to the Customer at least sixty (60) days prior to its effective date. If so, provided in the revised Exhibit, the Customer may elect to continue receiving support services under the terms of the existing Exhibits.

SI may offer new support services to Customer by forwarding a copy of a new Exhibit that describes such services. An order from the Customer for provision of any of the support services described in a new Exhibit shall constitute acceptance by the Customer, and this Agreement automatically shall then include that new Exhibit.

Systems Integrated ONSITE® Support Services Agreement
2 Customer agrees (i) that the Agreement constitutes understanding and represent ations, expressed or implied, between the Customer and SI with respect to the support services to be furnished thereunder.

Upon acceptance by both Parties, this Agreement shall be effective the (the Effective Date).

Accepted By: Agreed To:

SYSTEMS INTEGRATED, LLC (SI)

By:

WATER DISTRICT
(Customer)

By:

Authorized Signature

Typed Name Typed Name

Title Title

Street Address Street Address

City State Zip City State Zip

Telephone No. Telephone No.

Date

Federal Tax ID
Date

Systems Integrated ONSITE® Support Services Agreement
3 EXHIBIT 1

GENERAL TERMS AND CONDITIONS

1. GENERAL
The General Terms and Conditions contained herein shall be applicable to the furnishing of support services by S I to Customer as provided in this Agreement, which as previously defined includes this Exhibit 1 and all other Exhibits to this Agreement.

2. ELIGIBLE EQUIPMENT/SOFTWARE

2.1 The Customer represents that it is the owner of, or is duly authorized to utilize, the software System that (i) is to be supported under this Agreement and (ii) is described in Exhibit 2 to this Agreement.

2.2 Only Systems which are in normal operating condition and, as applicable, that are currently at SI’s currently supported levels are eligible for coverage under this Agreement. If, in SI’s opinion, maintenance is required to return the System to normal operating condition, or to bring any applicable software components of the System to the currently supported level, SI will offer to perform such work at its standard services rates then in effect prior to placing the System under the coverage of this Agreement.

3. ORDERS FOR ONSITE SYSTEM SUPPORT SERVICES

3.1(a) Unless otherwise provided, the support services provided in this Agreement shall commence on the Effective Date of . Requests for support services shall be initiated by “Service Requests”, which may be (i) an oral request for Corrective Maintenance or (ii) in the form of a purchase order or other written document when the Service Request is utilized to add or delete services or Systems (or components of Systems), as described herein. All charges for SI support services shall be adjusted to reflect any such changes. All Service Requests are subject to (i) acceptance by SI, and (ii) the order of precedence stated in paragraph 12 of this Exhibit 1.

(b) In the event that Customer requests SI to provide support services under this Agreement for hardware or software products either not installed by SI or installed by SI but not previously included in the SI ONSITE system support services agreement, SI will prepare and provide the Customer a quote for labor, material and other direct costs to perform the requested work in the form of a Task Order (Attachment A – Task Order form). Task Orders shall be valid for ninety (90) days after the date SI submits the completed Task Order quote to the Customer. Customer’s written acceptance of SI’s Task Order quote will initiate Systems Integrated to begin Task Order work.

(c) Under no condition shall Customer be liable for cost in excess of the Agreement value.

4. CONDITIONS OF SUPPORT SERVICES
Systems Integrated, LLC shall be under no obligation to furnish software support services under this Agreement should repair be required because of improper use or modification of the ONSITE software, or any related hardware failure. If support services are required as a result of any of the causes stated above, such services shall be provided at SI’s standard service rates for labor, travel, and material in effect at the time of service.

Systems Integrated ONSITE® Support Services Agreement
4 5. RELOCATION OF SYSTEMS

5.1 The Customer shall give SI thirty (30) days written notice prior to any relocation of the System covered by the ONSITE support services being provided under this Agreement.

5.2 If the System is moved, it shall continue to be serviced under this Agreement at no additional charge, provided that the network access is maintained.

5.3 For a System that will continue to be serviced after relocation, SI shall, at its option, assist the Customer in dismantling such System and shall inspect and reinstall the Syste m at the new location. These services are provided at an additional charge to the Customer at SI’s standard service rates for labor, travel, and material in effect at the time of service. The Customer shall furnish all labor and materials for packing and placement of the System in the new location.

5.4 The Customer shall be responsible for any and all loss or damage to the System during relocation.

6. EXCLUSIONS
SI software support services do not include any hardware components or supplies.

7. CONTRACT TERM

7.1 The term of this Agreement shall be one (1) year from the Effective Date, (“Initial Term”).

7.2 Support Vendor’s charges for support services provided under this Agreement, as stated in Exhibit 3, shall remain in effect during the Initial Term. Thereafter, SI shall advise Customer of the applicable rates for support services during each successive one (1) year term of this Agreement not less than sixty (60) days prior to expiration of any such term. Any increase or decrease of the charges for such services shall be implemented by the replacement of Exhibit 3 with a revised version that states the new rates. Unless otherwise mutually agreed in writing by SI and the Customer, the performance of support services by SI or the issuance of a Service Request after the effective date of the new service rates, shown by the issuance of a revised Exhibit 3, shall constitute acceptance (and agreement to) such new support services rates by Customer.

8. WARRANTY FOR SYSTEM SUPPORT SERVICES AND LIMITATION OF LIABILITY

8.1 For support services regarding software or consisting of consulting, training, or documentation, SI’s warranty shall be limited to providing such services on a “Commercially Reasonable Efforts” basis.

8.2 Any work performed by SI on a Task Order, when completed, will be warranted by adding the task order work product to the support Agreement during the remaining current term.

EXCEPT FOR THOSE WARRANTIES STATED IN SUBPARAGRAPHS 8.1 AND 8.2 OF THIS PARAGRAPH 8, NO OTHER WARRA NTY IS EXPRESSED OR IMPLIED. SI SPECIFICALLY DISCLAIMS THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.

Systems Integrated ONSITE® Support Services Agreement
5 8.3 The remedies provided herein are Customer’s sole and exclusive remedies. Whether with respect to SI’s obligations as regards the above-stated warranty or as otherwise provided in this Agreement, SI shall not be liable for any direct, indirect, special, incidental or consequential damages (including, but not limited to system down time, loss of data, loss of use, loss of profits) whether based on contract, tort, or any other legal theory, even if SI had prior knowledge thereof, except as defined in 8.4.

8.4 SI shall defend, indemnify and save harmless, to the extent permitted by law, (Customer), its members, officers, agents, servants, and employees against and from all suits, losses, demands, claims, payments, actions, recoveries, judgments and costs of every kind and description and from all damages to which (Customer) or any of its members, officers, agents, servants and employees may be subjected by reason of injury to person or property of others resulting from the performance of the services under this Agreement, or through any act or omission on the part of SI or its agents, employees, servants or subcontractor(s), or through any improper or defective machinery, implements or appliances used or supplied by SI, its agents, employees, servants or subcontractor(s) in the performance of this Agreement, and SI understands and agrees that it shall defend, indemnify and save harmless, to the extent permitted by law, (Customer), its members, officers, agents, servants and employees from all suits and actions of any kind or character whatsoever which may be brought or instituted by any subcontractor, material man or laborer who has performed work or furnished materials, in the performance of this Agreement.

9. CHARGES

9.1 The software support services rate specified in Exhibit 3 are those in effect as of the Effective Date, unless otherwise specified.

9.2 The Customer may prepay for support services up to one (1) year in advance at SI’s prevailing charge at time of payment. Prepaid services must have a commencement date of not more than ninety (90) days after payment. Increases that would otherwise take effect during the prepaid period shall be delayed until the end of the period and shall be effective at the date of any subsequent prepaid period.

9.3 Charges for support services performed outside the specified periods of coverage, and for services not covered by this Agreement, will be invoiced separately at SI’s standard service rates in effect at the time such services are rendered.

9.4 Task Orders will be prepared by SI upon the Customer’s request, to define the scope of work and the associated charges (i.e. materials, labor, and other direct costs) to perform the work. Task Order pricing will be based upon SI’s standard rates in effect during the current Agreement.

Customer’s written acceptance of SI’s Task Order quote will initiate Systems Integrated , LLC to begin Task Order work. Task Order work will be charged separately to the Customer under this Agreement upon completion of the work.

9.5 When the Customer requests that SI incur commercial travel and/or per diem expenses because of extended travel not included in this Agreement, those expenses will be charged to the Customer and shown as separate items on the SI invoice.

9.6 Unless otherwise stated in writing by SI, all charges shall be exclusive of state and local use,

Systems Integrated ONSITE® Support Services Agreement
6 sales, property (ad valorem) and similar taxes. The Customer agrees to pay such taxes, and when applicable, such taxes will appear as separate items on SI’s invoice.

10. INVOICING

10.1 Charges for support services will be invoiced in advance, as specified herein. Invoices for other charges described in Paragraph 9 of this Exhibit will be submitted as those charges are incurred.

10.2 Unless otherwise stated in writing by SI, the Customer shall pay all invoices issued under this Agreement within thirty (30) days from receipt date of invoice. Any payments not made within this time period are considered to be delinquent.

11. INSURANCE
SI shall provide insurance coverages to insure this Agreement and the work performed under this Agreement, to be maintained throughout the term of the Agreement as follows:

A. General Liability
Form: Commercial General Liability in a form providing coverage not less than that of a standard Occurrence Commercial General Liability policy form including separate limits for Personal Injury, and Products/Completed Operations. Coverage to include Contractual Liability.

Limits: $1,000,000 per occurrence/$2,000,000 general aggregate. $l,000,000 for Products/Completed Operations. $1,000,000 for Personal Injury Liability without a third -party action over exclusion. Products/Completed Operations to be maintained for a period of 2 years after the completion of the project.

B. Workers' Compensation:

Form: Providing coverage to all employees in all states where operations will be performed under the terms of the Contract.

Limits: As required by the Workers' Compensation Law of the State of or any State or Federal body having jurisdiction over the location of operations being performed.

C. Business Automobile Liability:

Business Automobile Liability insurance, including Owned, Hired and Not Owned Autos.

Form: Bodily Injury and Property Damage coverage in a combined single limit of not less than $1,000,000.

D. Miscellaneous:
1) SI shall add Customer to its insurance policies as an additional insured pursuant to the terms of Se ction 11. SI shall not be considered "approved" until it has obtained all insurance required by Section 11 and such insurance has been approved by Customer.

Systems Integrated ONSITE® Support Services Agreement
7 2) Insurance coverage shall be provided by an Insurance Company licensed as an "admitted carrier" by the State Financial Services Department - Insurance Industry and rated by "Bests" at "A-" or better, or as otherwise deemed acceptable to Customer.

3) Insurance coverage shall be evidenced by a Certificate of Insurance submitted in a form acceptable to Customer. "Acord" or other blank certificates may not be acceptable. Customer may request a letter of transmittal from the Insurance Company providing coverage indicating that the certificate is issued correctly and pursuant to their authorization.

4) Sixty (60) day notice of cancellation, non -renewal or reduction of coverage is required. The insuring company shall not be released from liability or obligation for its failure to notify Customer. The certificate shall not contain provisions that are limit ing, including but not limited to, "endeavor to mail" or "failure to mail such notice shall impose no obligation or liability of any kind, etc." Such provisions must be eliminated on the certificate.

5) The interest of Customer, as additional insured for ongoing operations, as well as, products/completed operations and as primary insurance with no responsibility for payment of premium shall be added to all policies other than Workers' Compensation. Evidence of this extension shall be by signed endorsement to the policy, such endorsement to be submitted to Customer with the applicable certificate of insurance. Mere recitation of the additional insured interest on the certificates may not be acceptable.

6) Customer will be notified o f any significant impairment or exhaustion of any of the above limits at the inception of or during the Agreement.

7) Subcontractors shall adhere to the above.

8) Customer is not responsible for any loss or damage whatsoever to the property of SI or its subcontractor(s).

9) All certificates of insurance shall contain the following provisions:

a. Nature of work described on certificate (in case of liability or compensation certificates) shall be inclusive of work provided for under this project. b. Location of work described shall be inclusive of the location of the work provided under this Agreement.
c. The period of certificates shall cover the period of the work or a new certificate shall be furnished before the current certificate expires.

10) Customer shall be the sole judge in determining the acceptability of insurance requirements.

12. ORDER OF PRECEDENCE
This Customer’s additional or different terms and conditions and Attachments hereto take precedence over this Agreement and all Exhibits and constitute the entire understanding between the Parties relating to transactions hereunder. NOTICE OF OBJECTION IS HEREBY GIVEN TO THE CUSTOMER’S

ADDITIONAL OR DIFFERENT TERMS AND CONDITIONS, AS SUCH MAY BE PROPOSED BY A SERVICE REQUEST, PURCHASE ORDER, ACKNOWLEDGMENT, INVOICE OR OTHERWISE.

Systems Integrated ONSITE® Support Services Agreement
8 13. LICENSE FOR SOFTWARE
Any and all modifications of the software for the System, whether the software was provided by SI or one or more third parties, shall be subject to the terms of the applicable licenses under which such software was originally supplied. In particular, and except as stated in the applicable license, Customer acknowledges and agrees that all right, title and interest in and to such software is and shall remain the sole property of Systems Integrated or such third parties, as appropriate.

14. MISCELLANEOUS

14.1 Any dispute arising hereunder shall first be resolved by taking the following steps where a successive step is taken if the issue is not resolved at the preceding step: 1) by the technical and contractual personnel for each Party performing this Agreement, 2) by executive management of each Party, 3) by mediation, or 4) in the event of litigation, by a court sitting in __________County, _____________ and applying the laws of the State of __________.

14.2 SI reserves the right to withhold without liability, but with prior written notice, any support services authorized by the Customer under this Agreement if the Customer is delinquent in payment for any services.

14.3 In the event of any proceedings, voluntary or involuntary, in bankruptcy or insolvency by or against the Customer, or in the event of the appointment, with or without the Customer’s consent, of any assignee for the benefit of creditors, or of a receiver, SI may elect to cancel any unfilled part of this Agreement. SI’s failure to exercise any of its rights hereunder shall not constitute or be deemed a waiver or forfeiture of such rights.

14.4 Stenographical, typographical and clerical errors are subject to correction.

14.5 Any notices required to be given hereunder shall be given in writing at the address of each party set forth in this Agreement, or to such other address as either party may substitute by written notice to the other.

14.6 With respect to the system or any components thereof, including technical data, supplied by SI directly or through others, Customer agrees that any export or re-export of such items shall be in compliance with the Export Administration Regulations issued by the Department of Commerce of the United States and other export controls of computer hardware, software media, technical date and direct products of technical data.

Systems Integrated ONSITE® Support Services Agreement
9 EXHIBIT 2

SYSTEM DESCRIPTION

The following is a list of the System software and hardware covered by this support Agreement:

Software: ONSITE®

Hardware: Hardware used by ONSITE®: this includes, Servers, Workstations, RTUs and Network equipment.

Systems Integrated ONSITE® Support Services Agreement
10 EXHIBIT 3

SERVICES INCLUDED IN MAINTENANCE SUPPORT AND CHARGES

Item Qty. Description
1 1 ea ONSITE® Software Support including:
 Hot Patches
 Updated revisions to ONSITE software
 Validation of continued operation of ONSITE with the
installation of operating system upgrades
 Disc cleanup
 Network monitoring/management
 Isolation of hardware problems
 Support for recording of software as a result of hardware failure (over the phone support)
 RTU firmware upgrades
 RTU firmware support
 LCD firmware upgrades
 LCD firmware support
 Database maintenance
 Re-loading/Re-synchronizing of ONSITE as a result of a hardware failure.

This Agreement is for 24 x 7 SI support service. Total cost of ONSITE system support services per year is $ (monthly amount is $ ).

The aggregate total funds for ONSITE system support services and Task Order work under this Agreement shall not exceed a total amount of $ for the period .

Systems Integrated ONSITE® Support Services Agreement
11 EXHIBIT 4

INVOICE AND SERVICES INFORMATION SHEET

I. PAYMENT AND BILLING

A. Payment for system support services performed, or to be performed, by SI shall be made by Customer upon the submission of SI invoices to Customer. Customer’s billing address is as follows:

Street Address

City State Zip
B. For the service changes described in paragraph 3.1(a) of Exhibit 1, Customer shall issue either a Service Request to SI, which may be in the form of a purchase order, for SI to invoice against in accordance with the terms and conditions of this Agreement.

C. For the optional support services (“Task Orders”) listed in paragraph 3.1 (b) of Exhibit 1 and in Section II of Exhibit 4, shall follow the terms and conditions of this Agreement.

D. The normal monthly service billing rate for the System described on Exhibit 2 is shown on Exhibit 3. If that billing rate is less than $100.00 per month, SI will invoice Customer on a quarterly basis. All normal monthly service billing shall be in advance of such normal services.

II. CUSTOMER AND SI REPRESENTATIVES
A. Customer’s Technical Representatives are:

Primary
Secondary

B. Customer’s Purchasing Representative is:

C. Customer’s Representatives authorized to initiate Out- of-Coverage Service; Extended Coverage or Task Orders:

Primary
Secondary
D. SI Service Representatives are:

Primary
Secondary
E. SI Service Telephone No.:

Systems Integrated ONSITE® Support Services Agreement
12 EXHIBIT 5
ONSITE® SYSTEM SUPPORT

I. ONSITE

SYSTEM SUPPORT SERVICES
A. At Customer Site Services: The standard annual maintenance does not include “at customer site” services.

B. Corrective Maintenance: Corrective maintenance includes the diagnosis and correction of System malfunctions and failures. Requests for this service may be made by telephone, as provided in Paragraph 3.1 (b) of Exhibit 1. Remedies may consist of temporary procedures to be followed by the Customer while a permanent remedy is being sought. Corrective Maintenance will be provided as described in paragraph C of Section I of this Exhibit 5, and will continue uninterrupted, as long as reasonable progress is being made, until the System is operational. If SI determines that additional resources are required, the service will be interrupted and will resume as soon as these resources are available.

C. Hours of Coverage: SI will provide the support services described 24-hours per day, 7- days per week (“Coverage Days”).

D. Response Time: Response time for Corrective Maintenance under this Agreement is measured in Coverage Days from the time a Service Request is received by SI to the time an SI engineer begins work on the problem. SI shall respond to a Service Request within 4 hours of network access (remote access to the Systems is required).

E. Network Access Security: SI shall restrict access to the Customer’s network, only to authorized SI employees that are providing software support. All SI employees have either been NERC certified and/or have DOD cyber security clearance.

II. OPTIONAL SUPPORT SERVICES:

In the event that the Customer requests SI to provide support services under this Agreement for hardware or software pr oducts either not installed by SI or installed by SI but not previously included in the SI
ONSITE® maintenance support services agreement, SI will prepare and provide the Customer a quote for labor, material and other direct costs to perform the requested work in the form of a Task Order (Attachment A – Task Order form). Task Orders shall be valid for ninety (90) days after the date SI submits the completed Task Order quote to the Customer. Customer’s written acceptance of SI’s Task Order quote wi ll initiate Systems Integrated to begin Task Order work
III. LIMITATIONS OF SOFTWARE SUPPORT SERVICES:

A. Qualified Devices: Any device which SI has provided the license or installed the software is considered a Qualified Device for purposes of support services.

B. Other Than Qualified Devices: Software support will not be covered under this Agreement for other than qualified devices.
(1) If, in the opinion of SI, performance of support services is made more difficult or impaired because of an Other Than Qualified Device, the Customer will temporarily remove the device at Customer’s expense for the purpose of allowing SI to maintain the System.

Systems Integrated ONSITE® Support Services Agreement
13 (2) The Customer is solely responsible for the compatibility of any Other Than Qualified Devices.

IV. RESPONSIBILITIES OF CUSTOMER:

A. Access: The Customer will provide SI with the following:

(1) Access to the System covered under this Agreement via a high speed network. (2) Access to and use of all information and facilities determined to be necessary by SI to service the System.

B. Data Reconstruction: The Customer is responsible for maintaining a procedure external to the System for reconstruction of lost or altered files, data, or programs to the extent deemed necessary by the Customer and for actually reconstructing any lost or altered files, data or programs. SI, as part of this Agreement, will assist in the restoration of the system using the back-up tapes maintained by the Customer.

C. Operating Procedures: The Customer will follow routine operator procedures as specified in the original equipment manufacturer’s operating manuals for the System’s components.

D. Operating Supplies: The Customer will provide operating supplies and consumables such as paper, magnetic tapes, ribbons, cards, format tapes, disc cartridges and such similar equipment the Customer would use during normal operations.

E. Customer Representative: A representative of the Customer will configure a site to site VPN between Customer and SI to allow unimpeded access to the Customer SCADA network and the associated equipment connected to the network.

F. Data Security: The Customer is responsible for safeguarding the confidentiality and security of its proprietary and classified information.

Systems Integrated ONSITE® Support Services Agreement
14 ATTACHMENT A - SAMPLE TASK ORDER FORM
________________WATER DISTRICT
Task Order
Task No.: Date Requested: Order/Contract/P.O.:

Requested By:

Statement of the Work Requested:

Deliverables:

Costs:

Labor:

Materials:

Other Direct Costs:

TOTAL COSTS: $_________________

Notes:

Task Order Prepared by:

Date Task Order Submitted:

Customer Acceptance of Task Order:

Date of Acceptance:

NOTE: Customer’s acceptance of a submitted Task Order constitutes approval for SI to proceed with the work. Task Orders will remain valid for ninety (90) days after date of submission to Customer.

ES-W18-100-01 / BEC / WHITTIER SCADA SYSTEM EVALUATION
REPORT - SECTION 1REV1 W WTMK.DOC

SCADA SYSTEM EVALUATION

Prepared for:

CITY OF WHITTIER
Department of Public Works
13230 Penn Street
Whittier, CA 90602
(562) 464-3514

Prepared by:

BOYLE ENGINEERING CORPORATION
1131 West Sixth Street, Suite #285
Ontario, CA 91762
(909) 933-5225

September - 2004

CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 2

INTRODUCTION:

The City of Whittier has contracted with Boyle Engineering to perform an evaluation of the City’s existing SCADA system infrastructure. The primary objective of this evaluation is to assess the overall functionality of the existing SCADA system and to provide the City with professional guidance in the form of recommendations relating to components of the control system that could potentially benefit from various improvements. This report will provide the City with various alternatives including cost estimates associated with the recommended improvements and control system enhancements.

Our basic approach to the evaluation involved the following four fundamental ideas and/or key concepts:

1. The identification of specific issues and/or problems with the existing system.

2. The determination of importance and priority. What is important? What are the key components or subsystems associated with this analysis?

3. What are the estimated costs for the various improvements? What are the budgetary constraints?

4. The determination of where to go from here? How do we develop a reasonable and definitive plan for the various improvements that have been identified as desirable or essential?

The response to item #1 above is involved. The following pages of this report have identified many issues of concern. Some of the issues are critical and some are a matter of convenience, consistency, or standardization. Some further discussion between the City and Boyle can facilitate a more detailed classification of each of the individual items. The City’s personnel have contributed in a large way towards the development of the items that together define this issue.

This report has identified the following key subsystems and/or equipment classifications:

 The Central SCADA System
 The Communications Infrastructure
 The field RTU’s
 Field Instrumentation and Controls
 Electrical Equipment (MCC’s)

Boyle has provided preliminary cost estimates for the identified work items. The actual prioritization of the individual items requires further discussion and analysis. Boyle would be willing to assist the City further with this matter.

Boyle can provide technical professional services to the City relating to the development of detailed engineering documents and specifications including an estimated schedule for implementation.

BACKGROUND:

The City of Whittier provides potable water service to approximately 48,000 customers. The water system is comprised of several production wells, a central water pumping plant, a pressure reducing station, several reservoirs, and approximately seven booster pump stations.

CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 3

The City has seven main production wells (WP-8, WP-13, WP-14, WP-15, WP-16, WP-17, and WP-18). These seven wells provide the primary water source for the City. The production wells pump ground water directly into the settling basins located at Pumping Plant No.2. The active wells are divided into two different basins (the upper and central basins) based on their relative geographic location. The central basin is comprised of Wells 8 and 14 and the upper basin is comprised of Wells 13, 15, 16, 17, and 18. The settling basins are located at Pumping Plant No.2 (PP2) along with eight booster pumps. The individual well pumps fill the settling basins and the booster pumps draw water from the settling basins and charge the distribution system, specifically, hydraulic zone 464. WP-8 pumps ground water directly into the settling basins and is geographically located on the PP2 site. WP-17 and WP-18 are configured as part of line-A, while WP-13, WP-15, and WP-16 are configured as part of line-B. Both lines provide water to the settling basins. The upper basin provides the largest contribution.

The City’s distribution system is comprised of four basic hydraulic pressure zones (464, 577, 670, and 997) and one sub-zone (400). The eight booster pumps located at PP2 pressurize the 464 hydraulic zone. The following table provides a brief summary of the system hydraulics.

ZONE # PRESSURE ZONE DESIGNATION HYDRAULIC CONFIGURATION 1 Sub-Zone 400 Hydraulically fed from an automatic PRS directly from the 464 zone.
2 Zone 464 Consists of Hoover, Greenleaf No.1 and
Greenleaf No.2 reservoirs. Hydraulically fed from
the eight booster pumps located at PP2. Also
consists of the Oceanview reservoir that is
charged from the Washington BPS during periods
of higher demand.
3 Zone 577 Consists of Painter and (2) Murphy reservoirs.

Hydraulically fed from two booster pumps located
at the Greenleaf BPS and two booster pumps
located at the Murphy BPS.
4 Zone 670 Consists of Rideout, Hazard, and (2) College Hills reservoirs. Hydraulically fed from two booster
pumps located at the Rideout BPS, two booster
pumps located at the Greenleaf BPS, and two
booster pumps located at the College Hills BPS.
5 Zone 997 Consists of Reservoir No.12 and the Summit
Hydro-Tank. Hydraulically fed from two booster
pumps located at the Greenleaf BPS, and two
booster pumps plus one fire pump located at the
Summit BPS.

THE EXISTING SCADA SYSTEM:

The existing SCADA System consists of 14 primary facilities. The majority of the electrical, controls, and instrumentation equipment at several of the facilities is old and obsolete. The central SCADA system is in need of a major upgrade, including the entire communications infrastructure. The hardware is obsolete and the software is several releases old. The method of interfacing with the SCADA system (pcAnywhere remote access software for the client interface) should be altered in order to provide an additional level of protection for the central CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 4

SCADA Server. The communications driver is in need of an upgrade. The protocol is extremely proprietary and future compatibility is quite limited.

The following table provides a list of the various facilities including relevant information:

RTU
#

RTU REFERENCE RTU
TYPE
LOCAL
ADDR
NOTES
Central SCADA System

N/A The Paragon-TNT SCADA System
central computer communicates to
the Pumping Plant No.2 (PP2)
central RTU via a 9600 Baud RS-
232C serial asynchronous
communications link. The
communications protocol is Bristol’s
BSAP. The interface is a hard-wired
direct connection. The central
computer hardware is now obsolete
and was purchased as used
equipment. The SCADA application
software and operating system are
several releases old and are in need
of an upgrade. PCAnywhere is
utilized as the primary interface to
the host computer system. The City
should consider purchasing Paragon
client software for this interface.
1 Pumping Plant No.2
(Control of WP-8, BP-1, BP-2, BP-3,
BP-4, BP-5, BP-6, BP-7, BP-8)
3330 1 This site serves as the
communications submaster
(CFE/FEP) for the entire telemetry
system. All remote telemetry is
routed through this RTU. The
communications protocol is Bristol’s
BSAP and the interface is 1200
Baud, including an internal 4-wire
telco modem. The communications
configuration is a 4-wire, Bell-3002
multi-point, conferenced bridge
analog FSK telephone circuit.
2 Upper Basin Wells, aka MCC Room
(Control of WP-15, WP-16, WP-17, &
WP-18)
3330 1
3 Upper Basin Wells, aka Well Field
(Control of WP-13)
3310 2
4 Central Basin Wells
(Control of WP-14)
3310 3
5 Rideout BPS & Hoover Reservoir
(Control of BP-1 & BP-2)
3330 4
6 Rideout Reservoir 3305 11
CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 5

RTU
#

RTU REFERENCE RTU
TYPE
LOCAL
ADDR
NOTES
7 Greenleaf Reservoirs No.1 & No.2 /
Greenleaf BPS
(Control of BP-1, BP-2, BP-3, BP-4,
BP-5, & BP-6)
3330 8
8 Reservoir No.12 3310 14
9 Hazard & Painter Reservoirs 3305 13
10 Washington BPS
(Control of BP-1 & BP-2)
3305 6
11 College Hills BPS
(Control of BP-1 & BP-2)
3330 7
12 College Hills Reservoir 3305 12
13 Summit BPS & Hydro-Tank
(Control of BP-1, BP-2, & FP-1)
3310 9
14 Oceanview & Murphy Reservoirs /
Murphy BPS
(Control of BP-1 & BP-2)
3330 5

CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 6

EXISTING SCADA SYSTEM GENERAL FUNCTIONALITY:
 Efficient & Reliable Communications – Limited statistics available.  Availability – Limited statistics available.
 Reliability – The entire system lacks any significant level of redundancy. All communications to the remote facilities relies upon the PP2 RTU. The PP2 RTU has no redundancy and is relatively exposed.
 Redundancy – None.
 Performance – The system performance is generally acceptable, considering the limited bandwidth of the 1200 Baud RTU communications circuit. The overall performance is extremely slow when contrasted with recent technological improvements in the various communications mediums available today.
 Maintainability – The overall system is highly proprietary and will most likely be overly difficult to maintain in the future.
 Security – Reasonable, considering the highly proprietary nature of the system.  Expandability / Scalability – Limited.
 Local Technical Support – The Paragon software has limited local support. The existing version is several releases old. Third party support is virtually non-existent.  Historical Data Archiving / System Backup – No facility for tape backup of the system currently exists. The SCADA software is copied via a LAN connection to another NT server for emergency backup. Boyle recommends the integration of a tape backup system for off-site storage of the SCADA application and historical data.  Graphic Screens – The basic operational screens are present. There is some minor cleanup that may be required. Boyle recommends the addition of individual site screens for additional clarity. Additionally, the main system overview graphic requires some minor reconstruction. The current screen does not accurately depict all of the significant informational items. This screen is the main operational graphic screen.  Trends – The existing system has trending capability. Numerical scales need to be incorporated into the vertical and horizontal scales of the analog trends for additional clarity.
 Historical Database Logging – The system is currently logging historical information (approximately 12-months).
 Historical Database Management – The system does not provide for a historical database management system. The derivation of minimum, maximum, and average values for the analog variables in the system was not present. This functionality provides additional insight into the operational characteristics of the system and can greatly benefit automated report generation in the future.  Reports – The existing system generates a couple of key reports (Daily Well Report and Monthly Water Production Report). The generation of reports is semi-manual. There is information that is acquired manually and then entered into the report manually. This process should be completely automated. The system should be reconfigured as necessary to enable the generation of all reports automatically. In addition, the City may want to consider the integration of the following additional reports:

CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 7

- Equipment Maintenance Reports (weekly, monthly, and annually). - Diagnostic Reports w/ Minimum, Maximum, and Average Values Represented. - Pump ETM Reports
- Reservoir Volumetric / Capacity Reports
- Summary Reports
 Alarming – The system provides basic alarming.
 Alarm Autodialer (After-Hours Callout) – The system does not have an integrated alarm autodialer subsystem for after-hours callout.
 Advanced Scripting – The system has scripting capability. There is a substantial amount of central-based control programming currently utilized. This configuration relies heavily upon the integrity of the central SCADA server.
 Menu / Navigation System – A basic configuration was present.  Security – Basic security was present, i.e., user name and password.  Communications – The communications infrastructure could definitely benefit from an upgrade. The 1200 Baud communications circuit is obsolete by today’s standards.

Direct reliance upon the local telephone company could introduce potential problems in the future. The City may want to consider a hybrid, dual-purpose communications infrastructure as part of a future communication system upgrade. This would provide the City with considerable bandwidth and could allow the use of networked video cameras for security surveillance, as well as other functionality in the future.  Networking – The SCADA Server has a network adapter and is currently networked to the main Win-2K administrative Server. There are no real SCADA clients on the network. PcAnywhere remote access software is utilized as the client interface to the central SCADA Server. Boyle recommends that this configuration be changed to a conventional SCADA client configuration.
 Clients (Real-Time Graphics & RDBMS) – None, PCAnywhere is utilized.  Remote Access Capabilities – PCAnywhere is utilized.
 Hardware – The hardware was purchased on Ebay. It is used and obsolete by today’s standards. A future software upgrade would necessitate the procurement of new hardware. The existing hardware should be upgraded / replaced as soon as possible.

Dell is one of the most widely supported PC hardware manufacturer’s in the U.S. today.

Therefore, we recommend that the City consider purchasing all PC hardware through Dell Computer.
 Software – The software is several releases old. The City should consider some form of upgrade. The major manufacturers of SCADA software in the water industry today are Wonderware, Intellution, Rockwell, and USData. Our recommendation is Wonderware’s InTouch and Industrial SQL Server. Wonderware’s corporate base is in Irvine, California and as such, there is strong local representation in the Southern California region.

Additionally, Wonderware is one of the dominant manufacturer’s in the water and wastewater industries for SCADA and control system automation.

CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 8

THE EXISTING RTU’S:

The existing RTU’s are manufactured by Bristol-Babcock. City personnel assembled the majority of the enclosures.
 Basics – The conventional approach to the design and construction of a typical RTU is a completely integrated assembly of components that are housed in a common enclosure.

This methodology includes all related components, including the power supply, local circuit breaker disconnect, TVSS, battery charger, batteries, and all related terminal blocks. The basic premise is to simplify maintenance and troubleshooting activities by establishing an integrated assembly. The RTU enclosure must be sized to accommodate the required equipment items. This basic concept has been violated in the majority of the RTU’s in Whittier’s system.
 Programming – The Bristol-Babcock “ACCOL” programming software, MS-DOS version, is obsolete and quite different from the other major manufacturers (Allen-Bradley, Modicon, Siemens, GE, Etc.). The programming editor does not provide IEC-61131 compliance. There is limited local technical support available.  Communications / Protocol – Bristol’s BSAP communication protocol is proprietary.

Communications to the remote facilities from the central RTU is via an asynchronous serial link at a data rate of 1200 baud. The communications driver is old and obsolete.

The City should consider an upgrade to a newer technology driver.  Standardization of Equipment / Components / Configuration – A mix of various types of Bristol RTUs (3305’s, 3310’s, and 3330’s) are currently present in the system. Several basic discrepancies have been noted.
 Quality of Construction – The RTU’s are, generally speaking, substandard with respect to current industry practices. The power distribution system is unprotected from power line disturbances and potential lighting damage. The overall appearance of the wiring in many of the RTU’s is rough and the wiring practices are not in accordance with accepted industry standards. Several of the RTU’s require additional conduits and wiring. There is some mixing of AC and DC wiring at a few of the facilities.  Local Technical Support – The main local technical support is generally limited to Bristol- Babcock direct.

THE EXISTING FIELD INSTRUMENTATION:

Many of the field instruments require replacement. There are several facilities that are missing critical instrumentation. Refer to the “Site Issues Summary / Cost Estimates” and “Site Instrumentation / Equipment Inventory” in sections #2 and #4 for specific details.

The issue regarding replacement and/or upgrades of the flow meters in the system requires special attention. Currently, there are a number of different types of technologies utilized. The total number of potential flow meters in the system is approximately 32, directly corresponding to the total number of well and booster pumps in the system. The majority of the existing meters are of the propeller type and are manufactured by Water Specialties. The Water Specialties propeller meter has been around for some time with a reasonably strong track record of performance and reliability. The City has been experiencing various problems with the Water Specialties flow meters, specifically the electronic 4-20 mA transmitters that are utilized for the interface with the local RTU. Boyle recommends that the City contact the manufacturer CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 9

directly to review potential alternatives before a final determination is made regarding the fate of the Water Specialties propeller-type flow meters.

SYSTEM INCONSISTENCIES:

Wells 13 and 14 include RTU control of the pump-to-waste logic, while all other wells have the logic integrated directly into the MCC relay logic. Well 8 requires manual control of the pump-to- waste valve operation. These issues have been further identified in section #2, “Site Issues Summary & Cost Estimates”.

MAJOR ISSUES:

The following listed issues should be considered as fundamental items. The foundation of any well-designed SCADA control system begins with accurate documentation. Then, consistency and standardization are paramount to the success of any implementation. Finally, the operations and maintenance personnel need to be furnished with a well-equipped spare parts repository so that an immediate response to an emergency situation is possible.  Documentation – The entire system lacks up-to-date documentation. There are virtually no process P&ID’s, RTU I/O diagrams, system overview drawings, communication diagrams, as-built construction drawings, JIC wiring diagrams, process control descriptions/narratives, or O&M manuals of any kind.

 Consistency – Many improvements can be made with respect to the overall consistency between sites. The use of a specific model of Bristol RTU is inconsistent and should be reviewed.

 Standardization – Some improvement can be made at the remote sites to facilitate a more standardized approach to the system architecture, programming, configuration, and documentation. This will also serve to simplify future upgrades, spare parts repository, and operator training requirements.

 Spare Parts – The City should establish a basic inventory of spare parts for proper maintenance of the system. A spare parts list should be developed to address required RTU and instrumentation components. At a minimum, there should be at least one spare of each type of instrument and RTU configuration immediately available off-the- shelf.

RECOMMENDATIONS:

1. Upgrade the communications infrastructure. Replace the obsolete 1200 Baud telephone communications circuit with a wireless infrastructure that has sufficient bandwidth for future requirements. This upgrade will also eliminate the recurring costs that are associated with the telephone company leased communication circuits.

2. Upgrade and/or replace the existing SCADA system. Procure new hardware and software for the central SCADA system. Review the system programming requirements and provide adjustments as necessary. Provide redundancy where feasible. The City should consider the utilization of an independent historical database server in the overall SCADA system design/architecture. In addition, operations personnel should utilize a separate PC with appropriate SCADA client software for indirect interaction with the SCADA system. This CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 10

configuration can help prevent potential problems from occurring that are caused by direct interaction with the central SCADA Server.

3. Consider replacing the existing remote telemetry units (RTU) with new modern non- proprietary RTUs.

4. Upgrade and/or replace all non-operational field instrumentation. Most of the individual field instruments are older and are in need of replacement. Standardize on specific manufacturers where feasible. Assess the application of various instruments at each facility to determine the appropriate instrument for each specific application, i.e., flow switches vs. pressure switches for the positive determination of pump run status, active well level monitoring, motor current monitoring, etc. Please refer to the “Instrument Checklist” for specific details. Provide new field instrumentation where required and as identified on the “Instrument Checklist” and “Site Issues Summary”. Update the electrical power subsystem at each of the remote facilities. All remote sites should be equipped with 24VDC power supplies and battery/charger components. The sites with battery chargers and batteries need 24VDC power supplies and isolation diodes to complete the power subsystem.

Additionally, the City should consider the integration of transient voltage surge suppressors (TVSS), EMI/RFI power line filters, AC power failure notification relays, and circuit breaker disconnects into the RTU power subsystem circuits. Provide a new enclosure for the central RTU located at the PP2 facility.

5. Provide up-to-date documentation that accurately details the complete control system.

6. Clean up the wiring and conduit workmanship at all applicable facilities.

7. Develop and maintain a spare parts inventory for operations and maintenance personnel.

The minimum spare parts should include at least one of each type of major field instrument and a basic RTU of each configuration.

CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 11

ESTIMATED COST SUMMARY:

ITEM
# DESCRIPTION BUDGETARY

ESTIMATE
1 Upgrade the complete communications infrastructure. The major equipment items required to complete this task are: (15 Sites)
 Radio Transceivers
 Antennas
 Feedlines, Connectors, Pigtails, Lightning Arrestors
 Mounting Hardware
 Installation & Configuration Labor
 Miscellaneous Equipment Items
$90,000
2 Upgrade / replace the existing SCADA system with new hardware and software (redundant SCADA server configuration w/ independent HDS). The items associated with this task are:
 Primary SCADA Server Hardware
 Backup SCADA Server Hardware
 Historical Database Server Hardware
 Network Printers + Print Server
 Network Communication Equipment
 SCADA Alarm After-Hours Alarm Autodialer Subsystem (Redundant)  SCADA Application Software
 Software Utilities
 RDBMS System Software
 Programming and Configuration Labor
 Miscellaneous Equipment Items
$200,000
3 Obtain 15 New Remote Telemetry Units (RTU) Programmed, installed Tested  Reservoir Sites ( 4 Sites X $15K/Site)
 Well / Booster PS Sites (11 Sites X $25K/Site)
 Contingency -

$60,000
$275,000
$67,000
$402,000
4 Pumping Plant #2 Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items -
 Mechanical Equipment Items -
 Contingency -

$123,500
$35,000
$122,500
$56,200
$337,200
5 MCC Room (Wells #15, #16, #17, & #18) Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items -
 Mechanical Equipment Items -
 Contingency -

$50,500
$0
$28,000
$15,700
$94,200
CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 12

ITEM
# DESCRIPTION BUDGETARY

ESTIMATE
6 Well #13 Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items -
 Mechanical Equipment Items -
 Contingency -

$13,500
$0
$0
$2,700
$16,200
7 Well #14 Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items -
 Mechanical Equipment Items -
 Contingency -

$10,000
$0
$0
$2,000
$12,000
8 Rideout BPS & Hoover Reservoir Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items (New MCC) -
 Mechanical Equipment Items -
 Contingency -

$32,000
$60,000
$0
$18,400
$110,400
9 Greenleaf BPS & Greenleaf Reservoirs #1 & #2 Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items -
 Mechanical Equipment Items -
 Contingency -

$34,500
$0
$0
$6,900
$41,400
10 College Hills BPS Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items -
 Mechanical Equipment Items -
 Contingency -

$14,500
$0
$0
$2,900
$17,400
11 Summit BPS Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items -
 Mechanical Equipment Items -
 Contingency -

$37,500
$0
$0
$7,500
$45,000
12 Washington BPS Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items (New MCC) -

$31,500
$60,000
CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 13

ITEM
# DESCRIPTION BUDGETARY

ESTIMATE
 Mechanical Equipment Items (Valves) -
 Contingency -
$20,000
$22,300
$133,800
13 Murphy BPS, Murphy (2) & Oceanview (2) Reservoirs Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items (New MCC + Underground Conduit) -  Mechanical Equipment Items -
 Contingency -

$51,000
$80,000
$0
$26,200
$157,200
14 Rideout Reservoir Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items -
 Mechanical Equipment Items -
 Contingency -

$16,500
$0
$0
$3,300
$19,800
15 Reservoir #12 Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items -
 Mechanical Equipment Items -
 Contingency -

$17,500
$0
$0
$3,500
$21,000
16 Painter & Hazard Reservoirs Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items -
 Mechanical Equipment Items -
 Contingency -

$23,000
$0
$0
$4,600
$27,600
17 College Hills Reservoirs Improvements:
 Controls & Field Instrumentation Equipment Items -
 Electrical Equipment Items -
 Mechanical Equipment Items -
 Contingency -

$25,500
$0
$0
$5,100
$30,600
18 Engineering documentation for complete system. $175,000 19 General cleanup at remote facilities (conduit, wire, etc.). $50,000 20 Spare parts repository. $50,000

CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 14

ITEM DESCRIPTION BUDGETARY

ESTIMATE

A
B
C
D
E
F
G
H
I
New Radio Communications System
Complete SCADA System Replacement
Remote Facility I&C Improvements (Equipment + Labor)
Remote Facility Electrical Improvements (Equipment + Labor) Remote Facility Mechanical Improvements (Equipment + Labor) Contingency
Remote Facility General Cleanup Services
Spare Parts
Engineering Services
$90,000
$200,000
$481,000
$235,000
$170,500
$177,300
$50,000
$50,000
$175,000

Grand Total Without New RTUs $1,628,800
J Obtain New Remote Telemetry Units $402,000
Grand Total With New RTUs $2,030,800

BUDGETARY ESTIMATE SUMMARY TABLE

CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 15

SUMMARY:

In summary, although operational, the existing SCADA system is in need of an upgrade. The central SCADA Server hardware and software are obsolete and the configuration is extremely proprietary. The communications architecture should be redesigned with the City’s future requirements in mind. The communication protocol driver and programming software is very old and should be upgraded in the near future. There has been a fundamental shift in the industry with respect to communications. The adoption of Ethernet TCP/IP as an industry standard is prevalent everywhere. The existing Bristol RTU’s do not provide direct support for this communications standard. A plan should be developed to address future communication requirements.

A SCADA system upgrade would enhance the overall functionality, along with the system’s robustness, security, performance, and reliability. The graphics and operator interfaces of today’s SCADA systems are considerably more intuitive and the operator training requirements would be decreased accordingly.

The RTU’s are aging and the available communications options of the future are limited. The programming and overall site configuration could be improved. The RTU power subsystems need to be upgraded as previously noted. The conduit and wiring practices at the individual facilities need to be evaluated and upgraded as required.

Many of the field instruments are non-operational or extremely old and fragile. Some of the facilities are missing instrumentation and that is directly contributing to an overall lack of consistency and standardization throughout the system. This particular problem should be addressed on a site-by-site basis. Refer to the “Site Issues Summary” for the specific details on a site-by-site basis. Some of the instrumentation issues are directly contributing to operational problems.

Due to City fiscal budgetary constraints, Boyle feels the following recommendations and prioritization of remote site improvements is a viable approach the City should consider for upgrading the existing SCADA System and implementing remote site improvements:

Recommendation 1 – Replace and Upgrade Entire SCADA System (New RTUs)

ITEM
# DESCRIPTION BUDGETARY

ESTIMATE
1 Eliminate leased telephone lines – Obtain new radio communication system $90,000 2 Replace existing central SCADA hardware & software $200,000 3 Obtain 15 New Remote Telemetry Units (RTU) $335,000 4 SCADA System Design Engineering & Plans and Specifications $85,000 5 Contingency $142,000
Estimated Upgrade Cost $852,000

CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 16

Recommendation 2 – Replace and Upgrade SCADA System (Keep Existing RTUs)

ITEM
# DESCRIPTION BUDGETARY

ESTIMATE
1 Eliminate leased telephone lines – Obtain new radio communication system $90,000 2 Replace existing central SCADA hardware & software $200,000 4 SCADA System Design Engineering & Plans and Specifications $85,000 5 Contingency $75,000
Estimated Upgrade Cost $450,000

Recommendation 3 – Prioritize project site improvements to meet City fiscal budget constraints as follows:

Priority 1 – Upgrade / Replace site field instrumentation.

Priority 2 – Upgrade / Replace site electrical components.

Priority 3 – Upgrade / Replace mechanical components.

Priority 1 – Upgrade / Replace site field instrumentation (Sites listed in order of importance)

ITEM
# DESCRIPTION BUDGETARY

ESTIMATE
1 Pumping Plant # 2 $123,000
2 MCC Room (Well # 15,16, 17, 18) $50,500
3 Murphy Booster PS & Oceanview Reservoir $51,000
4 Summit Booster PS $37,500
5 Greenleaf Booster PS & Greenleaf Reservoir $34,500
6 Rideout Booster PS & Hoover Reservoir $32,000
7 Washington Booster PS $31,500
8 College Hills Booster PS $14,500
9 Well # 13 $13,500
10 Well # 14 $10,000
11 Painter & Hazard Reservoir $23,000
12 College Hills Reservoir $25,500
CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 17

ITEM
# DESCRIPTION BUDGETARY

ESTIMATE
13 Reservoir # 12 $17,500
14 Rideout Reservoir $16,500
15 Instrument Replacement Design Engineering $15,000
16 Contingency $99,100
Estimated Priority 1 Upgrade Cost $594,600

Priority 2 – Upgrade / Replace site electrical components (Sites listed in order of importance) Sites not listed require no electrical upgrade.

ITEM
# DESCRIPTION BUDGETARY

ESTIMATE
1 Pumping Plant # 2 $35,000
2 Murphy Booster PS & Oceanview Reservoir $80,000
3 Rideout Booster PS & Hoover Reservoir $60,000
4 Washington Booster PS $60,000
5 Electrical Replacement Design Engineering $12,000
5 Contingency $49,400
Estimated Priority 2 Upgrade Cost $296,400

Priority 3 – Upgrade / Replace site mechanical components (Sites listed in order of importance) Sites not listed require no mechanical upgrade.

ITEM
# DESCRIPTION BUDGETARY

ESTIMATE
1 Pumping Plant # 2 $122,500
2 MCC Room ( Well #15, 16, 17, 18 ) $28,000
4 Washington Booster PS $20,000
5 Mechanical Replacement Design Engineering $12,000
CITY OF WHITTIER – SCADA SYSTEM EVALUATION MARCH, 2004

PAGE 18

ITEM
# DESCRIPTION BUDGETARY

ESTIMATE
5 Contingency $36,500
Estimated Priority 3 Upgrade Cost $219,000

Boyle recommends that the City consider the list of priorities from this report and then develop a reasonable budget and schedule for implementation of first; the control system SCADA System improvements, second; the site electrical improvements, third; the site mechanical improvements. Boyle would be willing to assist the City with this objective, including system design and implementation services.

ES-W18-100-01/BEC/WHITTIER SITE INSTRUMENTATION EQUIPMENT INVENTORY - SECTION 4.DOC

SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION
&

EQUIPMENT INVENTORY
CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 2

SITE REFERENCE Y/N COMMENTS
Upper Basin Wells RTU (aka Well Field)
General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect
 Power Failure Relay

Y
Y
Y
N
Y
N
N
N
N

Wall-mount type.

Bristol-Babcock model 3310.

Existing open-frame, linear. Needs replacement.

Needs replacement.

No local RTU disconnect.

Include as a basic requirement.

Well Pump No.13 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Oil Level Sensor
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
N
Y

Need to monitor discharge pressure.

Manual water level gauge on the wellhead.

Water Specialties propeller meter.

Needs replacement.

Needs replacement.

No CL2 injection at the wells, only at PP2.

Installed on well house door.

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 3

SITE REFERENCE Y/N COMMENTS
Upper Basin Wells RTU (aka MCC Room)
General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect
 Power Failure Relay

Y
Y
N
Y
Y
N
N
N
N

Wall-mount type.

Bristol-Babcock model 3330.

Required.

Include as a basic requirement.

Well Pump No.15 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
N
Y
Y
Y
N
Y

Need to monitor discharge pressure.

Needs replacement.

Needs replacement.

N/A

Well Pump No.16 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Need to monitor discharge pressure.

Level transmitter needs repair / replacement.

Needs replacement.

Needs replacement.

N/A

Well Pump No.17 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
N
Y
Y
Y
N
Y

Need to monitor discharge pressure.

No flow transmitter.

N/A
CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 4

SITE REFERENCE Y/N COMMENTS
Well Pump No.18 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Need to monitor discharge pressure.

Needs replacement.

Needs replacement.

N/A

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 5

SITE REFERENCE Y/N COMMENTS
Central Basin Wells RTU
General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect
 Power Failure Relay

Y
Y
Y
N
N
N
N
N
N

Wall-mount type.

Bristol-Babcock model 3310.

Existing open-frame, linear. Needs replacement.

Well Pump No.14 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Oil Level Sensor
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
N
Y
Y
Y
N
N
Y

Need 4-20 mA transmitter.

N/A

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 6

SITE REFERENCE Y/N COMMENTS
Pumping Plant No.2 RTU
General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect
 Power Failure Relay

N
Y
N
Y
Y
N
N
N
N

None. Required!
Bristol-Babcock model 3330.

Need a new power supply.

Needs replacement.

Needs replacement.

Include as a basic requirement.

PP2 Well Pump No.8 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
N

Need a discharge pressure transmitter.

Needs to be connected to RTU.

N/A
Need a protective cage w/ intrusion switch.

PP2 Booster Pump No.1 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
N

Needs to be replaced. Also need new conduit to RTU.

N/A

PP2 Booster Pump No.2 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
N

Needs to be replaced. Also need new conduit to RTU.

N/A

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 7

SITE REFERENCE Y/N COMMENTS
PP2 Booster Pump No.3 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
N

Needs to be replaced. Also need new conduit to RTU.

N/A

PP2 Booster Pump No.4 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
N

N/A

PP2 Booster Pump No.5 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
N

Needs to be replaced. Also need new conduit to RTU.

N/A

PP2 Booster Pump No.6 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
N

Need new conduit to RTU.

N/A

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 8

SITE REFERENCE Y/N COMMENTS
PP2 Booster Pump No.7 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
N

N/A

PP2 Booster Pump No.8 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
N

N/A

PP2 Settling Basin No.1 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer (AIT)
 Intrusion Alarm

N
Y
N
N
N
N
N
Y
N

Need replacement.

PP2 Settling Basin No.2 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer (AIT)
 Intrusion Alarm

N
N
N
N
N
N
N
N
N

Need new redundant LT.

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 9

SITE REFERENCE Y/N COMMENTS
Rideout BPS & Hoover Reservoir RTU
General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect
 Power Failure Relay

Y
Y
Y
N
N
N
N
N
N

Wall-mount type.

Bristol-Babcock model 3330.

Existing open-frame, linear type. Need replacement.

Rideout Booster Pump No.1 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Need both suction and discharge PT’s.

N/A

Need replacement.

Need replacement.

N/A

Rideout Booster Pump No.2 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

N/A

Need replacement.

Need replacement.

N/A

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 10

SITE REFERENCE Y/N COMMENTS
Hoover Reservoir Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
Y

Need replacement.

Need flowmeter on leach line.

N/A
Need door alarm on reservoir door.

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 11

SITE REFERENCE Y/N COMMENTS
Rideout Reservoir RTU
General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect
 Power Failure Relay

Y
Y
Y
N
N
N
N
N
N

Wall-mount type.

Bristol-Babcock model 3305.

Existing open-frame, linear. Need replacement.

Rideout Reservoir Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
Y

Need new submersible configuration.

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 12

SITE REFERENCE Y/N COMMENTS
Greenleaf BPS & Greenleaf Reservoirs No.1 & No.2 RTU
General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect

Y
Y
N
Y
Y
N
N
N

Wall-mount type.

Bristol-Babcock model 3330.

Greenleaf Booster Pump No.1 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Greenleaf Booster Pump No.2 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Greenleaf Booster Pump No.3 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 13

SITE REFERENCE Y/N COMMENTS
Greenleaf Booster Pump No.4 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Greenleaf Booster Pump No.5 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Greenleaf Booster Pump No.6 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Greenleaf Reservoir No.1 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
Y

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 14

SITE REFERENCE Y/N COMMENTS
Greenleaf Reservoir No.2 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
Y

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 15

SITE REFERENCE Y/N COMMENTS
Reservoir No.12 RTU
General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect
 Power Failure Relay

Y
Y
Y
N
N
N
N
N
N

Wall-mount type.

Bristol-Babcock model 3310.

Existing open-frame, linear. Need replacement.

Reservoir No.12 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
N

Need new submersible configuration.

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 16

SITE REFERENCE Y/N COMMENTS
Hazard Reservoir & Painter Reservoir RTU
General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect

Y
Y
Y
N
N
N
N
N

Wall-mount type.

Bristol-Babcock model 3305.

Open-frame, linear.

Hazard Reservoir Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
N

Painter Reservoir Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
N

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 17

SITE REFERENCE Y/N COMMENTS
Washington BPS RTU
General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect
 Power Failure Relay

Y
Y
Y
N
N
N
N
N
N

Wall-mount type.

Bristol-Babcock model 3305.

Existing open-frame, linear. Need replacement.

Washington Booster Pump No.1 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Need replacement.

Need replacement.

Washington Booster Pump No.2 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Need replacement.

Need replacement.

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 18

SITE REFERENCE Y/N COMMENTS
College Hills BPS RTU
General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect
 Power Failure Relay

Y
Y
Y
N
N
N
N
N
N

Wall-mount type.

Bristol-Babcock model 3330.

Existing open-frame, linear. Need replacement.

College Hills Booster Pump No.1 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

College Hills Booster Pump No.2 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 19

SITE REFERENCE Y/N COMMENTS
College Hills Reservoirs (2) RTU
General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect
 Power Failure Relay

Y
Y
Y
N
N
N
N
N
N

Wall-mount type.

Bristol-Babcock model 3305.

Open-frame, linear.

College Hills Reservoir No.1 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
Y

College Hills Reservoir No.2 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
Y

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 20

SITE REFERENCE Y/N COMMENTS
Summit BPS & Hydropneumatic Surge Tank RTU
General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect
 Power Failure Relay

Y
Y
Y
N
N
N
N
N
N

Wall-mount type.

Bristol-Babcock model 3310.

Open-frame, linear.

Summit Booster Pump No.1 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Summit Booster Pump No.2 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Summit Fire Pump No.1 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 21

SITE REFERENCE Y/N COMMENTS
Summit Hydro-Tank Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
Y

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 22

SITE REFERENCE Y/N COMMENTS
Murphy BPS, Murphy Reservoirs (2), & Oceanview Reservoir RTU General RTU Components:
 Enclosure
 PLC
 24 VDC Power Supply
 24 VDC Battery Charger
 Batteries
 TVSS
 EMI/RFI Power Line Filter
 Circuit Breaker Disconnect
 Power Failure Relay

Y
Y
Y
N
N
N
N
N
N

Wall-mount type.

Bristol-Babcock model 3330.

Open-frame, linear.

UPS at this site - needs replacement.

Murphy Booster Pump No.1 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Murphy Booster Pump No.2 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
N
Y
Y
Y
Y
Y
N
Y

Murphy Reservoir No.1 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
Y

CITY OF WHITTIER – SCADA SYSTEM EVALUATION

SITE INSTRUMENTATION / EQUIPMENT INVENTORY
MARCH, 2004

PAGE 23

SITE REFERENCE Y/N COMMENTS
Murphy Reservoir No.2 Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
Y

Oceanview (Left-Side) Reservoir Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
Y

Oceanview (Right-Side) Reservoir Instrumentation:
 Pressure Transmitter (PT)
 Level Transmitter (LT)
 Flow Meter (FM)
 Flow Transmitter (Electronic Output)
 Flow Switch
 Low Suction Pressure Switch (PSL)
 High Discharge Pressure Switch (PSH)
 Chlorine Residual Analyzer
 Intrusion Alarm

N
Y
N
N
N
N
N
N
Y

ADE EntErprisEs prEpArED for: prEpArED by:

City of Adelanto ADE Enterprises
Adelanto, CA San Diego, CA
909-374-8752
September 2, 2020
City of Adelanto
Water System SCADA Upgrade Project
Existing Water System SCADA
System Assessment Report
Final
February 2015

_________________________________
Prepared By Maris Janson, PE
Project Engineer

_________________________________
Reviewed By Harvey Gobas, PE
Project Manager, Psomas

1 Adelanto Existing Water System SCADA System Assessment Report September 2020

Contents
A. Purpose of Assessment Report ........................................................................................ 2 B. Existing Water System SCADA System ........................................................................... 3

1. Field Instruments .................................................................................................................... 3

2. Communications ..................................................................................................................... 4

3. Monitoring and Control ........................................................................................................... 5

4. SCADA Hardware and Software ............................................................................................ 5

5. Remote Site Security .............................................................................................................. 5 C. Recommended SCADA System Configuration ............................................................... 6

1. Field Instruments .................................................................................................................... 6

2. Wireless Radio Communication ............................................................................................. 7

3. Programmable Logic Controller (PLC) ................................................................................... 7

4. SCADA Hardware and Software Upgrade ............................................................................. 8

D. SCADA System Maintenance and Support Service Consideration …………………….8 E. Preliminary Estimated Design & Construction Costs ..................................................... 9

Drawings:

Water Distribution System Diagram
SCADA System Block Diagram

2 Adelanto Existing Water System SCADA System Assessment Report September 2020

Existing Water SCADA System Assessment Report
A. Purpose of the Assessment Report
The purpose of this report is to provide a summary of information related to the existing instrument & controls system and proposed upgrade for the control and monitoring of the remote sites . The information and recommendations contained herein will be use d as a basis for preparing plans, specifications, and opinion of probable construction cost for project biding and construction.

ADE/PSOMAS assessed the existing SCADA system based on our meetings with City and PERC Water staff.

The following areas are covered by the assessment report:
• Remote Site SCADA Needs Assessment
• SCADA Software and Hardware
• PLC/RTU Hardware
• Wireless Communications
Included in this report are the following general topics:
• Description of existing SCADA system
• Description of proposed upgrades
• Opinion of Probable Construction and Design Costs

3 Adelanto Existing Water System SCADA System Assessment Report September 2020

B. Existing Water System SCADA System
The City facilities and existing SCADA system were assessed and evaluated by ADE/PSOMAS.

The Water Distribution System Diagram drawing shows our understanding of the City’s overall water distribution system.

The following was observed from our site visits.

1. Field Instruments
From our site visits we observed the following condition of the existing field instrumentation being utilized by the City.
• Well Sites

(1) Have existing propeller flowmeters with transmitting heads but none of the field wiring was provided or routed to an existing RTU. (2) Discharge pressure transmitters were nonfunctional.

(3) Radios at many of the well sites were disconnected.

(4) The RTU panels and insi de equipment appeared to be non functional and the components were over ten year’s old and approaching obsolescence. • Booster Pump Station Sites

(1) Many discharge pressure switches were nonfunctional and/or disconnected.

(2) Discharge Pressure Transmitters nonfunctional and/or disconnected.

(3) Tank level sensing lines are rou ted inside the pump station to a level transmitter. The functionality of the level transmitter is questionable.

(4) Some sites have flowmeters but the reliability of the flow signal is questionable.

(5) The RTU at the pump station for the most part i s used to monitor the status of the pump. An operator can manually command a pump to start/stop at the local control panel or via the existing SCADA system.

Essentially, no automatic control logic is utilized to start/stop the pumps.

(6) The operators expressed an interest in having the booster pump stations be provided with the ability to be controlled automatically based on tank level, system pressure or flow.

(7) The operators expressed an interest to have a local Operator Interface Terminal (video screen) to be able to view all of the analog signals (flow, pressure, level) associated with the local Booster Pump Stations.

(8) The operators expressed an interest to be able to monitor and control all of

4 Adelanto Existing Water System SCADA System Assessment Report September 2020

the remote sites in addition to the Boo ster Pump Station sites from a lap top or tablet device.

2. Communications

The City’s present radio system utilizes Motorola 450 MHz radios as part of the Kingfisher RTU system. It is our understanding that the majority of the City’s remote sites communicate with the SCADA system intermittently or not at all. City staff cannot rely on receiving operational data from the remote sites and consequently are required to travel to the various sites on a daily basis to verify proper operation of each facility, thus, defeating the purpose of having a SCADA system.

ADE/PSOMAS performed a radio frequency analysis (See the September 2014 Radio Communication Analysis Technical Memorandum) which determined a new 5.8 GHz radio communication system would provide the City reliable communication (99.669 to 99.999 % uptime) for all of the water system remote sites.

The City currently has 7 existing remote facilities with existing RTU /radio system. These seven facilities utilize local remote terminal units (RTU) and are monitored by an existing supervisory control and data acquisition (SCADA) system located at the Intermediate Tank Booster Pump Station. The seven facilities that are part of the SCADA system are the following:

(1) Intermediate Tank & Booster Pump Station
(2) Well 4 & 5A
(3) Filter Plant Booster 1200 Pump Station
(4) Well Field (Well 1G, 3G2, 4G, 8G2, 14A)
(5) 3 MG Tanks (2 Tanks - Booster PS, Well 6, 7)
(6) Well 15
(7) 5 MG Tanks (3 Tanks)
The RTU’s and associated radios are old, in ill repair and have reached their useful life expectancy and should be replaced with the latest industry standard equipment.

Two additional radio sites were included in our analysis for the Water System SCADA Upgrade project:

(8) Victorville Elevated Tank
(9) Water Department Operations Building

Additionally, provisions shall be made during the final design phase to allow for incorporation of the following potential facilities with the overall SCADA system:
(1) Well 8A
(2) Well 16
(3) R
³ (regional recharge recovery site)
(4) EOC (emergency operations center)

Because of the uncertainty of adding the above four sites to the SCADA system, the costs associated for adding these facilities are not included in the preliminary estimated construction costs shown in Section E.

5 Adelanto Existing Water System SCADA System Assessment Report September 2020

3. Monitoring and Control
For the seven stations that are equipped with Kingfisher RTUs, the SCADA and RTU systems are configured so the SCADA operator can view the remote facilities data and receive alarms. Set point changes and pump operation is typically done locally at the respective control panel. The operator has the ability to command pumps on/off via the SCADA system. However, there is no automatic control logic programmed in the RTU.

The booster pumping stations are currently controlled via local hardware logic. The hardware logic consists of relay logic wired to local pressure switches and/or level switches. Upon reaching a high/low level set point, a start/stop command will be initiated and the hardware will operate a motor depending on the command and status of local hand switches.

Therefore, the SCADA RTU’s basically function as manual control and monitoring only devices. The RTU does not provide any local automatic logic to control a well or booster pump. An operator can manually command a pump to start from the SCADA system computer HMI.

4. SCADA Hardware and Software
The current Supervisory Control System (SCS) includes a SCADA system located at the Intermediate Tank site Booster Pump Station building which consists of a workstation, one monitor, a keyboard, and a mouse. A second workstation is located in the Water Department Operations building and communicates with the master SCADA system via a Wi-Fi connection. The software package currently installed in the computer system is Wonderware Factory Suite 2000 with InTouch

7.1. 5. Remote Site Security
It appeared from our site visits that the City has experienced incidents of vandalism, graffiti, break- ins, or theft at their facilities.

The facilities are typically located near moderately populated housing tracts or in isolated remote areas. The perimeter fencing (typically standard 6-foot chain link) does not appear to be sufficient to keep intruders out.

Since remote site security was not part of the scope of work, we only performed a cursory review of the Water System SCADA site security.

The City should evaluate the following suggestions for adding security features at the various SCADA remote sites:

1. Provide either door intrusion switches or interior motion detectors at all buildings including sheds, i.e., booster pump station building. This will provide inexpensive intrusion monitoring.

2. Provide exterior camera system and motion detectors at problem facilities. Consider the history and contents of this facility to help decide where cameras are warranted.

3. Intrusion switches for control panels. For outdoor panels, this will generate an alarm and indicate an unauthorized intrusion in the control panels. For indoor panels, it will alert that the control panel is being accessed even if it is accessed by an authorized visitor to the facility. These switches shall be connected to the local RTU. The SCADA operator can then verify if it is a legitimate access.

6 Adelanto Existing Water System SCADA System Assessment Report September 2020

4. Intrusion switches on tank access ladders and hatches. This will alarm and indicate an intrusion at the tank sites. Switch will be connected to the local RTU.

5. Motion-activated lighting near building entrances and all facilities greater than 200 square feet. Upon tripping a motion detector, security lighting should activate. Motion detector should be connected to City RTU panel.

It is our recommendation that a more detailed site by site security evaluation be performed to establish the minimum security requirements. Minimum requirements might be intrusion switches on building doors, intrusion switches on control panels, perimeter motion sensors and possibly CCTV cameras at high risk facilities.

C. Recommended SCADA System Configuration
The SCADA System Block Diagram drawing shows the suggested preliminary SCADA system configuration. The objective is to equip each facility with equipment required for interfac ing all available events and values to the SCADA system at the Water Department Operations Building.

The control philosophy should be to provide automatic standalone control at each remote facility. The design of the Remote Terminal Unit should provide the control logic to accomplish this function.

Additionally, field sensors (level, pressure, flow etc.) to provide the monitoring signals for the RTU control logic should be replaced or provided.

The SCADA operator will be able to trend analog values to check equipment health and operation which will also aid in scheduling pre-failure repairs or modifications. In the event of a failure, the City will be better informed of the situation before deploying an operator to investigate the problem. This will enable the City to use their resources more efficiently by matching the issue with the technician to resolve the problem.

1. Field Instruments
A cursory review of existing site field instruments revealed that many of the field sensors were missing and/or nonfunctional. For example, Propeller meters had transmitting heads but no wiring to the RTU panel. Booster pumps had pressure switches that were nonfunctional or missing. Booster pumps had flowmeters in vaults with unreliable signals being sent to the RTU etc.

A more detailed field instrument site by site investigation should be performed to determine and establish what new equipment should be added to each site.

Intrusion Switches:

We recommend limit switches be added on doors and hatches. We suggest an electro-mechanical device that consists of a lever actuator. When an object comes into contact with the actuator, the device outpu ts a contact . Limit switches offer ruggedness, simple visible operation, ease of installation and reliability of operation.

For panel intrusion detection, a light duty switch is recommended to be provided. For hatch intrusion detection, we recommend a heavy-duty, outdoor rated, watertight limit switch be utilized.

7 Adelanto Existing Water System SCADA System Assessment Report September 2020

2. Wireless Radio Communications
A comprehensive cost analysis was not performed. However, based on our past experience, we performed a planning level cost estimate. Our analysis was based on using the 5.2- to 5.8-GHz unlicensed radio band.

Our radio system cost analysis was based on point-to-multipoint equipment at each of the remote locations.

Proxim radios were utilized for the radio study because of past success with these radio systems and the Proxim radio technology provided combination base station and subscriber station polling technology that could handle random hidden radio interference situat ions. Additionally, this technology provides the flexibility of providing redundant alternative communication paths should anyone path have a failure.

Proxim radios were used as the benchmark from a cost perspective. The radio study determined that two sites will require 30 foot radio towers and three sites will require 20 foot towers. Four sites will utilize existing tanks to mount radio/antenna equipment on.

An average cost per site (9 radio sites) of $8,500 was determined to cover the cost of radio equipment (both at the base station sites and the remote subscriber sites) as well as the installation. The cost for the point-to-multipoint radio system would be approximately $76,500.

3. Programmable Logic Controller (PLC)
The term RTU and PLC is used interchangeably and both are utilized for remote telemetry purposes.

PLCs are available in various sizes from small, medium to large systems and from various manufacturers. The City has existing Allen Bradley PLCs in place at the Wastewater Plant and at the Water Plant at the present time. This being the case, and for standardization purposes, we would recommend the Allen Bradley CompactLogix famil y of PLCs for the water distribution facilities SCADA system application.

The approximate average cost for the PLC’s is $11,500/site. For seven sites the cost would be $80,500.

The operators expressed a desire to be able to view pertinent data about the operation of the booster pump stations locally at each pump station. A local Operator Interface Terminal (video screen) tied to the local PLC would serve this purpose. The following sites would be provided with OIT’s:

(1) Intermediate Tank Booster Pump Station
(2) Filter Plant 1200 Booster Pump Station
(3) 3 MG Booster Pump Station.

We recommend the City use the Allen-Bradley PanelView OIT for each facility requiring an OIT. Per our experience, the PanelView OITs offer brighter displays, ability to mount outdoors, and appear to be more rugged than the others. Integration will be a lot smoother because both the PLC and OIT will be by the same manufacturer. In addition service & spare parts are readily available due to Allen- Bradley's large market share in providing OIT for the water/wastewater industry.

8 Adelanto Existing Water System SCADA System Assessment Report September 2020

4. SCADA Hardware and Software Upgrade
The City’s existing SCADA computer and software is over ten years old and reaching the end of its useful life. Both elements of the SCADA system should be upgraded to the latest industry standards.

The central processing unit (CPU) for the SCADA upgrade project should utilize the latest computer hardware technology. The computer industry continues to lead the way with innovative graphics display capabilities, open single- processor multitasking software support, and high- speed communication interfaces. The speed, quality, and overall performance of this type of CPU continue to evolve at a rapid pace. Computer hardware should be selected with a suitable platform on which a multitasking application software package could be implemented for the City's SCADA upgrade project.

As with computer hardware, SCADA software packages are also continually evolving with a multitude of different software features and applications. There are a number of SCADA software packages utilized in the water and wastewater that the City should evaluate for their upgrade project . Our suggestion would be to evaluate the following software packages based on our experience with these packages in the water/wastewater industry:

(1) Wonderware InTouch
(2) OnSite
(3) ClearScada

The cost is based on a new SCADA system conf iguration we recommend the Cit y utilize. The recommendation is as follows:
• One HMI Workstations
• Two Video Screens
• One Printer
• One Automatic Alarm Dialer
Below is the estimated cost for upgrading the SCADA software and hardware.

Hardware - $16,500
Software - $15,000
$31,500
The above system features will provide improved graphics, report generation capabilities, additional remote workstations, fully compatible with the suggested PLC system.

D. SCADA System Maintenance and Support Service
Consideration
From our experience, t he suggested technologies and equipment provide dependable and loyal operation. Nevertheless, overtime some components may need maintenance or replacement to preserve an optimal performing system.

9 Adelanto Existing Water System SCADA System Assessment Report September 2020

We suggest the City to maintain an annual support contract for the SCADA system . The supp ort contract will aid the City in maintaining the SCADA overall system and to keep operating smoothly. It will also provide software version upgrades, up to date patches & functions, and assistance in resolving any technical issues at no additional costs.

Service and maintenance of hardware and programming may be either out-sourced or done in-house.

We suggest out-sourcing rather than having the duties performed by the City. In order for the City to do the work, one or more technicians will need to be trained on the new equipment and dedicate time to stay up to date with the system. We suggest the C ity to acquire a support agreement with an integrator for service on the SCADA hardware & software, PLCs, radios, and instruments. Typically, integrators employ specialists for each technology that continuously work on the providing and maintaining the equipment.

The support agreement should include on-call services. Services should provide as-needed hardware and programming services. Integrator shall be able to respond to emergency situations within 24 hours and have the ability to access the SCADA system remotely. Being “on-call” allows the County to work on matters they feel comfortable undertaking and leave difficult issues for the integrator.

E. Preliminary Estimated Design & Construction Costs
Based on the criteria outlined in this report, an opinion of probable design and construction cost is estimated below:
(1) Radio System $76,500.
(2) Remote RTU’s $80,500.
(3) SCADA Hardware & Software $31,500.
(4) System Engineering & Programming $106,500.
$295,000
(5) New Field Instruments $75,000.

Sub-Total $370,000.
(6) Cost for adding Security Camera
System (9 Sites Plus 2 Future Sites) $145,000
(7) Cost for Consultant Design and
Construction Services $150,000
Total Overall Project Budgetary Estimate $665,000

The above cost includes consultant fees, hardware, installation, programming, labor, documentation, testing, and debugging. A more refined estimate can be made during the design phase when a more detailed evaluation is made.

ADE EntErprisEs prEpArED for: prEpArED by:

City of Adelanto ADE Enterprises
Adelanto, CA San Diego, CA
909-374-8752
September 2, 2020

City of Adelanto
Water System SCADA Upgrade Project
Radio Communication Analysis
Technical Memorandum
Final
February 2015

_________________________________
Prepared By Maris Janson, PE
Project Engineer

_________________________________
Reviewed By Harvey Gobas, PE
Project Manager, Psomas
ADE Enterprises
Adelanto TM Radio Analysis September 2020
i
Contents

1.1 Project Approach ............................................................................................................................. 1

1.2 Computer Radio Path Study ............................................................................................................ 1

1.3 Radio Analysis Summary ................................................................................................................ 2

1.4 Conclusion and Recommendation .................................................................................................. 3 Attachments:

(1) Radio Site Coordinate Table.
(2) Computer Radio Path Propagation Analysis Documents
(3) Radio Path Routing Topography Map
(4) Remote Site Satellite Routing Map
(5) SCADA System Block Diagram

ADE Enterprises 1
Adelanto TM Radio Analysis September 2020

1.0 Background
The City of Adelanto contracted with PSOMAS and their subconsultant ADE Enterprises to perform professional engineering services for the SCADA Upgrade Project. Part of the scope of work for the project is to perform a SCADA system radio survey of the City wide water distribution facilities. Attachment (1) lists the various remote sites (9 sites) that were part of the study.

The City’s present radio system utilizes Motorola 450 MHz radios as part of the Kingfisher RTU system. It is our understanding that the majority of the City’s remote sites communicate with the SCADA system intermittently or not at all. City staff cannot rely on receiving operational data fr om the remote sites and consequently are required to travel to the various sites on a daily basis to verify proper operation of each facility, thus, defeating the purpose of having a SCADA system.

Additionally, the Quartzville Mountain radio repeater site is a very difficult site to gain access for maintenance, trouble shooting and repair purposes. The City would like to eliminate this site, if at all possible from the SCADA system.

Our goal was to find a radio communication configurati on that would provide the City with SCADA radio communication coverage to the City’s designated water distribution sites.

The purpose of this report is to summarize our computer radio analysis results and determine the feasibility of using a wireless communications system to monitor and control various water distribution sites.

1.1 Project Approach
The project objective was to determine the feasibility of using a wireless communication system for the City’s overall remote site SCADA system and as follows:

1. ADE/PSOMAS performed an independent computer radio frequency path analysis utilizing the Victorville elevated water tank on the abandoned air force base housing site as the radio base station/repeater site.

2. Attachment (1) lists the remote radio sites and associated site coordinates.

3. Attachment (2) shows the results of ADE/PSOMAS computer path analysis establishing a clear path for each associated remote site.

4. Attachment (3) shows the routing used for the radio path analysis. The color shading indicates the changes in the terrain elevations. The green area is lower elevation, the yellow area is higher than the green area and the brown to light brown is the higher elevation areas.

5. Attachment (4) shows the satellite routing locations associated with the remote sites.

6. Attachment (5) shows the overall SCADA system block diagram.

1.2 Computer Radio Path Study
The City indicated that the Victorville elevated water tank could be utilized for the SCADA radio system. The City will have to work out the details and an agreement with the City of Victorville to utilize this site for Adelanto’s SCADA system.

ADE Enterprises 2
Adelanto TM Radio Analysis September 2020
ADE based on the assumption that an agreement with Victorville will be worked out, used the Victorville Elevated Tank as the radio base /repeater station based on 5.7 GHz radios (this frequency also provides excellent bandwidth to handle large amounts of data at fast speeds) . This site was selected because the height of the elevated tank (120 Ft.) offered clear line of sight radio signal communications with the majority of the City’s remote water distribution facilities. Additionally, there would be no cost to the City to build a radio tower at this location. This site would also provide excellent radio coverage within a 3 to 5 mile radius of the tank which should cover any future water system growth within the City.

Attachment (1) shows the various antenna heights that were utilized in the computer analysis to establish acceptable radio signal strengths.

The important factor for the computer analysis is to determine if a reasonable fade margin between the Water Department HQ location and the remote sites can be established. The fade margin is the difference between the Received Signal Strength (transmitter power output m inus all losses) and the radio manufacturers Receiver Sensitivity (received signal strength level above receiver sensitivity level) ability to recognize received signal.

When one deploys a radio link you want to have a Receive Signal Strength that is sufficiently above the radio Receiver Sensitivity level in order to survive signal fading due to a variety of loss factors. These factors might include slight misalignment of antennas, losses due to fog and rain, tree and building obstructions, etc. As a rule of thumb one should try to obtain a minimum 15 dB of fade margin associated with each radio link. A better fade margin is between 20 dB to 30 dB. The higher the fade margin, the more reliable the link will be.

Based on the computer analysi s, the fade margi n levels are within acceptable industry standards which confirm the reasonability of utilizing a wir eless communication system for the Ci ty’s overall SCADA radio system utilizing the radio paths that were selected.

1.3 Radio Analysis Summary:

The following will summarize the results of the radio analysis.

1. Water Department HQ - The SCADA system computer and HMI will be located at the Water Department HQ control room. A subscriber radio will be provided with the antenna po inted towards the Intermediate Tank and Booster Pump Station site base radio.

A 30 Ft. antenna tower will be provided next to the Water Department HQ building.

Rather than routing conduit from the Booster Pump Station RTU to the SCADA computer at the Water Department HQ control room, it was decided to use radio communication rather than hardwire communication.

2. Intermediate Tank and Booster Pump Station – Three radios will be provided and mounted on the Intermediate Tank. One base radio will be pointed towards the 3 MG Tank site, Well 15 site and 5 MG tank site. Second base radio will be pointed towards the Victorville Elevated Tank repeater site. Third base radio will be pointed towards the Water Department HQ building.

3. Victorville Elevated Tank – Two radios will be provided on the elevated tank. One base radio will be pointed towards the Intermediate Tank site. Second base radio will be pointed towards the Well Fields, Water Treatment Plant, and Well 4, 5A sites.

The Victorville Elevated Tank is 120 Ft tall and provides excellent radio antenna coverage and ADE Enterprises 3
Adelanto TM Radio Analysis September 2020
will not require the construction of a separate antenna tower.

4. WTP & 1200 Booster Pump Station – One subscriber radio will be provided pointed towards the Victorville elevated tank site.

A 15 Ft. antenna tower will be required for this site and be located next to the Booster Pump building.

5. Well Fields (Well 1G, 3G2, 4G, 8G2) - One subscriber radio will be provided pointed towards the Victorville elevated tank site.

A 15 Ft. antenna tower wi ll be required for this site and be located next to the Well field RTU panel.

6. Well 4, 5A - One subscriber radio will be provided pointed towards the Victorville elevated tank site.

A 15 Ft. antenna tower will be required for this site and be located next to the Well RTU panel.

7. 3 MG Tanks (2) - One subscriber radio will be provided pointed towards the Victorville elevated tank site.

The radio antenna will be mounted on one of the tanks.

8. Well 15 - One subscriber radio will be provided pointed towards the Victorville elevated tank site.

A 30 Ft. antenna tower will be required for this site and be located next to the Well building.

9. 5 MG Tanks (3) - One subscriber radio will be provided pointed towards the Victorville elevated tank site.

The radio antenna will be mounted on one of the tanks.

1.4 Conclusion and Recommendation:

Based on ADE’s radio site computer analysis, it was determined that a point to multipoint (5.2 to 5.8 GHz) wireless communication system is feasible for the City to utilize for the Citywide water distribution facilities remote site SCADA system.

The Quartzville Mountain Repeater site can be eliminated if the City can utilize the Victorville elevated tank for their radio SCADA system.

COMPANY INFORMATION
Systems Integrated’s primary California offices:

Corporate Office Engineering Office

2200 North Glassell Street 8080 Dagget Street
Orange, CA 92865 San Diego, CA 92111
Tel: 714/998-0900 x 4562 Tel: 858/277-0700 x 4562
Fax: 714/998-6059 Fax: 858/277-1490

COMPANY BACKGROUND
Systems Integrated (SI) has been designing and implementing solutions for the automated control of infrastructure - water, power and transportation - for more than 40 years. We have always designed our control systems to be distributed, which required us t o design the associated communication networks to be capable of transporting high volumes of data, reliably and securely. Systems Integrated uses a variety of SCADA control system As the demands of communication networks continue to expand (i.e. more bandwidth; higher speeds and video), Systems Integrated’s expertise of designing and successfully deploying large scale communication networks using wireless technology has become a premier aspect of our engineering services. Our ability to link together various technologies (i.e. fiber, copper, wireless radio, satellite, cellular, etc.) within a communication network, benefits clients that have amassed various technologies over years of operation, since we know how to leverage legacy equipment with new communi cations equipment. The communications networks that Systems Integrated designs are cyber secure designed to comply with various standards: North American Electric Reliability Corporation (NERC) CIP current standards; NIST 800-82 R2, and FIPS 140- 2, etc. In the course of our work, Systems Integrated has provided more wireless communications networks for high speed control of traffic infrastructure than any other designer/supplier within the United States. SI has successfully delivered systems using a variety of contract structures: Task Order approach through a Master Agreement; Consultant/Specification model; Design/Build projects or Time & Material projects ranging in size from $50,000 to over $18 M. In order to perform the network construction aspects of t he work, Systems Integrated is a licensed general and electrical contractor in multiple states including California. SI has worked on private and public works contracts, subject to prevailing wage regulations, and is registered in the CA Department of Industrial Relations (Registration # 1000050406). Systems Integrated also has the ability to provide electrical and mechanical stamped drawings.

Based in California, SI undertakes projects throughout
North America and in selected international markets. SI has offices located throughout North America to support our operations and products. The company’s
headquarters are in Orange County, CA, centrally
located in Southern California, at 2200 N. Glassell Street, Orange, 92865 which is a 7,000 sq. ft. facility. In addition

to corporate functions, this office is the primary design engineering location for SI’s wireless and wired communications networks.

Our 8080 Dagget Street, San Diego, 92111 office is SI’s primary system integration facility. Most integration
hardware and software engineering is performed here, as well as CAD, documentation and training services. The
office consists of two buildings representing 18,000 ft² of space with 10,000 ft² dedicated to UL 508 certified control panel fabrication and SCADA system manufacturing.

SI’s standard software development and support office is in, Northampton, Massachusetts and is responsible for ONSITE ®, SITEVIEW®, and DataViews ®. This office handles all the design and updates for the standard software and provides worldwide software support to SI’s 3,000+ customer base.

Systems Integrated has been certified as a Small Business Enterprise (SBE) by the State of California: Certification No. 1003582 and a Minority, Woman owned business by CalTrans:

Certification No . 20573. SI is also federally certified as a WOSB by the Small Business Administration.

Due to the nature of our work with power utilities, Systems Integrated’s employees have had to pass NERC background checks for clearance to access critical infrastructure. Systems Integrated also performs DOD work, which requires security clearance, and necessitates that all SI employees complete annual security training. The NIST Special Publication 800- 82-R2 outlines the issues associated with industrial control systems security and SI engineers have taken various security training courses provided through the National Cybersecurity and Communications Integration Center (NCCIC) as well as various security training programs provided by DOD; Dept. of Homeland Security and Dept. of Interior.

Systems I ntegrated has been financially st able and profitable throughout i ts 40 + ye ars o f
operation. SI has a record of never failing to complete a contract on time and within budget.

Systems Integrated has never had any safety violations during our 40+ years of operation. SI maintains a $2 million dollar lines of working capital credit, with Bank of the West and $1million with Bristol Capital. SI also maintains a $40 million dollar surety line of credit with Atlantic Specialty Insurance Company, of the One Beacon Insurance Group for project bonds.

WIRELESS HIGH SPEED INFRASTRUCTURE
Systems Integrated’s engineering team has decades of experience in planning, designing, and implementing communications infrastructure systems. We have the benefit of a reputation of being a leader in developing innovative solutions to meet the complex and ever-changing needs of our clients. Our expertise covers a wide range of areas from solar power communications systems, to high security, high speed communications. We are experienced with all facets of modern high speed IP type wireless communications using both licensed and unlicensed frequencies.

In the transportation industry, Systems Integrated is a major supplier of wireless communications infrastructure for high speed bus prioritization, traffic control systems, and wireless video

backhaul. We have successfully integrated fiber optic and wireless networks to provide Wide Area High Speed Networks (WAN) that are both scalable and maintainable.

SI has designed and implemented over 100 wireless systems, with the largest project deployed in the County of Los Angeles, CA. This system covers over 4,000 square miles and 88 cities, and provides 20 Mbps communications from anywhere to anywhere and multiple point -to-point licensed backhauls of 700 Mbps. The County’s system is used as a private G4 communications system to transmit traffic flow information; controller status information; video data and system diagnostic data. This system has won several awards in the transportation arena including Innovative Use of Technology (Intelligent Transportation Society, 2014), and Best Return on Investment Award for a Public Works Project (County of Los Angeles, 2011). LA County’s network has been continually expanded as more intersections are added to the system.

SI is experienced in the design of communication systems and have been certified with various radio manufacturers’ products: Motorola, Cambium, Ceragon, Radwin, MDS, Proxim, Synetcom, ProSoft, Strix, Siklu, FreeWave, Teledesign, KeyWest, Wave Mobile, and Metricom. Systems Integrated collaborated with Wave Mobile Solutions to develop a DSRC (Dedicated Short Range Communications) radio, which is used for highly secure, high- speed wireless communication between vehicles and City infrastructure and is a component of the future connected vehicles technologies. The DSRC radios will communicate with vehicles internal controls and advise the state of the oncoming road (traffic; pedestrians, etc.) and provide preemption and priority rights to City vehicles.

Systems Integrated also developed a Network Management Software (NMS) package specifically for network systems. This software product was designed to provide both the current state of the various wireless links, as well as providing historical information regarding the overall reliability of the network (both wired and wireless). It supports both point -to-point and point -to- multipoint configurations, as well as, supporting data collection from Cisco and other vendor’s Ethernet switches. This product provides a graphical presentation of the location of the sites; the link status; throughput speed; Received Signal Strength Indication (RSSI); Signal to Noise Ratio (SNR); which frequency band is currently carrying the information (if the radio is set up to auto switch); number of bytes transmitted; number of bytes received; number of retries, and number of message failures.

SI has produced plans and specifications for many wired and wireless high- speed IP based communication systems and can provide additional support to our customers with remote network monitoring, system monitoring and 7 x 24 emergency support (both hardware and software). SI’s Orange County and San Diego offices maintain an inventory of spare parts for SI designed radio systems for easy access to our customers.

SCADA

SYSTEMS
Systems Integrated provides a wide variety of technology services, systems and automation products to utility, government, engineering firms, distributors and commercial customers. SI designs and develops turnkey control systems based on the latest, proven technology relevant to our customer base. Our typical automation system utilizes Windows or Linux based servers and workstations, with network and communications spanning copper, fiber and wireless products connecting to most major video, PLC, RTU and IED manufacturer’s devices in remote or plant - based installations.

Understanding a problem, with its inherent factors and desired result, is SI’s starting point on each project. SI works closely with the customer’s team to gain a detailed knowledge of their operational environment, as well as to understand their desired objective for the new SCADA system. SI performs site visits; studies the current system with the operators and engineers; performs simulation testing and any other necessary activity to affect the successful outcome of the system.

Designing a solution that works requires creativity and experience. SI engineers have years of experience developing systems that will achieve sustained benefits for our customer. We evaluate hardware, software and communications for the system taking into consideration long -term supportability; reliable and proven technology; security; expandability, and user -friendly operation. SI designs are standards based, ensuring that our customers can expand/upgrade their systems, and we always seek commercial off the shelf (COTS) products to reduce end-user costs and maintenance. Systems Integrated’s control systems are designed to grow with our customer’s requirements and evolve with changing technologies providing a life expectancy of at least twenty years.

Most of our projects require us to transition the active control system to the new system and ensure that there is no or minimal down time. Systems Integrated understands this requirement and have developed thoughtf ul approaches for bridging the old and new SCADA systems to accomplish this requirement and reduce the risk of impacting production. Systems Integrated’s engineers also have the rare combination of hands-on ability and field installation competence. It is from this practical experience, that we have developed some unique tools to reduce connection errors during the field installation work that simplifies and quickens deployment. Careful planning of the field installation reduces errors and time, which all ows SI to construct the system in an exponential manner.

Systems Integrated’ s
ONSITE utilizes SCADA software that is structured to simplify screen development and I/O tagging so that screens can be rapidly and accurately produced, and users can create an unlimited number of layers available beneath the surface providing immediate access to all levels of their operation. Systems Integrated is certified for a variety of SCADA software, including: iFIX, InduSoft,
ONSITE, Wonderware and Ignition.

Our panel shop adheres to quality industry standards and is UL 508A certified, mounts all the equipment in a manner that allows easy access for maintenance, and designs specialized cabinets, such as for cyber security. SI strives to deliver a system that can be operated by the skill levels of our customer’s staff; expand as needed to include dozens of facilities when fully deployed and can be upgraded over the normal lifes pan of the system when new software versions and hardware models become available and are relevant to the continued operation of the system.

Systems Integrated has decades of experience designing and implementing SCADA and Distributed Control Systems and f ully understands the critical nature of industrial operations.

Systems Integrated has developed methodologies that reduces potential risk and protects our customer’s operations, which affords us, our customers and our insurance partners, the confidence to shoulder the contractual responsibilities associated with projects in this industry.

ENGINEERING SERVICES
Systems Integrated’s engineering services provides Professional Engineers to support the design and deployment of SCADA and communications systems. On staff are electrical, mechanical, civil and controls systems Professional Engineers, RF engineers, and electronic design engineers.

The primary function of the engineering services is to create specifications and drawings required for construction and provide construction management to support customers with project management and act as an owner’s representation.

STANDARD PRODUCTS
Systems Integrated has more than a dozen hardware patents and millions of lines of copyrighted software. Our hardware products are integrated into various projects such as the control of power plants, control of water treatment plants, and control of subways and highways. SI’s standard software products are used worldwide to support everything from the control of space launches at Cape Canaveral, to control of nuclear power plants, and command and control interfaces supporting several military applications. SI’s standard software is also used to control the manufacturing processes of jet engines to Toyotas.

S

OFTWARE PRODUCTS
Systems Integrated ONSITE® SCADA software is a fully integrated suite of products that delivers the most powerful system for hydroelectric and pump storage water systems, to water and wastewater control today. ONSITE is a fully distributed SCADA solution designed to be scalable from a single ONSITE workstation node, to a fully distributed system with hundreds of nodes and hundreds of thousands I/O points with the visualization at all levels being the same. From the control room to remote field locations, ONSITE provides users with a fully distributed control system and the associated visualization using the same software everywhere, even when the communication network fails. All users – whether in the control room to remote field locations (including mobile users) - have access to the same displays. ONSITE web server delivers a fully functional ONSITE client for mobile users including laptop computers, tablets and smartphones.

This approach eliminates the need to maintain multiple visualization products (such as local standalone HMIs communicating with a PLC, to the control room operator screens). ONSITE packs all the visualization requirements for system wide control into a single open architecture product, making it unique in the industry.

To support ONSITE
®, SI’s DataViews® is used as the HMI. SI’s DataViews creates powerful graphical displays for visualizing critical information used to control and monitor real -time processes. The high performance, scalability and platform independence of the DataViews development toolkit for the visualization of data are the key reasons for its use as the front -end for control systems. DataViews is used by customers worldwide and is the only graphical presentation software that works on Linux, UNIX, and Windows; operates on more than 30 operating systems and is used in applications as complex as air traffic control to nuclear power plants.

DataViews provides some unique, significant features, such as, the ability of developed screens to automatically scale independent of the monitor ratio and/or monitor resolution. And DataViews allow screens to be built using a primary drawing and sub-drawings - there is no limit to the depth of sub-drawings. However, only ONSITE allows the tag substitution at both the screen and sub- drawing level and allows the sub- drawing to create the final tag name. These features substantially simplify the initial screen development and future modifications as changes are made to the system.

DV-Centro® is a software package that is used to control manufacturing processes. It is used to provide a methodology of automatically developing HMI screens used within the manufacturing environment.

HARDWARE PRODUCTS

STANDARD HARDWARE PRODUCTS
Systems Integrated manufacturers a Programmable Automation Controller (PAC) that expands the capabilities of hardware by merging features of more traditional PLC, DCS, and RTU systems, plus adding some capabilities from PCs. Unlike other manufacturers, SI’s SITEVIEW ® PAC is provided complete. Out of the box, all the software and hardware is provided to support all of the configuration and programming requirements. There is no additional software that must be purchased to develop ladder logic programs, develop HMI screens, create or look at the local database, or to connect the SITEVIEW PAC to a network. Each SITEVIEW PAC is provided with complete functionality including the ability to connect directly to the PAC with a keyboard, mouse and monitor. While it is completely self -contained, it can also be remotely managed and programmed. It is designed with built -in redundancy at all levels from the I/O to the SITEVIEW processor. The SI PAC is one of the only fully integrated systems that supports all of the IEC 61131-3 standards; that is fully integrated to allow the tag name to be generated at the SCADA system or the PAC, and has the ability to be scalable from a few hundred points to hundreds of thousands of points.

C

USTOM HARDWARE PRODUCTS
Systems Integrated always seeks off -the-shelf equipment, but given our customers unique situations, there are times that we need to design special hardware and/or software as an interface to link existing legacy equipment to the new equipment. Such work involves designing and manufacturing circuit boards, configuring and packaging entire systems to meet certain customer requirements, configuring off -the-shelf software and developing software (usually written in C/C++ or Assembly code) to create a complete solution. Systems Integrated has amassed a large repository of unique hardware products - PoE Board; Field Termination Interface Board, and Field Data Collection Processor, which is a small sample of our catalog. This work is always performed using industry standards to ensure its integration into the system and SI warrants all its manufactured items with a part replacement for any failed piece for the life of the SI system.

EXHIBIT C

FEE SCHEDULE

RFP - SCADA Master Plan, Integrator and
Support Services

Pricing Task 1 and Task 3

Due Date: September 16, 2020

Submitted by:

Systems Integrated
2200 North Glassell Street
Orange, CA 92865
Tel: 714/998-0900
Fax: 714/998-6059

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 1 Copyright © 2020
Systems Integrated
All rights reserved

The contents of this proposal are protected under copyright and other intellectual property laws. All rights reserved by Systems Integrated and its affiliated companies.

This document is intended for the City of Fullerton’s review associated with the Request for Proposal for the SCADA Master Plan, Integrator and Support Services. No part of this document may be disclosed in any manner to a third party without the prior written consent of Systems Integrated.

This document contains proprietary and confidential information to Systems Integrated, which are considered Trade Secrets that are excluded from Public Records Requests.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 2 Task 1
Master Plan Cost Analysis
Task Subtask Description of the Work Qty
Estimated
hours per
element
Total
time per
task
1 0 Workshop 1 1 16 16
2 Information Collection
1 Collection of data from main office facilities 1 40 40 2 Software licenses analysis 1 Included
3 Drawings of all control equipment from all sites 61 2 122 4 Drawings of existing communications network 1 8 8

5 Evaluate existing Wonderware system and make backup
copy of Wonderware system 1 16 16
6 Gather and copy existing O&M manuals for existing
control system field equipment 61 0.5 30.5

7 Inspection of field sites and collect documents
associated with field sites including PLC programs, radio configurations, hardware part numbers for 60 field sites. 61 2 122

8 Yearly costs including, hardware / software
maintenance, external support services, city employee
hours, overtime hours, upgrades additions /
modifications
1 8 8
9 System expansion including changes to the functionality, additional sites 1 4 4

10 Existing skill sets of the City including: SCADA master station training, PLC programming training, sensor repair / maintenance capability, VFD, soft start, MCC
maintenance
1 4 4
11 IT support, skill set, role to play. 1 4 4
3 Analysis of Information
1 How is existing SCAD System used 1 2 2
2 How does existing system compared to latest industry
standards 1 4 4
3 Remaining useful life of SCADA master 1 2 2
4 Remaining useful life of SCADA field devices 61 0.1 6.1 5 Cybersecurity exposure 1 24 24
4 Workshop 2 1 16 16
5 Development of Master Plan 1 160 160
6 Delivery of Master Plan and Presentation 1 4 4
Total Estimated Man-Hours 592.6
Average Engineering Labor Rate / Cost per Hour $150.00
Total Estimated Cost $88,890.00
Note: The quantity is based upon the 52 locations (15 Reservoirs, 13 Pumping Stations, 2 Forebays,12 Wells and 9 MWD Connections). If the City wishes to adjust the quantities, the cost estimate will adjust accordingly.

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 3 Task 3

(EXHIBIT A) Rates – SCADA SUPPORT SERVICES

The Consultant’s work under this Agreement shall be compensated based on the fee schedule shown below.

Schedule of Hourly Billing Rates
“Emergency Work” is generally defined as any work which requires (as determined by the City) response or completion either onsite or remotely within four hours after initial notification after the hours of: (Mon – Fri 7am – 5PM).

FIELD SERVICES*
Type of Work/Classification Hourly Billing Rate for Non- Emergency Work
Hourly Billing Rate for
Emergency Work
Sr. Project Manager 250.00 312.50
Project Manager 225.00 281.25
Sr. Software Engineer 220.00 275.00
Software Engineer 175.00 218.75
Sr. Systems Engineer 190.00 237.50
System Engineer 2 170.00 212.50
Systems Engineer 150.00 187.50
Applications Engineer 135.00 168.75
Field Engineer 145.00 181.25
Field Electrician 135.00 168.75
Field Technician 125.00 156.25
Designer/Draftsperson 110.00 137.50
Shop Labor 80.00 N/A

* FIELD SERVICES
Field Services are supplied to customers not covered by an established Contract Service Agreement or services as requested by a customer for a specific day, time or reason, outside the scheduled service provided under a Contract Service Agreement. Field Service also includes a the Portal to Portal travel time cost.

Standard Work Hour rates are Monday – Saturday 7am to 5pm - after these hours the emergency hour rate would apply. Hours for Sunday and Holidays are at the emergency rates iindicated.

SHOP FABRICATION SERVICES
Shop fabrication services are available at a shop rate of $80.00 per hour. Materials will be invoiced at cost plus 25%. Normal shop expenses are included within the above rates; however, additional expenses such

City of Fullerton – RFP- SCADA Master Plan, Integrator and Support Services 4 as freight, travel, etc., will be billed at cost. Shop/field calibration, acceptance testing, start -up, etc., are considered field services and will be charged at the appropriate field service rates.

SYSTEMS INTEGRATED’S PERSONNEL RATES
Normal labor charges will be at the hourly rates shown in the above tables for each labor classification.

Time in excess of 8 hours per day or 40 hours per week is termed overtime. When client authorized, overtime rates are 1.25 times normal rates. Rates are in USD. Rates are not valid for prevailing wage work. Quoted rates are subject to reasonable adjustment after December 31, 2020.

SUBCONTRACTED WORK
When it is necessary to supplement our staff with consultants or outside subcontractors, these services are billed at our cost plus 15%.

EXPENSES – Orange County, CA
These reimbursable costs include, but are not limited to:
 Travel (air fare, auto rental, public transportation and subsistence) o Rental Car - $65/day
o Hotel Room - $200/day
o Meals - $76/day
 Use of company vehicles ($90/day) and employee cars ($0.65/mile)  Equipment rental or purchase - TBD
 Long distance and cellular telephone, fax, postage, courier and reproduction work - TBD  Applicable sales taxes and freight charges – TBD
 Additional expenses are charged at cost plus 15%.

Please note for local service (within 50 miles) under any Contract Service Agreement, there are no travel, meals or hotel room expenses associated with ant service request.

MATERIALS
Material is charged at list price plus 15%. Applicable sales, excise taxes, fees and freight charges are added as applicable.

DOCUMENTATION
All agreed upon documentation including manuals, drawings and reproductions, will be furnished to the customer during or at the close of the job. We reserve the right to retain either originals or reproductions of all our work for our files.

SCADA Support Contact Information:

To contact Systems Integrated for support services we maintain an 800 telephone number that our customers may use 7 x 24 to contact us – 800/738-0906.

And our customers may always contact the Director of Engineering, Larry Pomatto, directly at 714/323- 1871 or [email protected] with any service issues or requests.

EXHIBIT D

CERTIFICATES OF INSURANCE

SHOULD ANY OF THE ABOVE DESCRIBED POLICIES BE CANCELLED BEFORE

THE EXPIRATION DATE THEREOF, NOTICE WILL BE DELIVERED IN ACCORDANCE WITH THE POLICY PROVISIONS.

INSURER(S) AFFORDING COVERAGE
INSURER F :

INSURER E :

INSURER D :

INSURER C :

INSURER B :

INSURER A :

NAIC #
NAME:

CONTACT
(A/C, No):

FAX
E-MAIL
ADDRESS:

PRODUCER
(A/C, No, Ext):

PHONE

INSURED
REVISION NUMBER:CERTIFICATE NUMBER:COVERAGES
IMPORTANT: If the certificate holder is an ADDITIONAL INSURED, the policy(ies) must have ADDITIONAL INSURED provisions or be endorsed.

If SUBROGATION IS WAIVED, subject to the terms and conditions of the policy, certain policies may require an endorsement. A statement on this certificate does not confer rights to the certificate holder in lieu of such endorsement(s).

THIS CERTIFICATE IS ISSUED AS A MATTER OF INFORMATION ONLY AND CONFERS NO RIGHTS UPON THE CERTIFICATE HOLDER. THIS

CERTIFICATE DOES NOT AFFIRMATIVELY OR NEGATIVELY AMEND, EXTEND OR ALTER THE COVERAGE AFFORDED BY THE POLICIES BELOW. THIS CERTIFICATE OF INSURANCE DOES NOT CONSTITUTE A CONTRACT BETWEEN THE ISSUING INSURER(S), AUTHORIZED REPRESENTATIVE OR PRODUCER, AND THE CERTIFICATE HOLDER.

OTHER:
(Per accident)
(Ea accident)
$
$
N / A
SUBR
WVD
ADDL
INSD

THIS IS TO CERTIFY THAT THE POLICIES OF INSURANCE LISTED BELOW HAVE BEEN ISSUED TO THE INSURED NAMED ABOVE FOR THE POLICY PERIOD INDICATED. NOTWITHSTANDING ANY REQUIREMENT, TERM OR CONDITION OF ANY CONTRACT OR OTHER DOCUMENT WITH RESPECT TO WHICH THIS

CERTIFICATE MAY BE ISSUED OR MAY PERTAIN, THE INSURANCE AFFORDED BY THE POLICIES DESCRIBED HEREIN IS SUBJECT TO ALL THE TERMS, EXCLUSIONS AND CONDITIONS OF SUCH POLICIES. LIMITS SHOWN MAY HAVE BEEN REDUCED BY PAID CLAIMS. $ $
$
$PROPERTY DAMAGE
BODILY INJURY (Per accident)
BODILY INJURY (Per person)

COMBINED SINGLE LIMIT

AUTOS ONLY

AUTOSAUTOS ONLY

NON-OWNED

SCHEDULEDOWNED

ANY AUTO

AUTOMOBILE LIABILITY
Y / N

WORKERS COMPENSATION

AND EMPLOYERS' LIABILITY
OFFICER/MEMBER EXCLUDED?
(Mandatory in NH)
DESCRIPTION OF OPERATIONS below
If yes, describe under

ANY PROPRIETOR/PARTNER/EXECUTIVE
$
$
$
E.L. DISEASE - POLICY LIMIT
E.L. DISEASE - EA EMPLOYEE
E.L. EACH ACCIDENT
ER
OTH-

STATUTE
PER

LIMITS(MM/DD/YYYY)

POLICY EXP
(MM/DD/YYYY)

POLICY EFF

POLICY NUMBERTYPE OF INSURANCELTR
INSR
DESCRIPTION OF OPERATIONS / LOCATIONS / VEHICLES (ACORD 101, Additional Remarks Schedule, may be attached if more space is required)

EXCESS LIAB
UMBRELLA LIAB $EACH OCCURRENCE
$AGGREGATE
$
OCCUR

CLAIMS-MADE
DED RETENTION $
$PRODUCTS - COMP/OP AGG
$GENERAL AGGREGATE
$PERSONAL & ADV INJURY
$MED EXP (Any one person)
$EACH OCCURRENCE

DAMAGE TO RENTED
$PREMISES (Ea occurrence)

COMMERCIAL GENERAL LIABILITY

CLAIMS-MADE OCCUR
GEN'L AGGREGATE LIMIT APPLIES PER:

POLICY PRO-

JECT LOC

CERTIFICATE OF LIABILITY INSURANCE

DATE (MM/DD/YYYY)

CANCELLATION

AUTHORIZED REPRESENTATIVE
ACORD 25 (2016/03)
© 1988-2015 ACORD CORPORATION. All rights reserved.

CERTIFICATE HOLDER
The ACORD name and logo are registered marks of ACORD
HIRED

AUTOS ONLY
11/18/2020
Infinity Assurance Group
PO Box 3646
Mission Viejo CA 92690
Leslie Henry
949-387-2323
949-387-2324
[email protected]
Valley Forge Insurance Company
20508
SYSTINT-01
Continental Insurance Company
35289
Systems Integrated, LP
2200 N. Glassell Street
Orange, CA 92865
Beazley Insurance Company, Inc
37540
765145432
A
X
1,000,000
X
500,000
15,000
1,000,000
2,000,000
X
Y
6081776491
9/15/2020
9/15/2021
2,000,000
B
1,000,000
X
X
X
6081776488
9/15/2020
9/15/2021
B
X
X
1,000,000
6081776507
9/15/2020
9/15/2021
1,000,000
B
B
X
Y
6081803169
6081803155
9/15/2020
9/15/2020
9/15/2021
9/15/2021
1,000,000
1,000,000
1,000,000
C
Media, Tech, Data
& Network Liability
V10D9B201101
9/15/2020
9/15/2021
Limit - Each Claim
Aggregate
Retention Each Claim
$2,000,000
$2,000,000
$50,000
The City of Fullerton, its elected or appointed officials, officers, employees and volunteers are Additional Insured per the attached endorsement CNA75079XX(10-16) including primary & non-contributory insurance. Workers Compensation Waiver of Subrogation applies per attached endorsement G19160B(11/97). 30 Day Notice of Cancellation will apply by endorsement to follow from each of the insurance companies.

City of Fullerton
Attn: Dustin Ensminger
1580 W. Commonwealth Avenue
Fullerton CA 92833

CNA PARAMOUNT
Blanket Additional Insured - Owners, Lessees or
Contractors - with Products-Completed
Operations Coverage Endorsement
This endorsement modifies insurance provided under the following:

COMMERCIAL GENERAL LIABILITY COVERAGE PART
It is understood and agreed as follows:

I. WHO IS AN INSURED is amended to include as an Insured any person or organization whom you are required by written contract to add as an additional insured on this coverage part, but only with respect to liability for bodily injury, property damage or personal and advertising injury caused in whole or in part by your acts or omissions, or the acts or omissions of those acting on your behalf:

A. in the performance of your ongoing operations subject to such written contract; or B. in the performance of your work subject to such written contract, but only with respect to bodily injury or property damage included in the products-completed operations hazard, and only if:

1. the written contract requires you to provide the additional insured such coverage; and

2. this coverage part provides such coverage.

II. But if the written contract requires:

A. additional insured coverage under the 11-85 edition, 10-93 edition, or 10-01 edition of CG2010, or under the 10- 01 edition of CG2037; or
B. additional insured coverage with "arising out of" language; or C. additional insured coverage to the greatest extent permissible by law; then paragraph I. above is deleted in its entirety and replaced by the following:

WHO IS AN INSURED is amended to include as an Insured any person or organization whom you are required by written contract to add as an additional insured on this coverage part, but only with respect to liability for bodily injury, property damage or personal and advertising injury arising out of your work that is subject to such written contract.

III. Subject always to the terms and conditions of this policy, including the limits of insurance, the Insurer will not provide such additional insured with:

A. coverage broader than required by the written contract; or B. a higher limit of insurance than required by the written contract.

IV. The insurance granted by this endorsement to the additional insured does not apply to bodily injury, property damage, or personal and advertising injury arising out of:

A. the rendering of, or the failure to render, any professional architectural, engineering, or surveying services, including:

1. the preparing, approving, or failing to prepare or approve maps, shop drawings, opinions, reports, surveys, field orders, change orders or drawings and specifications;and

2. supervisory, inspection, architectural or engineering activities;or B. any premises or work for which the additional insured is specifically listedas an additional insured on another endorsement attached to this coverage part.

V. Under COMMERCIAL GENERAL LIABILITY CONDITIONS, the Condition entitled Other Insurance is amended to add the following,which supersedes any provision to the contrary in this Condition or elsewhere in this coverage part:
6081776491CNA75079XX (10-16) Policy No:
7Page 1o f2 Endorsement No:

VALLEY FORGE INSURANCE COMPANY 09/15/2020 Effective Date:

SYSTEMS INTEGRATED INCInsured Name:

Copyright CNA All Rights Reserved. Includes copyrighted material of Insurance Services Office, Inc., with its permission. 20020009160817764911160

CNA PARAMOUNT
Blanket Additional Insured - Owners, Lessees or
Contractors - with Products-Completed
Operations Coverage Endorsement
Primary and Noncontributory Insurance
With respect to other insurance available to the additional insured under which the additional insured is a named insured, this insurance is primary to and will not seek contribution from such other insurance, provided that a written contract requires the insurance provided by this policy to be:

1. primary and non-contributing with other insurance available to the additional insured; or

2. primary and to not seek contribution from any other insurance available to the additional insured.

But except as specified above, this insurance will be excess of all other insurance available to the additional insured.

VI. Solely with respect to the insurance granted by this endorsement, the section entitled COMMERCIAL GENERAL LIABILITY CONDITIONS is amended as follows:

The Condition entitled Duties In The Event of Occurrence, Offense, Claim or Suit is amended with the addition of the following:

Any additional insured pursuant to this endorsement will as soon as practicable:

1. give the Insurer written notice of any claim, or any occurrence or offense which may result in a claim;

2. send the Insurer copies of all legal papers received, and otherwise cooperate with the Insurer in the investigation, defense, or settlement of the claim; and

3. make available any other insurance, and tender the defense and indemnity of any claim to any other insurer or self-insurer, whose policy or program applies to a loss that the Insurer covers under this coverage part. However, if the written contract requires this insurance to be primary and non-contributory, this paragraph 3. does not apply to insurance on which the additional insured is a named insured.

The Insurer has no duty to defend or indemnify an additional insured under this endorsement until the Insurer receives written notice of a claim from the additional insured.

VII. Solely with respect to the insurance granted by this endorsement, the section entitled DEFINITIONS is amended to add the following definition:

Written contract means a written contract or written agreement that requires you to make a person or organization an additional insured on this coverage part, provided the contract or agreement:

A. is currently in effect or becomes effective during the term of this policy; and B. was executed prior to:

1. the bodily injury or property damage; or

2. the offense that caused the personal and advertising injury; for which the additional insured seeks coverage.

Any coverage granted by this endorsement shall apply solely to the extent permissible by law.

All other terms and conditions of the Policy remain unchanged.

This endorsement, which forms a part of and is for attachment to the Policy issued by the designated Insurers, takes effect on the effective date of said Policy at the hour stated in said Policy, unless another effective date is shown below, and expires concurrently with said Policy.
6081776491CNA75079XX (10-16) Policy No:
7Page 2o f2 Endorsement No:

VALLEY FORGE INSURANCE COMPANY 09/15/2020 Effective Date:

SYSTEMS INTEGRATED INCInsured Name:

Copyright CNA All Rights Reserved. Includes copyrighted material of Insurance Services Office, Inc., with its permission.

Workers Compensation And Employers Liability Insurance
Policy Endorsement

BLANKET WAIVER OF OUR RIGHT TO RECOVER FROM OTHERS
This endorsement changes the policy to which it is attached.

It is agreed that Part One - Workers’ Compensation Insurance G. Recovery From Others and Part Two - Employers’ Liability Insurance H. Recovery From Others are amended by adding the following:

We will not enforce our right to recover against persons or organizations. (This agreement applies only to the extent that you perform work under a written contract that requires you to obtain this agreement from us.) PREMIUM CHARGE - Refer to the Schedule of Operations
The charge will be an amount to which you and we agree that is a percentage of the total standard premium for California exposure. The amount is 2%.

All other terms and conditions of the policy remain unchanged.

This endorsement, which forms a part of and is for attachment to the policy issued by the designated Insurers, takes effect on the Policy Effective Date of said policy at the hour stated in said policy, unless another effective date (the Endorsement Effective Date) is shown below, and expires concurrently with said policy unless another expiration date is shown below.

WC 6 81803169
Endorsement No: 2; Page: 1 of 1 Policy Page: 13 of 15
Underwriting Company: The Continental Insurance Company, 151 N Franklin St, Chicago, IL 60606 Form No: G-19160-B (11-1997)
Endorsement Effective Date:

Policy No:

Policy Effective Date: 09/15/2020Endorsement Expiration Date:
© Copyright CNA All Rights Reserved.

EXHIBIT E

W-9