The University of Iowa enterprise datacenters house computer systems that run production services critical to students, faculty, and staff. Enterprise datacenters also provide robust, state-of-the-art server colocation space and associated support services for campus departments and researchers.
General Support Information
Current Status
Maintenance
Past 90 Days
Alert History
There will be three separate ITS NES datacenter network refresh project changes taking place on the September Infrastructure Day. The first involves the Lindquist datacenter, and the second two will take place at the Information Technology Facility (ITF).
1. Routing will be changed for global-scope and local-scope networks used by ITS Enterprise Infrastructure (EI) managed or hosted servers in the LC datacenter. This work affects both general and secure server networks. All other LC networks (customer-managed, storage, or non-EI tenants) are not in scope. For each network change, all servers/services on that network will be inaccessible for up to 5 minutes. Only one network will be changed at a time. If you are unsure if your servers or services are impacted, please contact your ITS EI primary sysadmin/team.
2. The ITF datacenter firewall uplinks will be moved. This will occur on the non-active hardware first and thus should not incur any downtime due to the redundant nature of the datacenter firewalls.
3. The ITF F5 uplinks will be moved to the new datacenter network fabric. This will occur on the non-active hardware first and should not incur any downtime due to the redundant nature of the F5.
The migration work is complete.
The first large batch of systems being migrated belong to the CCoM. This work is in progress, another update will be posted by 3:30pm.
Staff are continuing to work the issue, including cabling and port configuration of the data center fabric. We'll provide another update no later than 3:00pm.
ITF end-of-row Switch Failure. EI-NES has been alerted to an end-of-row switch failure in the ITF data center affecting the CF row. This is a research row. Potentially impacted customers include:
-Psychiatry
-CCOM
-CLAS
-ITS-RS
The fix will be migrating network uplinks from the failed switch to the new data center fabric switches. An update will be provided shortly.
This issue is resolved.
Due to a hardware failure on a network switch in our primary data center, some services are currently experiencing a service outage. Known affected services include:
FProd Financials
ITS Network Engineers are on site working to deploy replacement hardware. ETA to completion is approximately 11:45PM
As part of the ITS NES data center network refresh project, we’ll be changing the network routing path, via a default gateway change, on all F5 load balancer networks in the ITF and LC data centers. This will affect over 80 services load balanced by the F5 (and the many other downstream services that rely on those services) that are fronted by IP addresses in the eight subnets slated for migration, causing intermittent communication loss.
Testing by ITS staff will be completed and customer application testing should begin as soon as possible after the change is verified.
As part of the ITS NES datacenter network refresh project, routing will be changed for the network used by ITS-managed storage in the ITF datacenter.
This includes network shares for Files@Iowa services (Home Drives, Shared Drive aka L: or U: drives, UDSS, ADSS) and Research Data Storage Service (RDSS). (Research Services' Large Scale Storage, LSS, is not impacted.)
The network change will result in the affected shares being inaccessible for up to 5 minutes.
As part of the ITS NES datacenter network refresh project, routing will be changed for global-scope and local-scope networks used by ITS Enterprise Infrastructure EI-managed or hosted servers in the ITF datacenter. This work affects general server networks.
All other ITF networks (secure, co-managed, customer-managed, storage, or non-EI tenants) are not in scope. For each network change, all servers/services on that network will be inaccessible for up to 5 minutes.
Up to date and scope of change details can be found in the entry for Infrastructure Day found on the RES-IT-Changes calendar. If you are unsure if your servers or services are impacted, please contact your ITS EI primary sysadmin/team.
As part of the ITS NES datacenter network refresh project, routing will be changed for global-scope and local-scope networks used by ITS Enterprise Infrastructure EI-managed or hosted servers in the ITF datacenter. This work affects general server networks.
All other ITF networks (secure, co-managed, customer-managed, storage, or non-EI tenants) are not in scope. For each network change, all servers/services on that network will be inaccessible for up to 5 minutes. Only one network will be changed at a time.
Up to date and scope of change details can be found in the entry for Infrastructure Day found on the RES-IT-Changes calendar. If you are unsure if your servers or services are impacted, please contact your ITS EI primary sysadmin/team.
NetApp clusters at ITF and LC datacenters will be upgraded. Each volume will experience two brief (10-30 seconds) pauses in IO.
NetApp clusters at ITF and LC datacenters will be upgraded. Each volume will experience two brief (10-30 seconds) pauses in IO.
The F5 LTMs will be updated to the newest long-term software release to ensure continued support beyond December 2023. No impact to services is expected.
NetApp clusters at ITF and LC datacenters will have maintenance performed on the cluster nodes. Each volume will experience two brief (10-30 seconds) pauses in input/output.
Clusters affected:
- ITFNA1
- ITFNA3
- LCNA1
ITS-TPS will be applying an urgent NetApp update to the UDSS, CLAS, ADSS, HOME, and VM services. NetApp clusters at ITF datacenters will be upgraded. Each volume will experience two brief (10-30 seconds) pauses in IO.
ITS-TPS will be applying an urgent NetApp update to the RDSS service. NetApp clusters at ITF datacenters will be upgraded. Each volume will experience two brief (10-30 seconds) pauses in IO.
NetApp clusters at ITF and LC datacenters will be upgraded. Each volume will experience two brief (10-30 seconds) pauses in IO. The F5 GTNs (DNS) will be updated to the newest long-term software release. No impact to services is expected.
The F5 hardware chassis will be updated to the newest long-term software release to ensure continued support beyond December 2023.
This issue has been resolved.
A network device at ITF is unavailable and impacting several systems. NES engineers are heading to ITF to investigate. CAS,SAS, and TPS teams have been notified.
More details on affected systems will be forthcoming.
ITS will be patching Brocade SAN fabric switches from Fabric OS 9.0.1e to Fabric OS v9.1.1.
We will test the install on the San Fabric B and evaluate the change. If the change is successful we will proceed with SAN A and SAN C.
This is intended to be a non-interruptive change. This process is repeated until all switches are patched.
The F5 Global Traffic Managers (GTM) will be updated to the latest software release on our current branch for the ITF & LC data centers.
The F5 Global Traffic Managers (GTM) will be updated to the latest software release on our current branch for the ITF & LC data centers.
During this time the NetApp clusters will be updated in the Lindquist and ITF data centers. Each volume will experience two brief (10-30 second) pauses in sending and receiving data.
EI-TPS will be applying an urgent priority disk firmware upgrade to a subset of disks in the Unity SAN in ITF. This process runs as an automated background task and should not have any impact on the data or services that use the SAN. However, due to the recent issues with the SAN outage in early July, we are proactively notifying for this instance of this work.
If there are any concerns or questions during the maintenance window, please contact the ITS Help Desk for escalation to the EI-TPS on-call staff.
EI-TPS will be applying an urgent priority disk firmware upgrade to a subset of disks in the Unity SAN in ITF. This process runs as an automated background task and should not have any impact on the data or services that use the SAN. However, due to the recent issues with the SAN outage in early July, we are proactively notifying for this instance of this work.
If there are any concerns or questions during the maintenance window, please contact the ITS Help Desk for escalation to the EI-TPS on-call staff.
During this time the NetApp clusters will be updated in the Lindquist and ITF data centers. Each volume will experience two brief (10-30 second) pauses in I/O.
The ITS Network Engineering Services (NES) team will be adjusting default routing in production data center routers, and once adjustments are completed Technology Platform Services (TPS) will be updating the F5 chassis in the same locations.
The maintenance will take place in sequence at Lindquist Center (LC14), followed by the Information Technology Facility (ITF) location.
No impact to services is expected while maintenance is completed.
The F5 chassis will be updated in both data centers. No impact on services is expected.
A firmware update is scheduled for the Dell EMC SAN storage arrays in this location. No interruption of services is expected.
A firmware update is scheduled for the Dell EMC SAN storage arrays in this location. No interruption of services is expected.
During this time the NetApp clusters will be updated in the Lindquist (LC) data center. Each volume will experience two brief (10-30 second) pauses in I/O.
During this time the NetApp clusters will be updated in the Lindquist and ITF data centers. Each volume will experience two brief (10-30 second) pauses in I/O.
A firmware update will be applied to the Dell EMC SAN storage array in ITF. No impact to services expected.
A firmware update will be applied to the Dell EMC SAN storage array in LC. No impact to services expected.
During this time the F5 chassis will be updated in the Lindquist and ITF data centers. No impact on services is expected.
Nature of the work – Upgrade the F5 ITF LTM system software to stay current with releases, improve reliability, address security issues, and provide new features.
Which data center(s) –ITF
Expected impact on services – None
Expected duration – 3 hours
The ITF F5 LTM systems are a redundant pair. The F5 LTMs in ITF will be upgraded as follows:
- Upgrade standby LTM;
- Shift services from the primary LTM to the standby LTM;
- Allow service and application owners ONE HOUR (*) to test their applications against the new LTM software;
- Upgrade primary LTM;
- Shift services from the standby LTM back to the primary LTM.
(*) In between the upgrade of the standby and primary LTMs, services will be shifted to the upgraded LTM. At that time, system and application owners will be given a ONE HOUR time block to test their applications and services against the new LTM software. If no major issues are discovered, the second LTM will be upgraded and the process will be complete. Estimated start time for this one hour block is around 05:30am, but encourage customers to be on the conference bridge ahead of time to take full advantage of the one hour block.
Nature of the work – Upgrade the F5 GTM and LC LTM system software to stay current with releases, improve reliability, address security issues, and provide new features.
Which data center(s) – LC & ITF
Expected impact on services – None
The F5 GTM/DNS systems provide the same DNS information. The ITF F5 GTM/DNS system will be upgraded first followed by the LC F5 GTM/DNS system. The LC F5 LTM systems are a redundant pair in each data center. The F5 LTMs in LC will be upgraded as follows:
- Upgrade standby LTM
- Shift services from the primary LTM to the standby LTM
- Allow service and application owners ONE HOUR (*) to test their applications against the new LTM software
- Upgrade primary LTM
- Shift services from the standby LTM back to the primary LTM
(*) In between the upgrade of the standby and primary LTMs, services will be shifted to the upgraded LTM. At that time, system and application owners will be given a ONE HOUR time block to test their applications and services against the new LTM software. If no major issues are discovered, the second LTM will be upgraded and the process will be complete. Estimated start time for this one hour block is around 05:30am, but encourage customers to be on the conference bridge ahead of time to take full advantage of the one hour block.
A firmware update will be applied to the Brocade Fiber optic SAN fabric B switches. There will be no expected impact to services.
A firmware update will be applied to the Brocade Fiber optic SAN fabric B switches. There will be no expected impact to services.
Nature of the work – F5 software upgrade test on standby Local Traffic Manager (LTM)
Which data center(s) – LC
Expected impact on services – None
Expected duration – 2 hours
Scheduled Work: F5 chassis maintenance
Data Center(s): Lindquist Center (LC) and Information Technology Facility (ITF)
Expected Impact on Services: None
Expected Duration: 4 hours
Nature of the work – Upgrade the F5 GTM/DNS systems system software to stay current with releases, improve reliability, address security issues, and provide new features.
Work process - The F5 GTM/DNS systems provide the same DNS information. The ITF F5 GTM/DNS system will be upgraded first followed by the LC F5 GTM/DNS system. No service impact is expected.
Nature of the work – Upgrade the F5 LTM system software to stay current with releases, improve reliability, address security issues, and provide new features.
Work process - The F5 LTM systems are a redundant pair in each data center. Each F5 LTM pair will be upgraded as follows: (1) Upgrade standby LTM; (2) shift services from the primary LTM to the standby LTM; (3) upgrade primary LTM; (4) shift services from the standby LTM back to the primary LTM.
Nature of the work – Upgrade the F5 LTM system software to stay current with releases, improve reliability, address security issues, and provide new features.
Work process - The F5 LTM systems are a redundant pair in each data center. Each F5 LTM pair will be upgraded as follows: (1) Upgrade standby LTM; (2) shift services from the primary LTM to the standby LTM; (3) upgrade primary LTM; (4) shift services from the standby LTM back to the primary LTM.
Nature of the work – Upgrade the F5 ITF LTM system software to stay current with releases, improve reliability, address security issues, and provide new features.
Work process - The F5 LTM systems are a redundant pair in each data center. Each F5 LTM pair will be upgraded as follows: (1) Upgrade standby LTM; (2) shift services from the primary LTM to the standby LTM; (3) upgrade primary LTM; (4) shift services from the standby LTM back to the primary LTM.
Nature of the work – Upgrade the F5 LC LTM system software to stay current with releases, improve reliability, address security issues, and provide new features.
Work process - The F5 LTM systems are a redundant pair in each data center. Each F5 LTM pair will be upgraded as follows: (1) Upgrade standby LTM; (2) shift services from the primary LTM to the standby LTM; (3) upgrade primary LTM; (4) shift services from the standby LTM back to the primary LTM.
Scheduled Work: Software upgrade for production and research routers
Data Center(s): Information Technology Facility (ITF)
Expected Impact on Services: The work should not cause any user-visible disruption
Expected Duration: 4 hours total (4 AM - 8 AM)
Scheduled Work: Upgrade NetApp clusters
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected impact on services: Each volume will experience two brief (10-30 seconds) pauses in IO
Expected Duration: 3 hours total (6 AM - 9 AM)
Services affected include:
Home (H:) Drives: .pst files located on these drives are particularly sensitive to drops in connectivity. Instruct users to close all applications (Outlook, Word, Excel) to their Home or H: Drive on Friday before leaving work.
Shared Departmental Drives: L:, I:, and U: SFTP jobs and instruments connected to these locations are sensitive to drops in connectivity. Modify as necessary.
RDSS: Research Data Storage Service is included in this upgrade.
Nature of the work – Upgrade the F5 GTM/DNS systems system software to stay current with releases, improve reliability, address security issues, and provide new features.
Work process - The F5 GTM/DNS systems provide the same DNS information. The ITF F5 GTM/DNS system will be upgraded first followed by the LC F5 GTM/DNS system. No service impact is expected.
Scheduled Work: The ITS Network Services team is rolling out a priority software code upgrade to the data center routers and production switches
Data Center(s): Lindquist Center (LC)
Expected Impact on Services: The upgrade has been tested successfully in the lab via in-service software upgrade (ISSU), which is non-disruptive. There is one switch upgrade that will cause a disruption. For that specific upgrade case, communication to affected hosting partners is being handled through a separate channel.
Expected Duration: 3 hours
Scheduled Work: F5 chassis hardware refresh migration
Data Center(s): Information Technology Facility (ITF)
Expected Impact on Services: None
Expected Duration: 3 hours
Time: Midnight - 3:00 AM
Scheduled Work: The ITS Network Services team is rolling out a priority software code upgrade to the data center routers and production switches
Data Center(s): Information Technology Facility (ITF)
Expected Impact on Services: The upgrade has been tested successfully in the lab via in-service software upgrade (ISSU), which is non-disruptive. There is one switch upgrade that will cause a disruption. For that specific upgrade case, communication to affected hosting partners is being handled through a separate channel.
Expected Duration: 4 hours
Time: 04:00 AM - 08:00 AM
A firmware update will be applied to the Dell EMC SAN storage array in Information Technology Facility (ITF).
There are no expected impacts to services.
A firmware update will be applied to the Dell EMC SAN storage array in Lindquist Center (LC).
There are no expected impacts to services.
Scheduled Work: F5 chassis hardware refresh migration
Data Center(s): Lindquist Center (LC)
Expected Impact on Services: None
Expected Duration: 4 hours
Time: 04:00 AM - 08:00 AM
Scheduled Work: Upgrade NetApp clusters
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected impact on services: Each volume will experience two brief (10-30 seconds) pauses in IO
Expected Duration: 2 hours total (6 AM - 8 AM)
Services affected include:
Home (H:) Drives: .pst files located on these drives are particularly sensitive to drops in connectivity. Instruct users to close all applications (Outlook, Word, Excel) to their Home or H: Drive on Friday before leaving work.
Shared Departmental Drives: L:, I:, and U: SFTP jobs and instruments connected to these locations are sensitive to drops in connectivity. Modify as necessary.
RDSS: Research Data Storage Service is included in this upgrade.
A firmware update will be applied to the Dell EMC SAN storage array in ITF. This update will cause no impact to services.
A firmware update will be applied to the Dell EMC SAN storage array in LC. This update will cause no impact to services.
Scheduled Work: F5 chassis maintenance
Data Center(s): Lindquist Center (LC) and Information Technology Facility (ITF)
Expected Impact on Services: None
Expected Duration: 4 hours
Time: 04:00 AM - 08:00 AM
Scheduled Work: Replace a failing fabric card in rtr-lc-1 (the LC data center router)
Data Centers: Lindquist Center (LC)
Expected Impact on Services: None expected but using scheduled window as a precaution
Expected Duration: 30 minutes
Time: 06:30 AM - 07:00 AM
Scheduled work: An end of row switch has experienced failed ports. The switch will be rebooted and if necessary replaced with a spare. The switch in question is located at the south end of row BA. Impacted cabinets and device owners will be communicated with in a separate, more focused communication.
Data center(s): Information Technology Facility (ITF)
Expected Duration: 90 minutes total (4:30 AM - 6:00 AM)
Scheduled work: Move research network links at ITF from over-subscribed cards to line-rate cards:
- link to each of 2 research firewalls
- 1 link in LC<>ITF 2x10G agg link
Data center(s): Information Technology Facility (ITF)
Expected impact on services: No impact is expected because the firewalls should fail-over seamlessly and the LC<>ITF agg link should remain up at 1x10g
Expected Duration: 1 hour total (6 AM - 7 AM)
The NetApp root volume at ITF will be migrated during this time. The controller is a pair of active-active nodes so disk and network services are moved to the partner node during the migration. This node primarily provides storage for VMware and Hyper-V hypervisors. Home drives and departmental drives will not be affected and no disruption of service is expected.
Scheduled Work: Upgrade NetApp clusters
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected impact on services: Each volume will experience two brief (10-30 seconds) pauses in IO
Expected Duration: 2 hours total (6 AM - 8 AM)
Services affected include:
Home (H:) Drives: .pst files located on these drives are particularly sensitive to drops in connectivity. Instruct users to close all applications (Outlook, Word, Excel) to their Home or H: Drive on Friday before leaving work.
Shared Departmental Drives: L:, I:, and U: SFTP jobs and instruments connected to these locations are sensitive to drops in connectivity. Modify as necessary.
RDSS: Research Data Storage Service is included in this upgrade.
Scheduled Work: Upgrade NetApp clusters
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected impact on services: Each volume will experience two brief (10-30 seconds) pauses in IO
Expected Duration: 2 hours total (6 AM - 8 AM)
Services affected include:
Home (H:) Drives: .pst files located on these drives are particularly sensitive to drops in connectivity. Instruct users to close all applications (Outlook, Word, Excel) to their Home or H: Drive on Friday before leaving work.
Shared Departmental Drives: L:, I:, and U: SFTP jobs and instruments connected to these locations are sensitive to drops in connectivity. Modify as necessary.
RDSS: Research Data Storage Service is included in this upgrade.
Scheduled Work: F5 chassis maintenance
Data center(s): Lindquist Center (LC) and Information Technology Facility (ITF)
Expected impact on services: None
Expected Duration: 4 hours (4 AM - 8 AM)
The ITS SST Storage Team will be rebooting a single NetApp controller. This work is on the recommendation of vendor support to resolve some communication issues and stabilize the environment ahead of the scheduled upgrade work this Saturday for Infrastructure Day.
If you have questions, please contact the ITS SST Storage Team at its-storage@iowa.uiowa.edu.
Scheduled work: Upgrade NetApp clusters
Data center(s): Information Technology Facility (ITF)
Expected impact on services: No impact is expected
Scheduled work: Replace NetApp controller
Data center(s): Information Technology Facility (ITF)
Expected impact on services: No impact is expected
The system smtp2-submit will be upgraded. During this time period the other campus mail submission server will be available.
Customers that access the single IP address for this server will experience email submission failures during this time. The suggested configuration is to use the DNS name ns-mx.uiowa.edu as it provides redundancy.
The system smtp1-submit will be upgraded. During this time period the other campus mail submission server will be available.
Customers that access the single IP address for this server will experience email submission failures during this time. The suggested configuration is to use the DNS name ns-mx.uiowa.edu as it provides redundancy.
Replacement equipment has been installed and service restored.
A hardware failure of one of the ITF F5 chassis systems has resulted in loss of redundancy for services that use the ITF LTM load balancer.
Replacement equipment has been ordered and will be installed and configured upon arrival. Until then, LTM services are functional on secondary equipment.
A firmware update will be applied to the Dell EMC SAN storage array in ITF.
A firmware update will be applied to the Dell EMC SAN storage array in LC.
Nature of the work – Upgrade the F5 LTM system software to stay current with releases, improve reliability, address security issues, and provide new features.
Work process - The F5 LTM systems are a redundant pair in each data center. Each F5 LTM pair will be upgraded as follows: (1) Upgrade standby LTM; (2) shift services from the primary LTM to the standby LTM; (3) upgrade primary LTM; (4) shift services from the standby LTM back to the primary LTM.
Nature of the work – Upgrade the F5 LTM system software to stay current with releases, improve reliability, address security issues, and provide new features.
Work process - The F5 LTM systems are a redundant pair in each data center. Each F5 LTM pair will be upgraded as follows: (1) Upgrade standby LTM; (2) shift services from the primary LTM to the standby LTM; (3) upgrade primary LTM; (4) shift services from the standby LTM back to the primary LTM.
The IT Facility F5 GTM/DNS system will be upgraded. The Lindquist Center F5 GTM/DNS system will be upgraded following the ITF upgrade. No service impact is expected.
Scheduled work: Upgrade NetApp clusters
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected impact on services: Each volume will experience two brief (10-30 seconds) pauses in IO
Services affected include:
Home (H:) Drives: .pst files located on these drives are particularly sensitive to drops in connectivity. Instruct users to close all applications (Outlook, Word, Excel) to their Home or H: Drive on Friday before leaving work.
Shared Departmental Drives: L:, I:, and U: SFTP jobs and instruments connected to these locations are sensitive to drops in connectivity. Modify as necessary.
RDSS: Research Data Storage Service is included in this upgrade.
A firmware update will be applied to the Dell EMC SAN storage array in ITF.
There will be no impact to services during the maintenance.
A firmware update will be applied to the Dell EMC SAN storage array in LC.
There will be no impact to services during the maintenance.
Nature of the work – Upgrade the F5 GTM/DNS systems system software to stay current with releases, improve reliability, address security issues, and provide new features.
Work process - The F5 GTM/DNS systems provide the same DNS information. The ITF F5 GTM/DNS system will be upgraded first followed by the LC F5 GTM/DNS system. No service impact is expected.
Scheduled work: Upgrade NetApp clusters
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected impact on services: Each volume will experience two brief (10-30 seconds) pauses in IO
Services affected include:
Home (H:) Drives: .pst files located on these drives are particularly sensitive to drops in connectivity. Instruct users to close all applications (Outlook, Word, Excel) to their Home or H: Drive on Friday before leaving work.
Shared Departmental Drives: L:, I:, and U: SFTP jobs and instruments connected to these locations are sensitive to drops in connectivity. Modify as necessary.
RDSS: Research Data Storage Service is included in this upgrade.
Nature of the work – Upgrade the F5 LTM system software to stay current with releases, improve reliability, address security issues, and provide new features.
Work process - The F5 LTM systems are a redundant pair in ITF. The ITF F5 LTM pair will be upgraded as follows: (1) Upgrade standby LTM; (2) shift services from the primary LTM to the standby LTM; (3) upgrade primary LTM; (4) shift services from the standby LTM back to the primary LTM.
Nature of the work – Upgrade the F5 LTM system software to stay current with releases, improve reliability, address security issues, and provide new features.
Work process - The F5 LTM systems are a redundant pair in LC. The LC F5 LTM pair will be upgraded as follows: (1) Upgrade standby LTM; (2) shift services from the primary LTM to the standby LTM; (3) upgrade primary LTM; (4) shift services from the standby LTM back to the primary LTM.
Scheduled work: Upgrade the F5 chassis system software to stay current with releases, improve reliability, address security issues, and provide new features
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected Duration: 4-hours (4 AM - 8 AM)
Expected impact on services: Non-disruptive upgrade. No impact on services
Scheduled work: Software updates and server reboot if needed for itf-rs-store16 and lc-rs-storage02
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected Duration: 1-hour max (7 AM - 8 AM)
Expected impact on services: Minimal unless the updates demand a reboot. Compliant LSS Pilot service might be unavailable and users should plan accordingly. This affects the pilot systems only, Large Scale Storage (LSS) and HPC attached storage will not be affected.
Scheduled work: A hotfix will be applied to the Dell EMC SAN storage array in the ITF.
Data center(s): Information Technology Facility (ITF)
Expected impact on services: Non-disruptive update; no impact to services.
Scheduled work: A hotfix will be applied to the Dell EMC SAN storage array in LC.
Data center(s): Lindquist Center (LC)
Expected impact on services: Non-disruptive update; no impact to services.
Scheduled work: OS Firmware update on the Dell EMC Unity all-flash SAN storage arrays
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected Duration: 2-hours (6 AM - 8 AM)
Expected impact on services: Non-disruptive upgrade. No impact on services
Scheduled work: Software updates and server reboot if needed for itf-rs-store16 and lc-rs-storage02
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected Duration: 1-hour max (7 AM - 8 AM)
Expected impact on services: Minimal unless the updates demand a reboot. Compliant LSS Pilot service might be unavailable and users should plan accordingly. This affects the pilot systems only, Large Scale Storage (LSS) and HPC attached storage will not be affected.
The Dell EMC SAN storage array located at ITF has a faulty DIMM that needs replaced. One of the redundant storage processors will be shut down while the faulty hardware is replaced. ITS SAN attached servers (including various SQL Server, Oracle, VMware and Hyper-V hosts) will have two of their four paths to SAN disks during this time. There is no expected impact to services.
Contacts: Seth Clarke, Cody Johnson, David Bronder
Scheduled work: Upgrade NetApp clusters
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected Duration: 2 hours (6 AM - 8 AM)
Expected impact on services: Each volume will experience two brief (10-30 seconds) pauses in IO
Services affected include:
Home (H:) Drives: .pst files located on these drives are particularly sensitive to drops in connectivity. Instruct users to close all applications (Outlook, Word, Excel) to their Home or H: Drive on Friday before leaving work.
Shared Departmental Drives: L:, I:, and U: SFTP jobs and instruments connected to these locations are sensitive to drops in connectivity. Modify as necessary.
RDSS: Research Data Storage Service is included in this upgrade.
Scheduled work: Software updates and server reboot if needed for itf-rs-store16 and lc-rs-storage02
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected Duration: 1 hour max (7 AM - 8 AM)
Expected impact on services: Minimal unless the updates demand reboot. Compliant LSS Pilot service might be unavailable and users should plan accordingly. This affects the pilot systems only, Large Scale Storage (LSS) and HPC attached storage will not be affected.
Scheduled work: Upgrade NetApp clusters
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected impact on services: Each volume will experience two brief (10-30 seconds) pauses in IO
Services affected include:
Home (H:) Drives: .pst files located on these drives are particularly sensitive to drops in connectivity. Instruct users to close all applications (Outlook, Word, Excel) to their Home or H: Drive on Friday before leaving work.
Shared Departmental Drives: L:, I:, and U: SFTP jobs and instruments connected to these locations are sensitive to drops in connectivity. Modify as necessary.
RDSS: Research Data Storage Service is included in this upgrade.
ITS will upgrade the F5 LTM system software to stay current with releases, improve reliability, address security issues, and provide new features.
Scheduled work: Upgrade NetApp clusters
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected impact on services: Each volume will experience two brief (10-30 seconds) pauses in IO
Services affected include:
Home (H:) Drives: .pst files located on these drives are particularly sensitive to drops in connectivity. Instruct users to close all applications (Outlook, Word, Excel) to their Home or H: Drive on Friday before leaving work.
Shared Departmental Drives: L:, I:, and U: SFTP jobs and instruments connected to these locations are sensitive to drops in connectivity. Modify as necessary.
RDSS: Research Data Storage Service is included in this upgrade.
Scheduled work: Upgrade NetApp clusters
Data center(s): Information Technology Facility (ITF) and Lindquist Center (LC)
Expected impact on services: Each volume will experience two brief (10-30 seconds) pauses in IO
Services affected include:
Home (H:) Drives: .pst files located on these drives are particularly sensitive to drops in connectivity. Instruct users to close all applications (Outlook, Word, Excel) to their Home or H: Drive on Friday before leaving work.
Shared Departmental Drives: L:, I:, and U: SFTP jobs and instruments connected to these locations are sensitive to drops in connectivity. Modify as necessary.
RDSS: Research Data Storage Service is included in this upgrade.
Data center: Information Technology Facility (ITF)
Expected impact on services: none
The F5 LTM system software will be upgraded to stay current with releases, improve reliability, address security issues, and provide new features.
The ITF F5 LTM pair will be upgraded as follows:
- Upgrade ITF standby LTM;
- Shift services from the ITF primary LTM to the standby LTM;
- Upgrade ITF primary LTM;
- Shift services from the ITF standby LTM back to the primary LTM.
ITS will be upgrading firmware on the Cisco UCS blade server infrastructure in the ITF datacenter. These upgrades will address bugs and security issues, provide new features and allow easier updates in the future.
These environments host ITS-managed VMware and some Hyper-V services in ITF. The infrastructure components have redundant units and connections. No service impact is expected.
ITS will be upgrading firmware on the Cisco UCS blade server infrastructure in the Lindquist Center datacenter. These upgrades will address bugs and security issues, provide new features and allow easier updates in the future.
These environments host ITS-managed VMware services in LC. The infrastructure components have redundant units and connections. No service impact is expected.
Data center: Lindquist Center
Expected impact on services: none
The F5 LTM system software will be upgraded to stay current with releases, improve reliability, address security issues, and provide new features.
The LC F5 LTM pair will be upgraded as follows:
- Upgrade LC standby LTM
- Shift services from the LC primary LTM to the standby LTM
- Upgrade LC primary LTM
- Shift services from the LC standby LTM back to the primary LTM
Firewall Software Upgrade
Scheduled work: Upgrade software on ITF Data Center Firewalls
Data center(s): Information Technology Facility (ITF)
Expected impact on services: none - failover pair will be used for hitless software upgrade
Firewall Update
Scheduled work: Replace Lindquist Center Data Center Firewalls
Data center(s): 14 Lindquist Center (LC)
Expected impact on services: Machines behind the LC firewall will experience an outage as this is a hardware replacement
Upgrading the F5 GTM/DNS system software to stay current with releases, improve reliability, address security issues, and provide new features.
The F5 GTM/DNS systems provide the same DNS information. The ITF F5 GTM/DNS system will be upgraded first followed by the Lindquist Center F5 GTM/DNS system. No service impact is expected.
ITF Network Switch Work
Scheduled work: Apply microcode to an end of row network switch and replace a failed port on another end of row network switch.
Data center(s): Information Technology Facility (ITF)
Expected impact on services: Network connections to these switches will be out of service for between 15 and 60 minutes. Redundantly connected services will remain network connected. Single network connected servers to the impacted switches will lose connectivity. A complete list of servers affected is available on request.
F5 – Upgrade Chassis System Software
Scheduled work: Upgrade the F5 chassis system software to stay current with releases, improve reliability, address security issues, and provide new features.
Data center(s): Information Technology Facility (ITF) & Lindquist Center
Expected impact on services: No more than one GTM/DNS and one LTM system will be unavailable at any time. No service impact is expected.
Data Center Operations & Services Contact Information
Email us at: ITS-EI-Data Center Team