Ticket #1769396

Jeremiah, The API calls from 10.62.99.21 are legit calls. They are for pulling the AOI data off the server into our databases. There is a task that runs every hour on the half hour and another that runs every 5 minutes. I gave the team that handles that a heads up that there may be changes that need made. A large number of the BAE team members are out today. Once they return next week we can start discussing a plan for how to address this situation in further detail. Thank you, Nolan Cassoday Manufacturing Engineer BAE Systems Electronic Systems, Controls & Avionics Solutions T: [phone] | E: [email] 4250 Airport Expressway, Fort Wayne, Indiana 46809 United States From: AOI Tech Support - US Sent: Friday, May 15, 2026 8:44 AM To: Bowers, Samuel L (US) Cc: [email] Streeter, Joshua D (US) ; Miller, Todd D (US) ; [email] [email] [email] Warnecke, Thomas (US) ; [email] Lewis, Matthew R (US) ; Cassoday, Nolan E (US) Subject: Re: v-CA Webpage slow to load and hang in system when entering PCB ID [Case: 1736062] External Email Alert This email has been sent from an account outside of the BAE Systems network. Please treat the email with caution, especially if you are requested to click on a link, decrypt/open an attachment, or enable macros. For further information on how to spot phishing, access “Cybersecurity OneSpace Page” and report phishing by clicking the button “Report Phishing” on the Outlook toolbar. Hi Matt, Sam, Nolan, and team, I wanted to provide a more direct update on where we are with the vCA / vDB outage investigation and what we believe the next practical options are. Based on the latest Tomcat “Complete Server Status” captures and outage logs from May 14 and May 15, we are now seeing a much clearer pattern. The server is not simply “crashing” in the traditional sense. Instead, Tomcat is reaching, or getting very close to reaching, its available request-processing thread limit. When that happens, vCA, vDB, Q-upNavi, and prismRest can appear slow, hung, or unavailable, even though the Windows services may still show as running. This became much clearer once your team started sending the full Tomcat status PDFs before rebooting the server. Earlier in the investigation, we could see the symptoms in the application logs, Oracle logs, and Windows logs, but we did not have a live view of exactly which web requests were consuming Tomcat threads at the time of failure. The full Tomcat status page gives us that view, including the active request URL, client IP, request time, and Tomcat thread state. From the latest outage captures, we saw a large number of active requests to: /prismRest/resources/GetPcbCompInfo Many of these requests appear to be coming from the same client IP address: 10.62.99.21 So one clear next step is still for BAE IT to identify what system or application is tied to that IP address. It may be a reporting tool, script, dashboard, API process, or another automated process. If that client is making many GetPcbCompInfo calls at once, those requests can consume Tomcat threads and directly contribute to the outages. That item should be corrected by stopping, throttling, rescheduling, or modifying whatever process is generating those requests. This may have been part of the issue the whole time, but we could not clearly prove it during the earlier events because we did not yet have the Tomcat full status captures from the actual outage window. Now that we are capturing that information before reboot, the failure pattern is much more visible. That said, we also understand that you are looking for a path to stabilize the environment, not just continue collecting logs. We agree. At this point, we see a few possible improvement paths. The first option is to upgrade the vDB/vCA environment from 3.04C to 3.04F. This is important because the 3.04F upgrade path also moves the web layer from Tomcat 6 to Tomcat 9. Japan has already confirmed that Tomcat 6 can sometimes leave old long-polling threads active if disconnect notifications are not handled cleanly. Tomcat 9 is a newer web container and should provide a more modern and stable foundation for handling the type of web traffic and long-polling behavior used by vCA. This would not excuse or “fix” a runaway API client by itself, but it should make the environment less fragile than the current Tomcat 6 setup. The second option is to review whether this site should move to a line server / master server configuration. BAE-IN appears to have a relatively high number of vCA users and web/API activity for a single-server configuration. Splitting the load across a line/master configuration may help reduce the amount of vCA/web traffic handled by one Tomcat instance. The third option is operational control of API/reporting traffic. If 10.62.99.21 is confirmed to be a reporting/API system, that process should be reviewed regardless of whether we upgrade or add servers. Any API process should avoid sending too many simultaneous component-level requests, especially calls like GetPcbCompInfo, because those can be heavier requests. Throttling, batching, caching, or scheduling those jobs outside production hours may be needed. In short, the strongest current evidence points to Tomcat thread exhaustion. The immediate trigger in the latest outage captures appears to be heavy prismRest traffic from 10.62.99.21, but the longer-term stability improvement is likely either upgrading to the newer 3.04F/Tomcat 9 platform, moving toward a distributed server configuration, or both. Thank you, Jeremiah [This is Jeremiah Soliz's card. Their email is [email] Their phone number is +[phone].] On Fri, 15 May at 4:45 AM , Bowers, Samuel L (US) > wrote: Good morning Jeremiah, Is this currently a high priority item for the Japan team? We understand the delay with the difference in time zones and there’s not much we can do until we hear back. I have to ask to make sure efforts are being maximized while we still have the patience of the plant. Thank You, Sam Bowers SPV II - IT Factory Support Enterprise Shared Services IT, BAE Systems, Inc. T: [phone] | M: [phone] | E: [email] BAE Systems, 4250 Airport Expressway, Fort Wayne, Indiana 46809 www.baesystems.com Connect with BAE Systems: [signatureImage][signatureImage][signatureImage][signatureImage][signatureImage][signatureImage] ________________________________ From: Lewis, Matthew R (US) Sent: Friday, May 15, 2026 4:27 AM To: Cassoday, Nolan E (US) ; AOI Tech Support - US Cc: [email] ; Streeter, Joshua D (US) ; Miller, Todd D (US) ; [email] ; [email] ; [email] ; Warnecke, Thomas (US) ; [email] ; Bowers, Samuel L (US) Subject: RE: v-CA Webpage slow to load and hang in system when entering PCB ID [Case: 1736062] And fresh event logs attached Matthew Lewis Systems Admin Sr – IT Factory Support VCP-DCV, MCSA, Security+ Enterprise Shared Services IT, BAE Systems, Inc. M: [phone] | E: [email] BAE Systems, 4250 Airport Expressway, Fort Wayne, Indiana 46809 www.baesystems.com [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxOTAwNTE2LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.be36BFFpW-CnXI2C_yJMrJ56P1pCk3xCT2bszerN08E][https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxOTAwNTE3LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.i10nMK8n8EGcQTcaIGf3Y7LY9cSyv5u9WBSTrvu-RcQ][https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxOTAwNTE4LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.JU95B3D3LAUI4_O7YQp3xWb5vXVsRpkMxm3GWW2G2_Q] From: Lewis, Matthew R (US) Sent: Friday, May 15, 2026 4:21 AM To: Cassoday, Nolan E (US) ; 'AOI Tech Support - US' Cc: [email] ; Streeter, Joshua D (US) ; Miller, Todd D (US) ; [email] ; [email] ; [email] ; Warnecke, Thomas (US) ; [email] ; Bowers, Samuel L (US) Subject: RE: v-CA Webpage slow to load and hang in system when entering PCB ID [Case: 1736062] Down again shortly after 4 am Restarted at 4:15 Matthew Lewis Systems Admin Sr – IT Factory Support VCP-DCV, MCSA, Security+ Enterprise Shared Services IT, BAE Systems, Inc. M: [phone] | E: [email] BAE Systems, 4250 Airport Expressway, Fort Wayne, Indiana 46809 www.baesystems.com [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxOTAwNTE2LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.be36BFFpW-CnXI2C_yJMrJ56P1pCk3xCT2bszerN08E][https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxOTAwNTE3LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.i10nMK8n8EGcQTcaIGf3Y7LY9cSyv5u9WBSTrvu-RcQ][https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxOTAwNTE4LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.JU95B3D3LAUI4_O7YQp3xWb5vXVsRpkMxm3GWW2G2_Q] From: Lewis, Matthew R (US) Sent: Friday, May 15, 2026 2:17 AM To: Cassoday, Nolan E (US) ; AOI Tech Support - US Cc: [email] Streeter, Joshua D (US) ; Miller, Todd D (US) ; [email] [email] [email] Warnecke, Thomas (US) ; [email] Bowers, Samuel L (US) Subject: RE: v-CA Webpage slow to load and hang in system when entering PCB ID [Case: 1736062] 10.62.99.21 is one of our bastion servers. Our personal computers are one network and the omron server and all production machines are on another. We use the bastion servers to connect from one to the other. We also remote into the Omron server from that server. Omron reported down again at 1:43 am I tried just restarting the tomcat service but the user reported that it did not help. Server restarted at about 2:10 Tomcat status, thread dump, and windows logs attached. I counted about 14 sessions in vdb before restarting Matthew Lewis Systems Admin Sr – IT Factory Support VCP-DCV, MCSA, Security+ Enterprise Shared Services IT, BAE Systems, Inc. M: [phone] | E: [email] BAE Systems, 4250 Airport Expressway, Fort Wayne, Indiana 46809 www.baesystems.com [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxOTAwNTE2LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.be36BFFpW-CnXI2C_yJMrJ56P1pCk3xCT2bszerN08E][https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxOTAwNTE3LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.i10nMK8n8EGcQTcaIGf3Y7LY9cSyv5u9WBSTrvu-RcQ][https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxOTAwNTE4LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.JU95B3D3LAUI4_O7YQp3xWb5vXVsRpkMxm3GWW2G2_Q] From: Cassoday, Nolan E (US) Sent: Thursday, May 14, 2026 9:09 PM To: AOI Tech Support - US Cc: [email] Streeter, Joshua D (US) ; Miller, Todd D (US) ; [email] [email] [email] Warnecke, Thomas (US) ; [email] Lewis, Matthew R (US) ; Bowers, Samuel L (US) Subject: RE: v-CA Webpage slow to load and hang in system when entering PCB ID [Case: 1736062] Jeremiah, Surface level look: it is not one of our review stations. I can look into more tomorrow once Sam, Matt, and I are back in plant tomorrow. Thank you Nolan Cassoday Manufacturing Engineer BAE Systems Electronic Systems, Controls & Avionics Solutions T: [phone] | E: [email] 4250 Airport Expressway, Fort Wayne, Indiana 46809 United States From: AOI Tech Support - US Sent: Thursday, May 14, 2026 9:03 PM To: Cassoday, Nolan E (US) Cc: [email] Streeter, Joshua D (US) ; Miller, Todd D (US) ; [email] [email] [email] Warnecke, Thomas (US) ; [email] Lewis, Matthew R (US) ; Bowers, Samuel L (US) Subject: Re: v-CA Webpage slow to load and hang in system when entering PCB ID [Case: 1736062] External Email Alert This email has been sent from an account outside of the BAE Systems network. Please treat the email with caution, especially if you are requested to click on a link, decrypt/open an attachment, or enable macros. For further information on how to spot phishing, access “Cybersecurity OneSpace Page” and report phishing by clicking the button “Report Phishing” on the Outlook toolbar. Hello Nolan, ​Can you identify the device/server/user at IP address 10.62.99.21? During both May 14 outage captures, this IP was making many requests to: /prismRest/resources/GetPcbCompInfo These requests appear to be consuming a large number of Tomcat threads and may be the immediate cause of the outage. Please let us know? If you can stop this client, the Tomcat 200 thread pool will stop filling up. This is different then the previous Tomcat saturation outages. Let us know? [This is Jeremiah Soliz's card. Their email is [email] Their phone number is +[phone].] On Thu, 14 May at 7:00 PM , Cassoday, Nolan E (US) wrote: Log files have been sent. Thank you, Nolan Cassoday Manufacturing Engineer BAE Systems Electronic Systems, Controls & Avionics Solutions T: [phone] | E: [email] 4250 Airport Expressway, Fort Wayne, Indiana 46809 United States From: Bowers, Samuel L (US) Sent: Thursday, May 14, 2026 7:32 PM To: Cassoday, Nolan E (US) ; AOI Tech Support - US Cc: [email] Streeter, Joshua D (US) ; Miller, Todd D (US) ; [email] [email] [email] Warnecke, Thomas (US) ; [email] Lewis, Matthew R (US) Subject: RE: v-CA Webpage slow to load and hang in system when entering PCB ID [Case: 1736062] Attached is the Tomcat status page at the time of the crash. Nolan will be sending the Tomcat Dump logs when he is online next. Sam Bowers SPV II - IT Factory Support Enterprise Shared Services IT, BAE Systems, Inc. M: [phone] | E: [email] BAE Systems, 4250 Airport Expressway, Fort Wayne, Indiana 46809 www.baesystems.com Connect with BAE Systems: [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxODUzODM4LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.svh1dVtooN5upWJQYuTeqKpLMiXkRbcc8FNQyPSnOwg] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxODUzODM5LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.QkVuQSjtIfFYm8msm92vLfVR-gY9GsG9qdVV_4zCG_I] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxODUzODQwLCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.4nhqq0a3onD_T6pXd3P5jUNULQcBKzm2hke8ijQ32ZA] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxODUzODQxLCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.iXiuj4gzmx4aRYjecNjHjBs_T0MjHXur0ZnrmV3iwqs] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxODUzODQyLCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.PeL5l9SvsmQeEw71pzrtUFNfleI6bGxpcsw2bJ6B8kw] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxODUzODQzLCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.cg-FXqIdGXHZYP_l3MMJrKpD1xbU8CK-_rxzf7_EJn8] From: Cassoday, Nolan E (US) Sent: Thursday, May 14, 2026 5:36 PM To: AOI Tech Support - US ; Bowers, Samuel L (US) Cc: [email] Streeter, Joshua D (US) ; Miller, Todd D (US) ; [email] [email] [email] Warnecke, Thomas (US) ; [email] Lewis, Matthew R (US) Subject: RE: v-CA Webpage slow to load and hang in system when entering PCB ID [Case: 1736062] Jeremiah, I personally have not had the opportunity to read through your response today. I would like the Omron team to be aware thought that we had another outage today this evening. I was told at 4:50pm that we had been down for an hour at that point. We started taking actions to correct at 5:12pm. v-CA logs, SystemMonitor logs, Event Logs, TomcatThreadDump, and Tomcat status page have been sent via file transfer for review. We restarted the server about 5:20pm. Thank you, Nolan Cassoday Manufacturing Engineer BAE Systems Electronic Systems, Controls & Avionics Solutions T: [phone] | E: [email] 4250 Airport Expressway, Fort Wayne, Indiana 46809 United States From: AOI Tech Support - US Sent: Thursday, May 14, 2026 10:35 AM To: Bowers, Samuel L (US) Cc: [email] Streeter, Joshua D (US) ; Miller, Todd D (US) ; [email] [email] [email] Warnecke, Thomas (US) ; [email] Cassoday, Nolan E (US) ; Lewis, Matthew R (US) Subject: Re: v-CA Webpage slow to load and hang in system when entering PCB ID [Case: 1736062] External Email Alert This email has been sent from an account outside of the BAE Systems network. Please treat the email with caution, especially if you are requested to click on a link, decrypt/open an attachment, or enable macros. For further information on how to spot phishing, access “Cybersecurity OneSpace Page” and report phishing by clicking the button “Report Phishing” on the Outlook toolbar. Hi Matt, Sam, Nolan, and team, Japan/development has provided another update, so I wanted to summarize where things stand. At this point, there appear to be two separate items being reviewed. The first item is related to Windows Defender / Group Policy. Japan reviewed the Windows security logs we provided and believes the Defender-related policy failure is not directly related to the vCA/server slowness. Their finding is that the current GPO named NHNA.WindowsDefender.Disable is trying to disable Windows Defender, but Windows Defender tamper protection may be preventing that change from applying cleanly. Since CrowdStrike has been removed, Japan recommends that your IT team review this GPO. Specifically, they recommend changing the WinDefend service setting and the DisableAntiSpyware registry policy setting to Not Configured. The second item is the vCA / Tomcat behavior. Japan confirmed that the /vtweb/vca/IDSearchByBoard_vca request remaining active is part of the long-polling design used by the “Board ID Reading Central Monitoring” screen. However, they also confirmed that Tomcat 6 can sometimes miss disconnect notifications, which can leave old threads active. If enough of these accumulate, Tomcat can eventually stop accepting new requests once the thread pool limit is reached. Japan noted that the data they reviewed still showed available thread capacity at that time, but this is the area we are continuing to monitor. Japan also stated they have not found past cases yet where the active Tomcat configuration remained at 3.03C after an upgrade to 3.04C, and they are not recommending Tomcat timeout/keep-alive setting changes because those changes may interfere with the long-polling behavior. For now, I have not asked your team to make the GPO changes yet because I wanted to review Japan’s response first and make sure we communicate the request clearly. The recommended customer-side action would be for your IT team to review the following GPO: NHNA.WindowsDefender.Disable Japan recommends reviewing these two settings: 1. System Services * Target: WinDefend * Current: Startup Type = Disabled * Recommended: Change to Not Configured 1. Registry Policy * Target: Software\Policies\Microsoft\Windows Defender\DisableAntiSpyware * Current: Value = 1 * Recommended: Change to Not Configured Separately, I would like to continue monitoring the Tomcat status to see whether the active thread count continues to climb. The key number we are watching is the Tomcat http-8080 busy thread count. If this approaches the 200-thread limit, vCA/vDB/Q-upNavi may stop accepting new requests. We will continue monitoring the daily Tomcat “Complete Server Status” PDFs your team has been sending. Those snapshots are very helpful because they allow us to track the active Tomcat thread count, vCA session count, and the long-running IDSearchByBoard_vca connections over time. We will continue collecting that trend data and sending it to Japan/development as needed so they can review whether the long-polling buildup is stabilizing or continuing to increase. Thank you, [This is Jeremiah Soliz's card. Their email is [email] Their phone number is +[phone].] On Thu, 14 May at 8:20 AM , Bowers, Samuel L (US) wrote: Of course! Have you heard anything else in regard to what next steps we should be taking for this issue? Thank You, Sam Bowers SPV II - IT Factory Support Enterprise Shared Services IT, BAE Systems, Inc. M: [phone] | E: [email] BAE Systems, 4250 Airport Expressway, Fort Wayne, Indiana 46809 www.baesystems.com Connect with BAE Systems: [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNzU4MzIzLCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.e_WIkFKMuLAPUVCIRNX59t18F7cOQ_UHQZlMl0OTSW8] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNzU4MzI0LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.Chbj670tFBD2p_Gkr6jsnsdbW0FttpPk4X3BPFWifIw] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNzU4MzI1LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.vE6Vz4zoL38n-9BVkM7UqYBGfWf0JMH2UWWS19Ebwwo] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNzU4MzI2LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.osaQBwgD4HWATmP_FP2-v4oH6G3pPCDmRnFMEXRLvfY] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNzU4MzI3LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.PclaFBUv5tCvQPwfjl3WT1QbaBVVoF6IkKijuvjeZbo] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNzU4MzI4LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.RQgFXWf4DqqMg5D_UK8mD6wzlTqaC_BBBgCo7CcMBGY] From: AOI Tech Support - US Sent: Wednesday, May 13, 2026 9:43 AM To: Bowers, Samuel L (US) Cc: [email] Streeter, Joshua D (US) ; Miller, Todd D (US) ; [email] [email] [email] Warnecke, Thomas (US) ; [email] Cassoday, Nolan E (US) ; Lewis, Matthew R (US) Subject: Re: v-CA Webpage slow to load and hang in system when entering PCB ID [Case: 1736062] External Email Alert This email has been sent from an account outside of the BAE Systems network. Please treat the email with caution, especially if you are requested to click on a link, decrypt/open an attachment, or enable macros. For further information on how to spot phishing, access “Cybersecurity OneSpace Page” and report phishing by clicking the button “Report Phishing” on the Outlook toolbar. Hello Sam, ​Thank you! I was literally about to email you and ask for this! [This is Jeremiah Soliz's card. Their email is [email] Their phone number is +[phone].] On Wed, 13 May at 8:41 AM , Bowers, Samuel L (US) wrote: Good morning, Attached is the TomCat status page from this morning: Sam Bowers SPV II - IT Factory Support Enterprise Shared Services IT, BAE Systems, Inc. M: [phone] | E: [email] BAE Systems, 4250 Airport Expressway, Fort Wayne, Indiana 46809 www.baesystems.com Connect with BAE Systems: [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNTg4MjU3LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.CYd4b-azWOnQnP57v9bFovYigmkW2FhyI0RgYoYdt1M] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNTg4MjU5LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.LWKrbnpoWiRnLJQEO8rD_mEi1Iti97DPM_jUWnEBzTk] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNTg4MjYwLCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.1w3rcG3wNLhCe3MJbMwCDwQXbvUKQd1LIUFfw7wa4g0] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNTg4MjYxLCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.J0bix4vrA2SMwEuv7bVyZWcUUPlYrbS7wuBnIqewrSk] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNTg4MjYyLCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.TKPXFc8XnEsPrFA1hSMJpkG4GxlkR5wfI_1Rqn5-U_Y] [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNTg4MjY1LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.llQTmNY8S-ceb_wJpUSzOdCxpqz7NrprWdMroRKkkTY] From: Lewis, Matthew R (US) Sent: Monday, May 11, 2026 9:29 AM To: AOI Tech Support - US Cc: [email] Streeter, Joshua D (US) ; Miller, Todd D (US) ; [email] [email] [email] Warnecke, Thomas (US) ; [email] Bowers, Samuel L (US) ; Cassoday, Nolan E (US) Subject: RE: v-CA Webpage slow to load and hang in system when entering PCB ID [Case: 1736062] Also, FYI, the Tomcat status page from this morning is attached. Matthew Lewis Systems Admin Sr – IT Factory Support VCP-DCV, MCSA, Security+ Enterprise Shared Services IT, BAE Systems, Inc. M: [phone] | E: [email] BAE Systems, 4250 Airport Expressway, Fort Wayne, Indiana 46809 www.baesystems.com [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNTg4MjY3LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.CCC4zKpjitqzZ5nAfmXeNlu03EV19b9relNHV4OoEZs][https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNTg4MjY5LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.xZsZM9-StU76Nr8UjnCUFC0t1-nOIKL9y-kPidRKyGQ][https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxNTg4MjcxLCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.56lPucJZt_Mqf9EWC7QesfyuNA2PAkG_rdEmRCJBTG4] From: AOI Tech Support - US Sent: Monday, May 11, 2026 9:11 AM To: Lewis, Matthew R (US) Cc: [email] Streeter, Joshua D (US) ; Miller, Todd D (US) ; [email] [email] [email] Warnecke, Thomas (US) ; [email] Bowers, Samuel L (US) ; Cassoday, Nolan E (US) Subject: Re: v-CA Webpage slow to load and hang in system when entering PCB ID [Case: 1736062] External Email Alert This email has been sent from an account outside of the BAE Systems network. Please treat the email with caution, especially if you are requested to click on a link, decrypt/open an attachment, or enable macros. For further information on how to spot phishing, access “Cybersecurity OneSpace Page” and report phishing by clicking the button “Report Phishing” on the Outlook toolbar. Hello matt, Got the zip file, thank you. [This is Jeremiah Soliz's card. Their email is [email] Their phone number is +[phone].] On Mon, 11 May at 8:05 AM , Lewis, Matthew R (US) wrote: Attached is the files requested. Please let me know if you get them. Nolan is out today and usually sends them. As for the second part, I got an error of “The service name is invalid” when trying the command of “net stop SoftwareUsageMetrics” My research indicated that “Software Usage metrics” is part of the User Access Logging Service. I was able to run the requested commands after stopping that service instead. Matthew Lewis Systems Admin Sr – IT Factory Support VCP-DCV, MCSA, Security+ Enterprise Shared Services IT, BAE Systems, Inc. M: [phone] | E: [email] BAE Systems, 4250 Airport Expressway, Fort Wayne, Indiana 46809 www.baesystems.com [https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxMjA1MTU0LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.4IFhh9kmB0Jzh8afm44CikQn80DrU9ts0eHaePJ0mtU][https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxMjA1MTU1LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.WGEmOX4H8MkM5n2RZJ5BpQL4HaphvFYNI31odSGNRls][https://attachment.freshdesk.com/inline/attachment?token=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpZCI6MTUwMTYxMjA1MTU2LCJkb21haW4iOiJvbXJvbmVsZWN0cm9uaWNzbGxjLmZyZXNoZGVzay5jb20iLCJhY2NvdW50X2lkIjoyNTQ5ODMyfQ.HG3u5egrATu6rgmKUnwUbQ00pvCJcbQGYmLm2tUyNbE] 1736062:2549832