NAPAC2022 - List of Authors (Hazelwood, K.J.)

Paper	Title	Page
MOPA15	Synchronous High-Frequency Distributed Readout for Edge Processing at the Fermilab Main Injector and Recycler	79
	J.R. Berlioz, J.M.S. Arnold, M.R. Austin, P.M. Hanlet, K.J. Hazelwood, M.A. Ibrahim, A. Narayanan, D.J. Nicklaus, G. Pradhan, A.L. Saewert, B.A. Schupbach, R.M. Thurman-Keup, N.V. Tran Fermilab, Batavia, Illinois, USA J. Jiang, H. Liu, S. Memik, R. Shi, M. Thieme, D. Ulusel Northwestern University, Evanston, Illinois, USA A. Narayanan Northern Illinois University, DeKalb, Illinois, USA
	Funding: Operated by Fermi Research Alliance, LLC under Contract No.De-AC02-07CH11359 with the United States Department of Energy. Additional funding provided by Grant Award No. LAB 20-2261 The Main Injector (MI) was commissioned using data acquisition systems developed for the Fermilab Main Ring in the 1980s. New VME-based instrumentation was commissioned in 2006 for beam loss monitors (BLM), which provided a more systematic study of the machine and improved displays of routine operation. However, current projects are demanding more data and at a faster rate from this aging hardware. One such project, Real-time Edge AI for Distributed Systems (READS), requires the high-frequency, low-latency collection of synchronized BLM readings from around the approximately two-mile accelerator complex. Significant work has been done to develop new hardware to monitor the VME backplane and broadcast BLM measurements over Ethernet, while not disrupting the existing operations-critical functions of the BLM system. This paper will detail the design, implementation, and testing of this parallel data pathway.
	Poster MOPA15 [1.641 MB]
DOI •	reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-MOPA15
About •	Received ※ 03 August 2022 — Revised ※ 04 August 2022 — Accepted ※ 14 August 2022 — Issue date ※ 19 August 2022
Cite •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

MOPA18	Residual Dose and Environmental Monitoring for the Fermilab Main Injector Tunnel Using the Data Acquisition Logging Engine (Dale)	87
	N. Chelidze, R. Ainsworth, B.C. Brown, D. Capista, K.J. Hazelwood, D.K. Morris, M.J. Murphy Fermilab, Batavia, Illinois, USA
	Funding: Fermi National Accelerator Laboratory The Recycler and the Main Injector are part of the Fermilab Accelerator complex used to deliver proton beam to the different experiments. It is very important to control and minimize losses in both machines during operation, to reduce personnel dose from residual activation and to preserve component lifetime. To minimize losses, we need to identify the loss points and adjust the components accordingly. The Data Acquisition Loss Engine (DALE) platform has been developed within the Main Injector department and upgraded throughout the years. DALE is used to survey the entire enclosure for residual dose rates and environmental readings when unrestricted access to the enclosure is possible. Currently DALE has two radiation meters, which are aligned along each machine, so loss points can be identified for both at the same time. DALE attaches to the enclosure carts and is continuously in motion monitoring dose rates and other environmental readings. In this paper we will describe how DALE is used to provide radiation maps of the residual dose rates in the enclosure. We will also compare the loss points with the Beam Loss monitor data.
DOI •	reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-MOPA18
About •	Received ※ 02 August 2022 — Revised ※ 05 August 2022 — Accepted ※ 11 August 2022 — Issue date ※ 21 September 2022
Cite •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

MOPA19	The Effect of the Main Injector Ramp on the Recycler	90
	N. Chelidze, R. Ainsworth, K.J. Hazelwood Fermilab, Batavia, Illinois, USA
	The Recycler and Main Injector are part of the Fermilab Accelerator complex used to deliver a high power proton beam. Both machines share the same enclosure with the Recycler mounted 6 ft above the Main Injector. The Main Injector accelerates beam from 8 GeV to 120 GeV. While the majority of the Recycler has mu metal shielding, the effect of the Main Injector ramp is still significant and can affect both the tunes and the orbit. In this paper, we detail the size of these effects.
DOI •	reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-MOPA19
About •	Received ※ 02 August 2022 — Accepted ※ 04 August 2022 — Issue date ※ 23 August 2022
Cite •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

MOPA28	Semantic Regression for Disentangling Beam Losses in the Fermilab Main Injector and Recycler	112
	M. Thieme, H. Liu, S. Memik, R. Shi Northwestern University, Evanston, Illinois, USA J.M.S. Arnold, M.R. Austin, P.M. Hanlet, K.J. Hazelwood, M.A. Ibrahim, V.P. Nagaslaev, A. Narayanan, D.J. Nicklaus, G. Pradhan, A.L. Saewert, B.A. Schupbach, K. Seiya, R.M. Thurman-Keup, N.V. Tran Fermilab, Batavia, Illinois, USA
	Funding: Operated by Fermi Research Alliance, LLC under Contract No.De-AC02-07CH11359 with the United States Department of Energy. Additional funding provided by Grant Award No. LAB 20-2261, Batavia, IL USA Fermilab’s Main Injector enclosure houses two accelerators: the Main Injector (MI) and the Recycler (RR). In periods of joint operation, when both machines contain high intensity beam, radiative beam losses from MI and RR overlap on the enclosure’s beam loss monitoring (BLM) system, making it difficult to attribute those losses to a single machine. Incorrect diagnoses result in unnecessary downtime that incurs both financial and experimental cost. In this work, we introduce a novel neural approach for automatically disentangling each machine’s contributions to those measured losses. Using a continuous adaptation of the popular UNet architecture in conjunction with a novel data augmentation scheme, our model accurately infers the machine of origin on a per-BLM basis in periods of joint and independent operation. Crucially, by extracting beam loss information at varying receptive fields, the method is capable of learning both local and global machine signatures and producing high quality inferences using only raw BLM loss measurements.
DOI •	reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-MOPA28
About •	Received ※ 02 August 2022 — Revised ※ 05 August 2022 — Accepted ※ 06 August 2022 — Issue date ※ 03 September 2022
Cite •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

MOPA29	Second Generation Fermilab Main Injector 8 GeV Beamline Collimation Preliminary Design	116
	K.J. Hazelwood, P. Adamson, B.C. Brown, D. Capista, R.M. Donahue, B.L. Klein, N.V. Mokhov, V.S. Pronskikh, V.I. Sidorov, M.C. Vincent Fermilab, Batavia, Illinois, USA
	The current Fermilab Main Injector 8 GeV beamline transverse collimation system was installed in 2006. Since then, proton beam intensities and rates have increased significantly. With the promise of even greater beam intensities and a faster repetition rate when the PIP-II upgrade completes later this decade, the current collimation system will be insufficient. Over the past 18 months, multiple collimation designs have been investigated, some more traditional and others novel. A preliminary design review was conducted and a design chosen. Work is underway to finalize the chosen design, prototype some of its novel components and procure parts for installation Summer 2023.
DOI •	reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-MOPA29
About •	Received ※ 03 August 2022 — Revised ※ 08 August 2022 — Accepted ※ 15 August 2022 — Issue date ※ 25 September 2022
Cite •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

MOPA75	Machine Learning for Slow Spill Regulation in the Fermilab Delivery Ring for Mu2e	214
	A. Narayanan Northern Illinois University, DeKalb, Illinois, USA J.M.S. Arnold, M.R. Austin, J.R. Berlioz, P.M. Hanlet, K.J. Hazelwood, M.A. Ibrahim, V.P. Nagaslaev, D.J. Nicklaus, G. Pradhan, P.S. Prieto, A.L. Saewert, B.A. Schupbach, K. Seiya, R.M. Thurman-Keup, N.V. Tran Fermilab, Batavia, Illinois, USA J. Jiang, H. Liu, S. Memik, R. Shi, M. Thieme, D. Ulusel Northwestern University, Evanston, Illinois, USA
	Funding: Work done partly (READS) collaboration at Fermilab (Grant Award No. LAB 20-2261). Fermilab is managed by Fermi Research Alliance, LLC (FRA), acting under Contract No. DE-AC02-07CH11359. A third-integer resonant slow extraction system is being developed for the Fermilab’s Delivery Ring to deliver protons to the Mu2e experiment. During a slow extraction process, the beam on target is liable to experience small intensity variations due to many factors. Owing to the experiment’s strict requirements in the quality of the spill, a Spill Regulation System (SRS) is currently under design. The SRS primarily consists of three components - slow regulation, fast regulation, and harmonic content tracker. In this presentation, we shall present the investigations of using Machine Learning (ML) in the fast regulation system, including further optimizations of PID controller gains for the fast regulation, prospects of an ML agent completely replacing the PID controller using supervised learning schemes such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) ML models, the simulated impact and limitation of machine response characteristics on the effectiveness of both PID and ML regulation of the spill. We also present here nascent results of Reinforcement Learning efforts, including continuous-action soft actor-critic methods, to regulate the spill rate.
DOI •	reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-MOPA75
About •	Received ※ 03 August 2022 — Revised ※ 08 August 2022 — Accepted ※ 18 September 2022 — Issue date ※ 05 October 2022
Cite •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

WEYE3	Improvements to the Recycler/Main Injector to Deliver 850 kW+	578
	R. Ainsworth, P. Adamson, D. Capista, N. Chelidze, K.J. Hazelwood, I. Kourbanis, O. Mohsen, D.K. Morris, M.J. Murphy, M. Wren, M. Xiao Fermilab, Batavia, Illinois, USA C.E. Gonzalez-Ortiz MSU, East Lansing, Michigan, USA
	The Main Injector is used to deliver a 120 GeV high power proton beam for Neutrino experiments. The design power of 700 kW was reached in early 2017 but further improvements have seen a new sustained peak power of 893 kW. Two of the main improvements include the shortening of the Main Injector ramp length as well optimizing the slip-stacking procedure performed in the Recycler to reduce the amount of uncaptured beam making its way into the Main Injector. These improvements will be discussed in this paper as well future upgrades to reach higher beam powers.
	Slides WEYE3 [24.715 MB]
DOI •	reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-WEYE3
About •	Received ※ 02 August 2022 — Revised ※ 08 August 2022 — Accepted ※ 10 August 2022 — Issue date ※ 18 August 2022
Cite •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

WEPA40	The L-CAPE Project at FNAL	719
	M. Jain, V.C. Amatya, G.U. Panapitiya, J.F. Strube PNNL, Richland, Washington, USA B.F. Harrison, K.J. Hazelwood, W. Pellico, B.A. Schupbach, K. Seiya, J.M. St. John Fermilab, Batavia, Illinois, USA
	The controls system at FNAL records data asynchronously from several thousand Linac devices at their respective cadences, ranging from 15Hz down to once per minute. In case of downtimes, current operations are mostly reactive, investigating the cause of an outage and labeling it after the fact. However, as one of the most upstream systems at the FNAL accelerator complex, the Linac’s foreknowledge of an impending downtime as well as its duration could prompt downstream systems to go into standby, potentially leading to energy savings. The goals of the Linac Condition Anomaly Prediction of Emergence (L-CAPE) project that started in late 2020 are (1) to apply data-analytic methods to improve the information that is available to operators in the control room, and (2) to use machine learning to automate the labeling of outage types as they occur and discover patterns in the data that could lead to the prediction of outages. We present an overview of the challenges in dealing with time-series data from 2000+ devices, our approach to developing an ML-based automated outage labeling system, and the status of augmenting operations by identifying the most likely devices predicting an outage.
	Poster WEPA40 [1.870 MB]
DOI •	reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-WEPA40
About •	Received ※ 03 August 2022 — Revised ※ 12 August 2022 — Accepted ※ 17 August 2022 — Issue date ※ 31 August 2022
Cite •	reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

Paper

Title

Page

Synchronous High-Frequency Distributed Readout for Edge Processing at the Fermilab Main Injector and Recycler

79

J.R. Berlioz, J.M.S. Arnold, M.R. Austin, P.M. Hanlet, K.J. Hazelwood, M.A. Ibrahim, A. Narayanan, D.J. Nicklaus, G. Pradhan, A.L. Saewert, B.A. Schupbach, R.M. Thurman-Keup, N.V. Tran
Fermilab, Batavia, Illinois, USA
J. Jiang, H. Liu, S. Memik, R. Shi, M. Thieme, D. Ulusel
Northwestern University, Evanston, Illinois, USA
A. Narayanan
Northern Illinois University, DeKalb, Illinois, USA

Funding: Operated by Fermi Research Alliance, LLC under Contract No.De-AC02-07CH11359 with the United States Department of Energy. Additional funding provided by Grant Award No. LAB 20-2261
The Main Injector (MI) was commissioned using data acquisition systems developed for the Fermilab Main Ring in the 1980s. New VME-based instrumentation was commissioned in 2006 for beam loss monitors (BLM), which provided a more systematic study of the machine and improved displays of routine operation. However, current projects are demanding more data and at a faster rate from this aging hardware. One such project, Real-time Edge AI for Distributed Systems (READS), requires the high-frequency, low-latency collection of synchronized BLM readings from around the approximately two-mile accelerator complex. Significant work has been done to develop new hardware to monitor the VME backplane and broadcast BLM measurements over Ethernet, while not disrupting the existing operations-critical functions of the BLM system. This paper will detail the design, implementation, and testing of this parallel data pathway.

Poster MOPA15 [1.641 MB]

DOI •

reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-MOPA15

About •

Received ※ 03 August 2022 — Revised ※ 04 August 2022 — Accepted ※ 14 August 2022 — Issue date ※ 19 August 2022

Cite •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

MOPA18

Residual Dose and Environmental Monitoring for the Fermilab Main Injector Tunnel Using the Data Acquisition Logging Engine (Dale)

87

N. Chelidze, R. Ainsworth, B.C. Brown, D. Capista, K.J. Hazelwood, D.K. Morris, M.J. Murphy
Fermilab, Batavia, Illinois, USA

Funding: Fermi National Accelerator Laboratory
The Recycler and the Main Injector are part of the Fermilab Accelerator complex used to deliver proton beam to the different experiments. It is very important to control and minimize losses in both machines during operation, to reduce personnel dose from residual activation and to preserve component lifetime. To minimize losses, we need to identify the loss points and adjust the components accordingly. The Data Acquisition Loss Engine (DALE) platform has been developed within the Main Injector department and upgraded throughout the years. DALE is used to survey the entire enclosure for residual dose rates and environmental readings when unrestricted access to the enclosure is possible. Currently DALE has two radiation meters, which are aligned along each machine, so loss points can be identified for both at the same time. DALE attaches to the enclosure carts and is continuously in motion monitoring dose rates and other environmental readings. In this paper we will describe how DALE is used to provide radiation maps of the residual dose rates in the enclosure. We will also compare the loss points with the Beam Loss monitor data.

DOI •

reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-MOPA18

About •

Received ※ 02 August 2022 — Revised ※ 05 August 2022 — Accepted ※ 11 August 2022 — Issue date ※ 21 September 2022

Cite •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

MOPA19

The Effect of the Main Injector Ramp on the Recycler

90

N. Chelidze, R. Ainsworth, K.J. Hazelwood
Fermilab, Batavia, Illinois, USA

The Recycler and Main Injector are part of the Fermilab Accelerator complex used to deliver a high power proton beam. Both machines share the same enclosure with the Recycler mounted 6 ft above the Main Injector. The Main Injector accelerates beam from 8 GeV to 120 GeV. While the majority of the Recycler has mu metal shielding, the effect of the Main Injector ramp is still significant and can affect both the tunes and the orbit. In this paper, we detail the size of these effects.

DOI •

reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-MOPA19

About •

Received ※ 02 August 2022 — Accepted ※ 04 August 2022 — Issue date ※ 23 August 2022

Cite •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

MOPA28

Semantic Regression for Disentangling Beam Losses in the Fermilab Main Injector and Recycler

112

M. Thieme, H. Liu, S. Memik, R. Shi
Northwestern University, Evanston, Illinois, USA
J.M.S. Arnold, M.R. Austin, P.M. Hanlet, K.J. Hazelwood, M.A. Ibrahim, V.P. Nagaslaev, A. Narayanan, D.J. Nicklaus, G. Pradhan, A.L. Saewert, B.A. Schupbach, K. Seiya, R.M. Thurman-Keup, N.V. Tran
Fermilab, Batavia, Illinois, USA

Funding: Operated by Fermi Research Alliance, LLC under Contract No.De-AC02-07CH11359 with the United States Department of Energy. Additional funding provided by Grant Award No. LAB 20-2261, Batavia, IL USA
Fermilab’s Main Injector enclosure houses two accelerators: the Main Injector (MI) and the Recycler (RR). In periods of joint operation, when both machines contain high intensity beam, radiative beam losses from MI and RR overlap on the enclosure’s beam loss monitoring (BLM) system, making it difficult to attribute those losses to a single machine. Incorrect diagnoses result in unnecessary downtime that incurs both financial and experimental cost. In this work, we introduce a novel neural approach for automatically disentangling each machine’s contributions to those measured losses. Using a continuous adaptation of the popular UNet architecture in conjunction with a novel data augmentation scheme, our model accurately infers the machine of origin on a per-BLM basis in periods of joint and independent operation. Crucially, by extracting beam loss information at varying receptive fields, the method is capable of learning both local and global machine signatures and producing high quality inferences using only raw BLM loss measurements.

DOI •

reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-MOPA28

About •

Received ※ 02 August 2022 — Revised ※ 05 August 2022 — Accepted ※ 06 August 2022 — Issue date ※ 03 September 2022

Cite •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

MOPA29

Second Generation Fermilab Main Injector 8 GeV Beamline Collimation Preliminary Design

116

K.J. Hazelwood, P. Adamson, B.C. Brown, D. Capista, R.M. Donahue, B.L. Klein, N.V. Mokhov, V.S. Pronskikh, V.I. Sidorov, M.C. Vincent
Fermilab, Batavia, Illinois, USA

The current Fermilab Main Injector 8 GeV beamline transverse collimation system was installed in 2006. Since then, proton beam intensities and rates have increased significantly. With the promise of even greater beam intensities and a faster repetition rate when the PIP-II upgrade completes later this decade, the current collimation system will be insufficient. Over the past 18 months, multiple collimation designs have been investigated, some more traditional and others novel. A preliminary design review was conducted and a design chosen. Work is underway to finalize the chosen design, prototype some of its novel components and procure parts for installation Summer 2023.

DOI •

reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-MOPA29

About •

Received ※ 03 August 2022 — Revised ※ 08 August 2022 — Accepted ※ 15 August 2022 — Issue date ※ 25 September 2022

Cite •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

MOPA75

Machine Learning for Slow Spill Regulation in the Fermilab Delivery Ring for Mu2e

214

A. Narayanan
Northern Illinois University, DeKalb, Illinois, USA
J.M.S. Arnold, M.R. Austin, J.R. Berlioz, P.M. Hanlet, K.J. Hazelwood, M.A. Ibrahim, V.P. Nagaslaev, D.J. Nicklaus, G. Pradhan, P.S. Prieto, A.L. Saewert, B.A. Schupbach, K. Seiya, R.M. Thurman-Keup, N.V. Tran
Fermilab, Batavia, Illinois, USA
J. Jiang, H. Liu, S. Memik, R. Shi, M. Thieme, D. Ulusel
Northwestern University, Evanston, Illinois, USA

Funding: Work done partly (READS) collaboration at Fermilab (Grant Award No. LAB 20-2261). Fermilab is managed by Fermi Research Alliance, LLC (FRA), acting under Contract No. DE-AC02-07CH11359.
A third-integer resonant slow extraction system is being developed for the Fermilab’s Delivery Ring to deliver protons to the Mu2e experiment. During a slow extraction process, the beam on target is liable to experience small intensity variations due to many factors. Owing to the experiment’s strict requirements in the quality of the spill, a Spill Regulation System (SRS) is currently under design. The SRS primarily consists of three components - slow regulation, fast regulation, and harmonic content tracker. In this presentation, we shall present the investigations of using Machine Learning (ML) in the fast regulation system, including further optimizations of PID controller gains for the fast regulation, prospects of an ML agent completely replacing the PID controller using supervised learning schemes such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) ML models, the simulated impact and limitation of machine response characteristics on the effectiveness of both PID and ML regulation of the spill. We also present here nascent results of Reinforcement Learning efforts, including continuous-action soft actor-critic methods, to regulate the spill rate.

DOI •

reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-MOPA75

About •

Received ※ 03 August 2022 — Revised ※ 08 August 2022 — Accepted ※ 18 September 2022 — Issue date ※ 05 October 2022

Cite •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

WEYE3

Improvements to the Recycler/Main Injector to Deliver 850 kW+

578

R. Ainsworth, P. Adamson, D. Capista, N. Chelidze, K.J. Hazelwood, I. Kourbanis, O. Mohsen, D.K. Morris, M.J. Murphy, M. Wren, M. Xiao
Fermilab, Batavia, Illinois, USA
C.E. Gonzalez-Ortiz
MSU, East Lansing, Michigan, USA

The Main Injector is used to deliver a 120 GeV high power proton beam for Neutrino experiments. The design power of 700 kW was reached in early 2017 but further improvements have seen a new sustained peak power of 893 kW. Two of the main improvements include the shortening of the Main Injector ramp length as well optimizing the slip-stacking procedure performed in the Recycler to reduce the amount of uncaptured beam making its way into the Main Injector. These improvements will be discussed in this paper as well future upgrades to reach higher beam powers.

Slides WEYE3 [24.715 MB]

DOI •

reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-WEYE3

About •

Received ※ 02 August 2022 — Revised ※ 08 August 2022 — Accepted ※ 10 August 2022 — Issue date ※ 18 August 2022

Cite •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)

WEPA40

The L-CAPE Project at FNAL

719

M. Jain, V.C. Amatya, G.U. Panapitiya, J.F. Strube
PNNL, Richland, Washington, USA
B.F. Harrison, K.J. Hazelwood, W. Pellico, B.A. Schupbach, K. Seiya, J.M. St. John
Fermilab, Batavia, Illinois, USA

The controls system at FNAL records data asynchronously from several thousand Linac devices at their respective cadences, ranging from 15Hz down to once per minute. In case of downtimes, current operations are mostly reactive, investigating the cause of an outage and labeling it after the fact. However, as one of the most upstream systems at the FNAL accelerator complex, the Linac’s foreknowledge of an impending downtime as well as its duration could prompt downstream systems to go into standby, potentially leading to energy savings. The goals of the Linac Condition Anomaly Prediction of Emergence (L-CAPE) project that started in late 2020 are (1) to apply data-analytic methods to improve the information that is available to operators in the control room, and (2) to use machine learning to automate the labeling of outage types as they occur and discover patterns in the data that could lead to the prediction of outages. We present an overview of the challenges in dealing with time-series data from 2000+ devices, our approach to developing an ML-based automated outage labeling system, and the status of augmenting operations by identifying the most likely devices predicting an outage.

Poster WEPA40 [1.870 MB]

DOI •

reference for this paper ※ doi:10.18429/JACoW-NAPAC2022-WEPA40

About •

Received ※ 03 August 2022 — Revised ※ 12 August 2022 — Accepted ※ 17 August 2022 — Issue date ※ 31 August 2022

Cite •

reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)