With his trademark horn-rimmed glasses, Allen Ludden looked like a guy who was more at home in a college seminar on quantum physics than in a television studio.

Hailing from Mineral Point, Wisconsin, and raised in San Antonio, Ludden, born Oct. 5, 1917, studied English at the University of Texas. He served as an Army officer during World War II and eventually found work with the CBS radio network. In that time he also married girlfriend Martha McGloin and began growing their family.

For more on Betty White, listen below toour daily podcast on PEOPLE Every Day.

Getty

betty white, allen ludden

McGloin died of cancer in 1961, leaving Ludden with three children,David, Martha and Sarah. Ludden soon became smitten with White, and after he proposed to her several times, in 1963, White, who had been married twice before, finally said yes.

“I just wasn’t about to take another chance,” White said in the 2012 CNN interview. “Then I thought, ‘Am I going to live the rest of my life without this man?’ Thank goodness we got married when we did.”

But his luck did change. Ludden was diagnosed with terminal stomach cancer in the late 1970s. The disease progressed slowly, affording him and White time to build a dream getaway home in Carmel, California.

RELATED PHOTOS:‘I Had the Love of My Life’: Betty White’s Love Story with Husband Allen Ludden

In his final days, “we took him back up to see the house finished,” White recalled to PEOPLE in 1999. “He slept there two nights.” Ludden died at 63 on June 9, 1981.

White remembered being home alone days after that: “I came upstairs, and our dogs were lying on his robe. I just fell apart, and we sat there together on the floor.”

Betty White special cover

The actress never remarried, because, as she told Anderson Cooper in 2011, “I had the love of my life. If you’ve had the best, who needs the rest?”

Today, White’s and Ludden’s stars on the Hollywood Walk of Fame remain next to each other. “I cannot express what this day means to me,” a teary White told the crowd at the unveiling of Ludden’s star in 1988. “Don’t be surprised if in the wee hours of the morning our stars are fooling around.”

For more on White and Ludden’s love story, pick up PEOPLE’s Special Issue,America’s Golden Girl: Betty White,available onAmazon.comnow.

source: people.com