During this time, Finch continued to appear on stage in various productions while under contract to Olivier. Finch's closeness to the Olivier family led to an affair with Olivier's beautiful but increasingly unstable wife, Vivien Leigh, which began in 1948, and continued on and off for several years, ultimately falling apart due to her deteriorating mental condition.
During his war service Finch was given leave to act in radio, theatre and film. He appeared in a number of propaganda shorts, including Another Threshold (1942), These Stars Are Mine (1943), While There is Still Time (1943) and South West Pacific (1943), the latter for Ken G. Hall. He also appeared in two of the few Australian feature films made during the war, The Rats of Tobruk (1944) and the less distinguished Red Sky at Morning (1944).
“Peter and the team offer professionally run, competitive golf at the best courses in the UK. It has been a great way for me to play the top venues under tournament pressure whilst meeting people I now class as friends. A tight ship is run too, with no questionable handicaps and scores, which are well within reason, picking up prizes is a refreshing change. Since my involvement from 2014, you can see the tour growing naturally year on year and given the schedule who can see it stopping. Every event is top class – and glad to be apart of it.”
Finch was married three times. In 1943, he married Romanian-born French ballerina Tamara Tchinarova; they worked together on a number of films. They had a daughter, Anita, born in 1950. They divorced in 1959, after she discovered his affair with actress Vivien Leigh in California. He then married South African-born actress Yolande Turner (née Yolande Eileen Turnbull); they had two children together, Samantha and Charles Peter. During their marriage, Finch had an affair with the singer Shirley Bassey. Bassey had a daughter, also named Samantha, born in 1963; Bassey's husband at the time, the openly gay film producer Kenneth Hume, believed that Finch was her biological father. Finch and Turner divorced in 1965. In 1972 Finch married Mavis "Eletha" Barrett, who was known as Eletha Finch. They had a daughter together, Diana.