Reverse Engineering Doctor Who Into Color 171
Lanxon writes "In 1967, the BBC set about junking its Doctor Who archive: a moment sci-fi fans wish they could travel back in time to prevent. There are 108 vintage episodes missing, but since 1978 a number have been rediscovered as 16mm black-and-white films. The BBC shot many of these series in color, but made monochrome copies for countries such as Australia, where many TV companies were still broadcasting in greyscale. The reels had sat in archives since. Now, the Doctor Who Restoration Team, an independent group contracted by the BBC, is using a new technique to regenerate The Doctor in color."
And now for the nerdery. (Score:5, Informative)
So the article was devoid of anything of particular interest other than some jargon. The jargon, on the other hand, led to fascinating little technique about reconstructing the color of the grayscale image from "chroma dots". The actual method was discovered by a BBC engineer, and you can read more about it here: colour-recovery.wikispaces.com.
Re:There's Good News and Bad News... (Score:5, Informative)
Actually, the process by which they're recovering the colour data is very interesting:
http://www.insell.co.uk/colourisation/Recovery_of_Colour_Information_0-2.htm [insell.co.uk]
Re:technique (Score:5, Informative)
It almost is reverse engineering. The chroma subcarrier in a video signal has a center frequency picked to allow the sidebands to fall between those of the main lumanance (black and white) video. The spectrum of those extends out from the main visual carrier frequency (or up from D.C. for the baseband signal) at multiple of the horizontal scan rate. The goal was to add color broadcast information to an existing greyscale system while introducing a minimal amount of interference. Here people are figuring out what is going on from the visual interference.
The added signal amplitude represents the amount of color added/subtracted from the greyscale white, and the phase represents the hue. The phase of the signal is compared with a short burst (a minimum of eight cycles) sent just after the horizontal sync pulse prior to the start of video on each scan line. PAL, as used by the BBC, is very similar to NTSC, except the scan rates differ, the phase of the reference signal is inverted on every other line to help cancel out the effect of small phase errors on tint.
Basically, those trying to recover color from the back and white films of on-air video have to use a comb filter to pick off the frequency (precisely related to the inverse of the spacing) of the resulting dots that are there from the color signal. The position of the dots from left to right carries the phase information. Considering that the dot pattern is probably quite weak, the resulting color would be noisy. Depending on the filtering used, the bandwidth (detail) may also suffer. But it is still a good starting point to know what the colors were.
The dots aren't on/off like pixels. It's actually a sinusoidal intensity variation. I recall some older Zenith B&W sets had particularly good detail (and maybe some video peaking - enhancement) making it easy to see which programs were broadcast in color, and what parts of the picture were deeply saturated. In addition to a notch in the video response at 4.5 MHz to filter out patterns from the sound, some sets rolled-off or notched centered at 3.58 MHz (3.579545 actually) video response to reduce the interference. Better later sets (and color generally) used "comb" filters to separate the interleaved spectral components without those loss of detail seen with more primitive methods. Failure to filter color signals could cause wild colors/patterns on things like striped neck-ties when a shot zoomed in/out.
It's pleasing to see that there are still a few around that understand the old analog technology well enough to realize there were visual color cues remaining. Even those that understand the electronics well often don't associate a particular visual characteristic with the responsible signal attributes.
Although partial signal recovery is easy to envision with analog electronics, something along the lines of a GIMP/Photoshop plugin could work as well. Some might think of it as being similar to watermark detection.
Re:Rev the wrong thing (Score:5, Informative)
You might consult the Doctor who ratings guide [pagefillers.com]. Look under "Televised Adventures".
Many people like Pyramids of Mars, and the Talons of Weng Chiang, though the latter isn't particularly culturally sensitive. Genesis of the Daleks is another keeper.
Personally, I started with The Power of Kroll.
Re:And now for the nerdery. (Score:5, Informative)
Re:And now for the nerdery. (Score:5, Informative)
http://www.iwillvoice.com/faqpage.html#q3.6 [iwillvoice.com]
Question 3.6 from that FAQ seems to be that which specifically refers to this issue.
Facts (Score:5, Informative)
The politics behind the Chroma Dot story is intriguing and in some places unpleasant. The instigator of the team was James Insell, and a method was created to perform the chroma dot extraction by a man named Richard Russell. Insell became a bit proprietorial over it all, and he and Russell parted ways, and now Russell it doing it alone. The original Colour extraction blog is here [wikispaces.com] but they don't seem to have made any huge advances since Russell left. There is some more info, plus a link to Russell's own work (including software download) on my own Dr.Who webpage here [paullee.com]
Re:Why couldn't they have lost the right ones? (Score:4, Informative)
I did enjoy some of the Colin Baker episodes. Seriously, the guy did an amazing job considering the crap they were putting it through, and it's the producer John Nathan-Turner who would have been better lost, as he seemed determined to make the series die a slow death. Being forced to retake scenes requiring strong emotions multiple times just because "that prop in the background still isn't quite right" must have been soul destroying for the actors.
The good news is that Colin Baker is still doing Doctor Who via the Big Finish Productions [bigfinish.com], where he is given good scripts and is well liked among fans. Nicola Bryant seems to have settled into the role well too, and no longer sounds like she's about to burst into tears after every sentence.
Re:color (Score:4, Informative)
And given that the rest of you guys can't settle on a particular dialect, I think it's a bit arrogant to suggest that our version isn't the dominant dialect
We can't settle on a particular dialect here, either. I can barely understand someone from the NE seaboard; they seem incapable of pronouncing the letter R unless it starts a word. "Da dyam dwag is unda da cah!"
Folks in the south have too many Rs. "Warsh thayut thar winder!"
Then there's jive, ebonics, tex-mex, board-room, 133t5p33k, txt, and those are ones I can think of off the top of my head.
Re:And now for the nerdery. (Score:1, Informative)