Author Topic: Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)  (Read 32280 times)

Offline apollo16uvc

  • Mars
  • ***
  • Posts: 396
  • Where no telescope has gone before.
    • Patreon
Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #45 on: September 17, 2020, 02:05:30 PM »
Starting work on HQ 1080p scans of Gemini 4 spacewalk. Will take approx 3 days of uninterrupted rendering for both camera's.

I did run some tests, going from 6 to 24fps.

...


It is going to be otherworldly.
Watch me at: YouTube
Experience the past: Flickr
Support me on Patreon

Offline JayUtah

  • Neptune
  • ****
  • Posts: 3814
    • Clavius
Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #46 on: September 24, 2020, 11:33:38 AM »
Looking forward to it!
"Facts are stubborn things." --John Adams

Offline apollo16uvc

  • Mars
  • ***
  • Posts: 396
  • Where no telescope has gone before.
    • Patreon
Watch me at: YouTube
Experience the past: Flickr
Support me on Patreon

Offline Obviousman

  • Jupiter
  • ***
  • Posts: 743
Re: Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #48 on: October 06, 2020, 03:55:51 PM »
Getting some traction there, with all of the HSK people being alerted to the work!

Quote
Hello All,

Thought you would find this article about a Dutch film restoration specialist's work on bringing the Apollo footage up to HD quality, of interest.
https://www.livescience.com/moon-landing-footage-remastered.html

Cheers,

Offline apollo16uvc

  • Mars
  • ***
  • Posts: 396
  • Where no telescope has gone before.
    • Patreon
Re: Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #49 on: October 07, 2020, 09:01:23 AM »
Getting some traction there, with all of the HSK people being alerted to the work!

Quote
Hello All,

Thought you would find this article about a Dutch film restoration specialist's work on bringing the Apollo footage up to HD quality, of interest.
https://www.livescience.com/moon-landing-footage-remastered.html

Cheers,
I saw that article, was a Nice interview.

I would not call myself a restorer however.

Where is that post from? Not sure I know HSK...
Watch me at: YouTube
Experience the past: Flickr
Support me on Patreon

Offline Obviousman

  • Jupiter
  • ***
  • Posts: 743
Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #50 on: October 07, 2020, 04:02:55 PM »
I'm a member of a mail newsgroup created by the "trackers" who manned the Honeysuckle Creek tracking station near Canberra, Australia, during the Gemini, Apollo and Skylab missions. The excerpt was from an email sent out to members.

Offline JayUtah

  • Neptune
  • ****
  • Posts: 3814
    • Clavius
Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #51 on: October 08, 2020, 11:05:16 AM »
Now I'm wondering what Méliès' From the Earth to the Moon would look like with this treatment.
"Facts are stubborn things." --John Adams

Offline apollo16uvc

  • Mars
  • ***
  • Posts: 396
  • Where no telescope has gone before.
    • Patreon
Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #52 on: October 09, 2020, 03:41:51 PM »
Now I'm wondering what Méliès' From the Earth to the Moon would look like with this treatment.
I could let my PC crunch on that overnight.

But I would need to know its original recording speed and have a high quality scan. Something where the grain is resolved.

The playback speed is supposed to be 16fps, but that looks too fast. I think it was filmed between 12 and 14fps.
« Last Edit: October 09, 2020, 04:09:25 PM by apollo16uvc »
Watch me at: YouTube
Experience the past: Flickr
Support me on Patreon

Offline JayUtah

  • Neptune
  • ****
  • Posts: 3814
    • Clavius
Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #53 on: October 09, 2020, 07:53:40 PM »
Yes.  That was his preferred frame rate.
"Facts are stubborn things." --John Adams

Offline apollo16uvc

  • Mars
  • ***
  • Posts: 396
  • Where no telescope has gone before.
    • Patreon
Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #54 on: October 18, 2020, 02:38:06 PM »
Watch me at: YouTube
Experience the past: Flickr
Support me on Patreon

Offline apollo16uvc

  • Mars
  • ***
  • Posts: 396
  • Where no telescope has gone before.
    • Patreon
Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #55 on: October 29, 2020, 06:14:30 PM »
I have been thinking about how the Apollo 11 TV EVA would look interpolated. It was shot at 10fps, so it could really be improved.

The problem is that the 10fps SSTV signal went through several conversions before being broadcasted and recorded on video tape or telecined onto film.

In order for this to really work, I need the footage without any duplicated frames.... only the real 10fps.


Which source do you think has the least amount of frame adding/removing and thus the best potential for all duplicate frames to be removed so I only have the real frames?


If there is a pattern to the frames, maybe it can be achieved by simply removing every X amount of frames? Or are all sources too irregular for that? If so, maybe some duplicate-frame detection scheme.

I could possibly do a test by manually removing the duplicates for a few seconds and see how that turns out.

Worth a shot?

If we can make this work I will interpolate the entire EVA, which may take several weeks of uninterrupted rendering...
Watch me at: YouTube
Experience the past: Flickr
Support me on Patreon

Offline ka9q

  • Neptune
  • ****
  • Posts: 3014
Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #56 on: November 30, 2020, 10:41:20 PM »
Those have a super high bitrate and look stunning, but there is one big problem: They are 59.94fps. This means there are duplicates because the source is either 1, 6, 12 or 24fps.
Is the problem the 59.94 fps NTSC frame rate (vs 60 fps), or that it's not an integer multiple of 1, 6, 12 or 24?

Offline apollo16uvc

  • Mars
  • ***
  • Posts: 396
  • Where no telescope has gone before.
    • Patreon
Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #57 on: December 22, 2020, 08:07:07 AM »
Watch me at: YouTube
Experience the past: Flickr
Support me on Patreon

Offline apollo16uvc

  • Mars
  • ***
  • Posts: 396
  • Where no telescope has gone before.
    • Patreon
Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #58 on: December 22, 2020, 08:15:29 AM »
Those have a super high bitrate and look stunning, but there is one big problem: They are 59.94fps. This means there are duplicates because the source is either 1, 6, 12 or 24fps.
Is the problem the 59.94 fps NTSC frame rate (vs 60 fps), or that it's not an integer multiple of 1, 6, 12 or 24?
The problem are the introduced duplicate frames. By saving a 24fps file in a 59.94 file but trying to retrain the same speed.

These sometimes prove difficult to remove. Especially when they are blended or interlaced...
Watch me at: YouTube
Experience the past: Flickr
Support me on Patreon

Offline apollo16uvc

  • Mars
  • ***
  • Posts: 396
  • Where no telescope has gone before.
    • Patreon
Re: AI Interpolation of NASA footage (Smoothing/Increasing Fps)
« Reply #59 on: February 07, 2021, 05:32:15 AM »


Combination of 16mm, Hasselblad and TV footage of the Apollo 14 ladder egress and flag deployment. 16mm interpolated and upscaled to 60fps 5k.

Special thanks to the ALSJ, David Woods, Lunarmodule5
Watch me at: YouTube
Experience the past: Flickr
Support me on Patreon