Subscribe by Release via RSS 2.0Subscribe by Chronology via RSS 2.0Recent Comments via RSS 2.0

For The Press - A Project Summary

May
01

So, about 3 years ago, I had a serious hard drive failure and my main multimedia storage drive ate itself. This was my big-gun. About 1 TB of very speedy storage that housed all of the remnant uncompressed video from various projects. Now, you must recall, even 2 years ago, 1 TB of storage was hard to come by and expensive. Back then, Western Digital wasn’t selling 1 TB drives for $200 a pop and if you were trying to utilize multi-stream uncompressed HD for Final Cut or Premiere, you had to invest in serious RAID platforms. Such was the case. No mirroring, no fault tolerance. Just unbridled speedy storage. And it died…

The problem is/was that this drive was home to all the color correction renders of Adrian’s old film, and all of the source renders out from After Effects of the animatic. So, the prime uncompressed HD renders of the animatic were toast. And I never had a chance to reconnect with the materials to re-render. The project timed out for a time while we were waiting for some matters to clear up, and Cyan had already seen everything, so reconstitution was not a priority. And considering the fact that around that time my outside work load went from 40 to 65 hours a week - things just fell by the wayside.

When I started going through our archives to prep content for release on this site, I knew this history was going to pose a problem. We had only one master image in possession of the animatic and as this was before the big wave of H.264, it had been ripped and archived in MPEG-2/DVD format. (For those non-tech types who aren’t already asleep, DVD format is hugely lossy and destructive - about 20% of your original material is lost in the rip. The format only saves what it considers data that’s changed between frames. This is how they fit full movies on one disc.) This problem became very clear when I started importing material for the presentation rip that came out a few weeks ago. A lot of it had to be reconstructed. Dead frames (which translate into bright red frames that have nothing but flat color in them) were all over the place. I had to tween and cut, and dupe frames to keep Adrian from blinking rapidly into a large red square. The first time I previewed it, I nearly had a seizure. And when I scrubbed to the animatic section of the presentation? There was corrupt data all over the place. Boards were getting in the way of the title sequences, black matte was flashing back to frames seen 30 seconds ago — it was a mess. So, I knew, that I was going to have to do some research, and set aside a time to find a better solution, or plan to re-render the entire thing from scratch material (which could easily take days of unbroken attention). Days we don’t have right now with everything going on.

Tonight, I had a breakthrough.

It’s taken a couple of odd hours here and there over the last several weeks researching the best ways to recapture original material from MPEG-2 format, but I finally found something that does the trick - and it’s open source. These obsessed C++ programmers certainly know their way around cracking the MPEG-2 codec to source from to really work with the bits and bytes. After just a little finagling with Handbrake (written by a collection of brilliant French programmers), which I found through reading the Creative COW forums, I could see the solution had come to light. The animatic has now been fully restored in just a simple 7 minute 4-core pass. And it’ll be ready to go as soon as I prep it into web format.

Now, I know what you’re asking. Why the hell am I telling you all of this? Well, because it’s a rant. Technology had me down, and I pwned it. And I had to say something. Just ’cause.

EDIT: Just a typo…um…typos (typoes?)…whatever

2:49 am

tags: , , , , ,

  • Digg
  • del.icio.us
  • Google
  • TwitThis
  • Facebook
  • Mixx
  • Technorati
  • Live
  • Reddit

Ah, it’s wonderful to be a human conquering technology for once, ain’t it? :D Yay for you, Patrick!



I was actually asking when you were going to share with us!

(Data loss haunts my dreams 8( Glad it ended well for you!)



Mister Cloak
May 01 2008

All I can say is that I am in awe of your ability to get things done. Keep up the good work and all that.



I can absolutely appreciate this.

Good old RIAD. Speed or redundancy; your choice!



Technology can be rather sneaky. It first lulls you into a false sense of security, then it pulls the rug. Few things come even close to the the joy of putting our electronic servants back in line. :)

Patrick: 1, Technology: 0



Imagine your dog jumping on your computer desk, and spilling soda, food and other materials all over your 5TB, Quad-core processor, top-of-the-line-better-than-factory-made-HAND-made computer and toasting it to hell.

Right before you were gunna get your college paper finalized.

That’s the story of my brother.

He now works at Burger King.

EDIT: For all who HAVEN’T realized, this is a joke of immense proportions. The accident did happen, but it was well after my brother left college.



Sarah, it’s actually Patrick: 22, Technology: 428. I’m keeping score. Nek, what was your brother doing with that system? serving Seti@Home or something?



myst fanatic
May 02 2008

ah! you’ve got to love technology… you can’t truly come to beating it as far as making it do completely what you want, but i can’t live without it now a-days.
lol, 22 to 428, that is pretty funny. no offense patrick : )



Data loss is serious business. u__u None of our accidents have been that major, I think, but we’ve lost a good couple of gigabytes of data in hard drive crashes. A great applaud to you that you managed to get your stuff back, though! Pwn the technology. ^^



What was the issue w/ the drives specifically? There are ways to fix it either for free or for cheap. If you need any help, you STILL might be able to recover that data. I had a RAID0 go out because of a bad SATA to USB adapter which fried the PCB. Since the platters are fine, I just have to swap out the board. I’ve had to deal with numerous traces of HDD recovery so hopefully you still have those drives, and I might be able to tell you what to do to get them working again, even if RAID0.


Watch Post Comments via RSS 2.0