| ARTICLES
The Tapeless World
As
of this writing, there are some 400 HD formats in use
around the world. And you thought you had a lot of choices!
Formats have proliferated so fast, that there is now
a complete disconnect between how we shoot and how we
deliver.
The tapeless revolution has given the camera manufacturers
an opportunity to save money by eliminating the tape
drive mechanism and the shooters a new opportunity to
shoot with any of several formats in a smaller, lighter
camera.
Tapeless records to one of 6 devices and formats: PCMCIA
cards, Flash memory cards, Blu-ray disks, Hard disks,
SxS cards, SD cards. But, because the format we shoot
to is almost never the format we output for distribution,
the postproduction and editing process needs to include
time for transcoding or converting from one format to
another.
There are four times transcoding can take place: capture,
editing, output, after output.
Moving to a larger question that looms in the tapeless
world "where do I archive my original material, finished
program and project files?" Most of us would say hard
drives. They're cheap, easy to store and plug and play.
But hard drives are NOT long term storage devices. If
you don't spin-up a hard drive at lease once every three
months, it may not spin-up at all - ever again. That
is due to physical problems with the lubricants inside
the drive. But the real bad news is that if you don't
remove and replace the data on the drive at least once
every 6 months, it may just "fade-out." That's right,
it can just become so weak the computer can no longer
recognize it as data. It needs to be moved off the drive,
and then replaced on the drive. SuperDuper is a great
application for this purpose
www.shirt-pocket.com/SuperDuper/SuperDuperDescription.html
In this clone and re-clone process the data is re-generated
and restored back to its original strength.
Along with hard drives, there are several other longer
term archiving solutions: Optical media including Blu-ray
disks with uncompressed .mov data files, DLT and LTO
tape, and a new product that is billed as a RAID of
RAIDS (very, very expensive). As a matter of interest,
here are the relative times that archival materials
should last: replicated DVD-100 years (Impractical &
very expensive), tape (DLT & LTO) and burned disks-25
years, and hard drives could be as short as 3 months.
More realistically, if they are kept powered off and
on the shelf, you could reasonably expect data loss
in less than three years.
In summary, part of the PRE-Production process must
include decisions about the final distribution format
because that will affect the format used for shooting,
you'll need to allow time for transcoding if you shoot
and distribute in different formats, and special care
needs to be given to archiving.
Speed, Speed, Speed
When you're editing do you ever wonder why some effects
need to be rendered, and some don't. It's a function
of several factors: hard drive speed, the hard drive
connection, the type of video, the number of streams
of video to be rendered and the speed of your processor.
Whether your effects play without rendering, or need
rendering while you’re working, all effects will
need to be rendered prior to output, so allow some extra
time.
The following tables were carefully and laboriously
prepared by Larry Jordan (larryjordan.biz), to whom
the entire production and postproduction communities
need to give continual thanks.
It’s important to note here that most editing
is done by having the source material on some type of
hard drive. For better efficiency, it is recommended
that you not let drives get more than 80% full. All
hard disks require about a 20% overhead for the non-data
communications between the drive and the computer. So,
when comparing numbers on a drive, reduce the effective
throughput by about 20% to get an idea of the effective
data rate. Also remember that the fuller a hard disk
gets, the slower it goes.
This first chart covers connection speeds of various
types of connections (protocols). This will be important
is determining the speed needed for various types of
video. Remember, all speeds are ranges - individual
devices can vary from the range.
| Connection
Speeds by Protocol |
| Protocol |
Speed |
| USB (1 or 2) |
Too slow for video |
| FireWire 400 |
23-30 MB/Sec |
| FireWire 800 |
40-55 MB/Sec |
| SATA (Single Drive) |
75-95 MB/Sec |
| SATA (Laptop) |
~100-150 MB/Sec |
| SATA RAID (Laptop) |
~225-400 MB/Sec |
| SATA RAID (Tower) |
~225-400 MB/Sec |
| PCI Express |
~Up to 500 MB/Sec |
| SAS RAID |
~200-400 MB/Sec |
| SCSI RAID |
~200-450 MB/Sec |
| FibreChannel RAID |
~400-1400 MB/Sec |
Chart Compliments of Larry Jordan, www.larryjorday.biz
Chart # 2 is called Video Formats du Jour, and again will
clue you in as to why things move slower than you anticipated.
A couple of points that will need explanation:
*Bit Depth determines how accurately a digital image can
represent a
color image. It refers to the number of steps that the
picture will display over the entire height of the screen.
8 bit is 256 steps and might cause “banding”
in some clear areas of color (most noticeable in blends
behind graphics). 10 bit is 1024 steps and is much better
at displaying a smooth picture. Notice that there are
almost as many steps as lines in HD.
*Color space, also called color subsampling, refers to
how colors are
represented in a block of four pixels. 4:4:4 means each
pixel has its
own color definition. 4:2:2 means 2 pixels are grouped
to form one
color block. 4:1:1 means four pixels are grouped to form
one color
block. 4:2:0 means two pixels on one row are grouped with
two pixels
on the row below it to form one color block. As a reference
4:2:2 is the standard of broadcast TV and HDCAM. 4:1:1
is the standard for SDV, and 4:2:0 is the standard for
HDV (that’s why it is very hard to color correct
individual colors). Here's a tip - if you're creating
and using effects, use 10 bit.
*GOP Based refers to how the video is compressed. I-frame
compression tends to be faster, easier to work with, and
does not require
any conforming time.
*Data rate refers back to the figures on Chart #1.
*Space to store one hour relates to how big a recording
device you’ll need. Some of these can get pretty
huge. 
What size is that?
What size is a 4K picture? What about 2K, or 35mm?
This last chart that shows a comparison of several formats
in terms of projection size starting with DV and ending
with RED 4K. From this chart you can see the answer to
the “what size is a 4K picture” simply refers
to its size of over 4000 pixels wide. A 2K picture is
2048 pixels wide. 
The second chart shows some of the most common frame rates.
| Common
Frame Rates |
| SD |
HD |
| 23.98 |
23.98 |
| 25 |
25 |
| 29.97 |
29.97 |
| |
30 |
| |
59.94 |
| |
60 |
And finally, the other video format choice is Interlace
or Progressive.
*Interlace is two ½ frames woven together to give
one frame. It is easier to transmit and works better in
low light.
*Progressive is a still picture of a complete frame just
as a digital still camera would record were it able to
run at the faster video frame rates. It is best for action
and is the ONLY choice for the web or if your output is
to film. So, from this you can see that to create progressive
from interlace you need to de-interlace, but that takes
½ of the lines of information away.
If broadcast is your delivery medium, remember that the
major broadcast and cable HD networks take different formats:
- 1080i is used by NBC, CBS, PBS, DiscoveryHD
- 720p is used by ABC, ESPN, FOX
REMEMBER, one of the most important production decisions
you can make is to DECIDE ON YOUR DISTRIBUTION MEDIUM
IN PRE-PRODUCTION, not after you shoot?
Special thanks goes to Larry Jordan for this information
and his charts. If your are interested in learning more,
log on to www.larryjordan.biz
and subscribe to his newsletter. His EditWell newsletter
is also highly recommended.
|