WHOI  WHOI People  

Video

Overview

Video from the Jason/Medea ROV includes both recordable and utilitarian streams. The three sources that are routinely recorded use HDTV cameras. Utility cameras are used to aid vehicle and instrument operations and are not recorded.

Jason's SciCam, the camera offered for control by science party watchstanders, can be configured using one of two different options. The first is a unit developed by WHOI's Advanced Imaging and Visualization Lab and produces an HD-SDI digital stream with frames of 1980x1020 pixels x 12 bits per pixel, at a capture rate of 30 frames per second (1080p/29.97). The second option is an InSite Mini Zeus HD imaging camera with still imaging storage. Both are most often mounted on the centerline above the basket on a pan and tilt mechanism. A pair of red lasers mounted on the pan and tilt platform in parallel provides a scale reference (10cm) in the image.

The "brow camera" is mounted top and forward on the vehicle's light bar. Both of these are an Insite Mini Zeus camera, which produces an HD-SDI (1080i/59.94) signal at 1920x1080x10 bits.

Select moments from any of these HDTV cameras can be recorded as highlights by a hard disk recorder (currently Aja KiPro).The recorded video files are compressed using the Apple ProRes422 family of codecs. Each HDTV camera signal is also converted to an analog composite signal and is constantly recorded onto DVD-R media. The HD-SDI signal can be routed though an overlay server, which produces an SD-SDI signal that can be recorded by the hard disk recorder in lieu of high definition highlights, or can be recorded by a Sony DSR1500 DVCam tape recorder. Note: The DVCam recording is NOT a standard Jason video product deliverable. See the Non-Standard Product - DVCam section below.

Primary Video Streams - Four

Pilot's P/T, light bar, science HDTV P/T, Medea color
Displayed
Recorded (except for Medea) constantly to DVD

Select moments recorded to ProRes422 file, one camera of SciCam, PilotCam, or BrowCam.
Distributed into ship
Framegrabbed (Virtual Van)

  Pilot’s Pan/Tilt Light Bar Camera Science Pan/Tilt Medea Color
Specs HDTV, HD-SDI
Color, Zoom, Pan/Tilt
HDTV, HD-SDI
Color, Zoom, Fixed
HDTV, HD-SDI
Color, Zoom, Pan/Tilt
10cm Laser Scalers
NTSC, Composite
Color, Zoom, Fixed
Camera 6.5kM Insite Mini-Zeus 6.5kM Insite Mini-Zeus WHOI AIVL HDTV 6.5kM Wide Angle Pegasus
Location
View
Use
Jason
Center/Fwd
Pilot’s View
Jason
Light Bar/Fwd, Down
OverView
Jason
Port/Fwd
Science Operated P/T
Medea
Center/Downlook
Medea Overview of Jason
Displayed Yes Yes Yes Yes
Recorded
DVD Recorder
Yes
Continuously while on bottom
DVD-R
VBR, MPEG-2
SP (2hr format)
Yes
Continuously while on bottom
DVD-R
VBR, MPEG-2
SP (2hr format)
Yes
Continuously while on bottom
DVD-R
VBR, MPEG-2
SP (2hr format)
No
Frame Grabbed
(Virtual Van)
Yes
Auto Interval
User I/P Events
704x480, jpg
Yes
Auto Interval
User I/P Events
704x480, jpg
Yes
Auto Interval
User I/P Events
704x480, jpg
Yes (Color)
Auto Interval
User I/P Events
704x480, jpg
HD Video Highlights
Yes Yes Yes No
HD Framegrabs
In Development No Yes No
Distributed Into Ship
Yes Yes Yes Yes (Color)
NDSF Archive Copy
(NDSF Archiving Policy)
1 DVD-R/ 2Hrs
Pilot’s P/T Video
No Video Annotation
Audio Time Code
FSK Encoded Data
Real Time Media Provided by Jason
1 DVD-R/ 2Hrs
Light Bar Video
No Video Annotation
Audio Time Code
FSK Encoded Data
Real Time Media Provided by Jason
1 DVD-R/ 2Hrs
Science P/T Video
No Video Annotation
Audio Time Code
FSK Encoded Data
Real Time Media Provided by Jason
(NA)
Science Copy
(Video Overlay)
1 DVD-R/ 2Hrs
Pilot’s P/T Video;
User-Configurable
Video Annotation;
2/3 User-Selectable
Audio Time Code
or
FSK Encoded Data
or
Audio Commentary;
Real Time Media Provided By Jason
1 DVD-R/ 2Hrs
Light BarVideo;
User-Configurable
Video Annotation;
2/3 User-Selectable
Audio Time Code
or
FSK Encoded Data
or
Audio Commentary;
Real Time Media Provided By Jason
1 DVD-R/ 2Hrs
Science P/T Video;
User-Configurable
Video Annotation;
2/3 User-Selectable
Audio Time Code
or
FSK Encoded Data
or
Audio Commentary;
Real Time Media Provided By Jason
(NA)

Secondary Video Streams - Multiple

Port/Stbd manipulator cameras, basket camera, BUTT camera
Pencil camera, DSC video, deck camera, winch camera, Medea termination
Displayed as required, not recorded, not distributed, not framegrabbed

  Port/Stbd Manip Center Cam Butt Cam Pencil Cam DSC Deck Cam Winch Cam Medea Termination
Specs NTSC
Color Composite Fixed
 NTSC
Color Composite Fixed
NTSC
Color Composite Fixed 
 NTSC
Color Composite Fixed
 NTSC
Color Composite Fixed
NTSC
Color Composite Fixed
NTSC
Color Composite Fixed 
NTSC
Color Composite Fixed 
Use  Monitor Manips Monitor Basket Aft Looking As Required Monitor
DSC Image Collection
Monitor Ship's Afterdeck Monitor Jason FO Winch Monitor
Medea Termination 
Displayed As Required As Required As Required As Required Yes Yes Yes As Required
Recorded  No  No No No  No  No  No  No
Frame Grabbed
No No  No  No   No Sometimes
(Launch Recovery) 
 No  No
Distributed Into Ship
No   No No  No   No  No No  N

Video Lighting (Jason)

Sixteen LED, including four 3-head units

Two 400 watt HMI (1 down/fwd, 1 aft)
Two 250 watt incandescent (1 fwd, 1 aft)

Video Distribution

All video is available for display within the Jason control vans via a video routing system.

Up to four streams (typically from pilot's P/T, light bar cam, science P/T, Medea color, deckcam) are run into the ship's video distribution system for ship-wide viewing.

Video Recording

MPEG2, SP (2Hr) format
One video stream per individual DVD-R
Three primary video streams recorded continuously when at depth:

• Pilot's pan/tilt: 1-chip, color, zoom, pan/tilt, ROV pilot's view (sample video)
• Light bar cam: 1-chip, color, zoom, fixed, fwd/down overview (sample video)
• Science pan/tilt: 3-chip, color, zoom, pan/tilt, science use, 10cm lasers (see sample image below)

Two copies generated in real time - NDSF archive copy and science party copy
NDSF archive copy: no video overlay annotation
Science party copy: user-configurable video overlay annotated

DVD recorder: Panasonic DMR-ES15/28 or Toshiba D430

Audio Track Recording - Time Code, FSK Data, Audio Commentary

Audio Time Code: SMPTE standard audio time code disciplined by NTP from GPS/Master
FSK data: Bell202-compatible audio data stream containing Jason data (see below)
Audio commentary: verbal commentary from a single source, push to talk microphone

NDSF archive copies: audio time code in right audio channel, FSK data in left audio channel
Science party copies: two of the three audio streams available; determined by the Chief Scientist.

Highlights Recording

One of the HDTV camera streams (Science, Pilot, or Brow) can be routed to a hard disk recorder. Highlights
are captured under the control of a science party watchstander, who also records metadata (start/stop time,
description of activity during the highlight). SMPTE standard audio time code disciplined by GPS via NTP is
recorded to both a dedicated time code and channel and to an audio channel. The science party's choice of
voice narration or an Bell202 compatible FSK audio data stream containing Jason data is recorded to the other
audio channel.

After the lowering the Jason data processor transfers highlight clips to hard drives, renaming them to include start and stop time in the file name. A full set of the highlights is archived at WHOI/NDSF. Another set is provided to the chief scientist on hard drives (MacOS HFS+ filesystem) provided by the chief scientist.

[Gallery Photo]Zoom

Sample Video Overlay.

Video Overlay Processor

Note:  The NDSF archive copies of the Jasonvideo are recorded with no video overlay annotation. This is to preserve a pristine copy of the video for the user community. The FSK data stream is recorded in the left audio track of the NDSF archive copies. Using the features of the DSL video overlay processor, the unannotated video can be copied and reannotated as needed in post processing.

Video annotation and FSK digital data encoding is carried out using the DSL video overlay processor board. The DSL video overlay processor is a seventeen lines by forty characters video overlay generator system that derives overlay text data via UDP data packets broadcast by the Jason topside computer. The system collects and parses Jason data strings (JDS), Medea data strings (MDS) and Jason cable temperature data strings (CTM) on UDP port 10502 and prints the data onto either a composite or Y/C video channel. Text positions, labels and data types are configured via an onboard web server interface and are saved to flash memory.
Data available for annotation include cruise id, lowering id, date, time, navigation, vehicle attitude and temperature as well as other data broadcast by the Jason topside system. The web server interface displays the full suite of data available when configuring the overlay. See Sample Video Overlay below.

There are currently four controllers dedicated to science video recording (one each to the three science copy DVD decks and one to the DVCam deck), and four others dedicated to various control van video displays. Each individual video overlay controller can be configured independently (or the same) to meet user requirements.

The video overlay processor board also generates a Bell202 compatible FSK audio data output stream derived from the parsed UDP data. The FSK data stream includes Date, Time, X, Y, Heading, Depth, Altitude, Dive Number, Cruise ID and LBL Origin broadcast at a 1Hz rate. This FSK audio data is always recorded to one of the audio tracks on the NDSF copies of the video DVDs, and can be chosen as one of two audio options recorded onto the audio tracks of the science party DVDs (see the Audio Track Recording section above).

The board incorporates the ability to decode a previously recorded audio track and generate overlays from that audio data. This provides the capability of recording a video source without video overlays and selectively generating them in post processing.

Additionally, a Windows-based program can be used to decode the audio stream via the PC’s microphone jack input and display the decoded data in real time. This feature allows end users to decode the audio track without requiring special equipment.

The HD-SDI hard disk recorder offers both a dedicated time code recording channel and two audio recording channels. Configuration of the audio channels is the same as for the DVD recoders. The dedicated time code channel places time information properly for use in playback and non-linear editing software. The HD-SDI to SD-SDI overlay server uses a Blackmagic Design Decklink SDI capture card in a linux OS computer with custom software to collect the same Jason subnetwork UDP broadcast packets and perform an alpha-channel masking using selected text fields.. This server overlays a stream from one camera.

Media

  • Verbatim DVD-R 4.7GB, 1-8X speed DVD-R with white/matte printable surface
  • All real time media (archive and science copies) supplied by NDSF/Jason
  • All costs for real time media covered by Jason Group (includes cases, labeling)
  • Media supplied based on number of proposed Jason use days, 24/7 ops, 2hrs/DVD, rounded up
  • Estimated use/day: 12 DVD-Rs/stream/copy (total of 72/day: 36 archive, 36 science)
High definition highlight files are copied from the recorder onto portable hard drives for transport to shore. NDSF has drives for transporting the archive copies. The science party must provide the hard drives for its copy. We use and recommend portable RAID systems that contain two hard drives (currently 2TB) and are configured for RAID type 1 (1:1 mirroring). These drives must be formatted for the MacIntosh HFS+ filesystem. We currently limit total disk space for highlights to 8 TB per cruise.

Products

HDTV highlights files on science-provided hard drives

DVD-R media, labeled, in protective plastic clamshell case
MS Excel spreadsheet listing of

- DVD-R's: ID, Start/End Dates/Times, etc (see sample below)

- HDTV highlights metadata: start/stop time, original clip name, new name containing timestamp information, one-line description of activity shown in the highlight.

Pilot's pan/tilt 1 DVD-R, NDSF archive copy
  1 DVD-R, science party copy
Light bar cam 1 DVD-R, NDSF archive copy
  1 DVD-R, science party copy
Science pan/tilt 1 DVD-R, NDSF archive copy
  1 DVD-R, science party copy only

NDSF Archive Copy:
• Audio time code in right audio track
• FSK encoded Jason digital data in left audio track
• Unannotated/no video overlay
• Ship disposition: Jason data personnel for archiving
  Not available to science party unless absolutely necessary
• Final disposition: Shipped to WHOI by Jason Group
  Turned in to WHOI/NDSF Archives
  POC: WHOI/NDSF Archives personnel (508) 289-2538, 2850
  NDSF Archiving Policy

Science Party Copy:
• Audio time code or FSK encoded data or verbal commentary (choose 2)
• Annotated - user configurable video overlay annotation (if desired)
• Ship disposition: Property of Chief Sci/PI or designee for shipboard use
• Final disposition: Chief Sci/PI or designee
  Science party responsible for shipping media home at their cost
  NOTE: to prevent complete loss of all data, science copies MUST
  be shipped separately from the NDSF archive copies

Quantities/Day:
12 DVD-Rs: Science party copies of the pilot's pan/tilt camera
12 DVD-Rs: Science party copies of the light bar camera
12 DVD-Rs: Science party copies of the science pan/tilt camera

12 DVD-Rs: NDSF archive copies of the pilot's pan/tilt camera
12 DVD-Rs: NDSF archive copies of the light bar camera
12 DVD-Rs: NDSF archive copies of the science pan/tilt camera

Total: 72 DVD-Rs/24hrs (36 NDSF, 36 science)
10 days of 24/7 ops will produce 360 DVD-Rs delivered to the science party
     (120 pilot's P/T, 120 light bar camera, 120 science P/T)

Shipboard Real-Time Viewing

Video is distributed throughout the Jason control vans via a video routing system. Anyone working in the control vans will have access to the display of all video as required. Access to the vans is limited to those personnel on watch and any other personnel the Chief Scientist or watch leader designates as necessary. Other personnel are invited into the control vans on a space available and need basis.

A remote station, normally set up in the ship's Main Lab, will have four-way split screen and real-time science camera feed shown on two HD monitors.

For personnel working elsewhere in the ship, the four primary Jason/Medea video feeds are run into the ship's video distribution system (Table 1 above). Access and ease of viewing is dependent on the ship's video capabilities. The Jason Group does not provide equipment for viewing video within the ship. The science party must supply any additional monitors, cabling, etc. if there are additional requirements to view real time video beyond what the ship's video system is capable of providing.

Shipboard Post-Real-Time Processing

Post-real-time processing of the video, defined here as the ability to grab or digitize video clips, video editing, video compilation, etc. is primarily the responsibility of the science party depending on their specific needs. The Jason Group provides access to a DAC-100 DV Format Converter for science party use. This unit can be used to input video into standard consumer video editing/compilation software such as I-Movie, Windows DVD Creator, etc.

Related Files

Shipboard Duplication

The Jason Group provides a DVD/CD duplicator for shipboard use. It will produce two copies from one source disc.

The science party is responsible for carrying out all tasks involved in generating duplicate copies of science media. The science party must purchase and provide all media, cases and CD/DVD binders required and provide/assign personnel to carry out the duplication.  NOTE: even though DVD-R duplication is 3-4x faster than real time, generating a single copy of all three recorded streams from 10 days of use (360 DVD-Rs) will take a long time.

Non Standard Product - DVCam

If requested during the pre-cruise phase, NDSF will provide one Sony DSR1500 DVCam recorder deck for use by the science party. This recorder can be used to capture SD-SDI digital video produced by an annotation system (developed by NDSF) for an HD-SDI stream. This will yield higher quality video than the Y/C and composite Video Overlay Processor described earlier.

The unit cost/tape for the media ($25-$40/tape depending on the supplier) makes it cost prohibitive for DSL/NDSF to provide DVCam recording as one of its standard video products. The science party can decide whether they are interested in recording to DVCam, estimate usage and purchase and provide their own media.

If the science party intends to view and edit DVCAM recordings during the cruise, we suggest that the science party bring a second deck. This will provide a free unit for use while the NDSF unit is recording. It will also act as a backup unit.

Non-standard video recording media are not supplied by the Jason Group. Users must purchase/provide their own.

Media:
Sony PDV-124N digital video tape for Sony DSR-20 DVCam Recorder - 2 hours/tape
Sony PDV-184N digital video tape for Sony DSR-20 DVCam Recorder - 3 hours/tape

User Provided System(s)

The science party is free to provide their own recording system to be used in addition to the standard DVD-R provided. It cannot, however, be used instead of the standard DVD-R system.

The science party must supply ALL equipment, cables, and media for these systems. Due to limited space available in the control vans, there is no guarantee that these systems can be accommodated within the vans. In this case, video cables can be run to a ship laboratory for recording on these systems, but all cabling must be provided by the science party and all installation and operation carried out by the science party.

Jason personnel are not responsible for maintaining or servicing user-provided non-standard video systems in any way. This includes real-time watchstanding for media change out, etc. The science party must provide whatever additional personnel are needed to monitor these systems.

Investigators anticipating use of a non-standard system should contact Jason personnel to discuss needs and make necessary arrangements.

Post-Cruise Support

• NDSF Data Manager
• NDSF/archive copies - WHOI/NDSF Archives personnel, (508) 289-2865
• NDSF Archiving Policy
• Science party copies - contact the Chief Scientist

Last updated: April 4, 2013