Test Tasks

From ElphelWiki
Revision as of 11:30, 23 April 2013 by Oleg (talk | contribs)
Jump to: navigation, search

Area: IMU Data Processing

About

"An Inertial Measurement Unit (IMU) is an electronic device that measures and reports on a craft's velocity, orientation, and gravitational forces, using a combination of accelerometers and gyroscopes, sometimes also magnetometers..." © Wikipedia

We use ADIS16375 (fully compatible with ADIS16488) with a tri-axis gyroscope and a tri-axis accelerometer.

IMU, ADIS16375 in NC353L-369 camera
IMU in Eyesis4π
Fig.3 Positive rotation angles in the calibration machine
Fig.4 Goniometer
Fig.5 IMU acceleration data during the Eyesis4Pi calibration



Our projects


1. Images Relative Orientation

The goal is to find how the camera rotated/moved (Rotation Matrix) between the shots. Knowing the images' relative orientation allows to use this information for further 3D reconstruction.

2. ERS Correction

Our sensor is Aptina's MT9P006 - CMOS, 5MP, 1/2.5". It has an ERS (Electronic Rolling Shutter) - the image scan time is about 1/15 s (~66 ms) while IMU samples data at 2.460 kHz (T = 0.406 ms) which makes it possible to reconstruct how the camera moved during the image acquisition and correct the ERS effect by placing each pixel according to the sensor orientation at each moment of time. This only corrects the movement/rotation of the camera but not the ERS effect from the fast moving objects.



Test Tasks


Input Data

timestamp - timestamp of an image set taken at certain camera orientation during the calibration process. Seconds since January 1, 1970, the Time Zone is GMT
axial - angle in degrees about Z-axis (Fig.3)
tilt - angle in degrees about Y-axis (Fig.3)
Motor2 - motor 2 state in its steps
Motor3 - motor 3 state in its steps
NumPoints - applies to images only
RMS - applies to images only

A log file contains 3 types of records (events):
  a. (2.460kHz) IMU data
      - [localTimeStamp,GMT]: IMU:[gyroX][gyroY][gyroZ][angleX][angleY][angleZ][accelX][accelY][accelZ][veloX][veloY][veloZ][temperature]
      where original parameters are angular velocities and accelerations - delta angles and delta velocities represent an integration of original parameters.
  b. (5Hz) GPS data
      - [localTimeStamp,GMT]: GPS: $GPRMC,231112.2,A,4043.36963,N,11155.90616,W,000.00,089.0,250811,013.2,E
  c. (rare) Image-acquired event registered at local clock. 
      - [localTimeStamp,GMT]: SRC: [masterTimeStamp,GMT][localTimeStamp,GMT],
      knowing the master's timestamp is important for matching the events with the taken images - each image has a master timestamp in its EXIF header. 
      The local timestamp is just the time at which an event was registered.



Requirements

  • Programming language - Java



Task 1. Parse the IMU Data

Description
  • The IMU model is ADIS16375.
  • Learn how the log data parser works from the reference Java program.
  • Modify or write your own parser and plot the IMU data in a spreadsheet as Value(Time) (for accelerations and angular velocities) or Sum(Time) (for delta angles and delta velocities) for a given log file.
Comments

-

Output

A spreadsheet with plotted data.


Task 2. Estimating biases (zero drifts) of the IMU Data

Description
  • Determine the time intervals of when the camera is at rest.
  • Estimate the average biases (zero drifts) of ADIS16375 IMU output data when at rest. The formulas can be retrieved from the reference program.
Comments
  • The Camera-IMU system can be considered at rest within some time range from the image registration event - SRC-record in the log file. This range is also to be determined/estimated.
  • The first SRC-record is found in test.log-00002.
Output

Estimated zero drifts stored in a public variable and in an XML file.


Task 3. Calculating the IMU parameters more precisely

Description
Comments
  • Calculate the relative IMU rotation matrices for each state at which the pictures were acquired considering the calibration machine angles to be precise enough.
  • Knowledge of the precise initial IMU orientation is not needed - can be defined arbitrarily.
  • The first SRC-record is found in test.log-00001.
  • Max records in a log file 10,000,000.
Output

Calculated with a better precision IMU parameters in a public variable and in an XML file.

Links

Retrieved from "importwiki?title=Test_Tasks&oldid=13013


10353 series is a legacy product, previously used for Google Street View project



 Elphel-Eyesis 4π is a panoramic and stereophotogrammetric camera that covers full sphere with the same high resolution, with it's 24 x 5Mpix sensors.
  • Main Features:
    • 4*π (360x180) coverage
    • Calibrated fixed lens to compensate for the lenses distortions
      • 10" (0.1 pix) in the center 80% x 80% area
      • 30" (0.3 pix) maximal error over the full FoV
      • <0.03um/° thermal expansion
    • 26 * 5Mpix, 1/2.5" format image sensors
    • 130 MPix Total resolution
    • 64 MPix Panoramic image resolution after stitching
    • 5 FPS - maximum frame rate
    • Integrated high-precision IMU and GPS
    • Recording to internal SSDs
    • Web Based GUI
    • Free Software and Open Hardware
  • Physical Characteristics:
    • Weight 10 Kg
    • Size 230 x 1350 mm
    • Power Consumption - 50W
    • Weatherproof
Image samples
More Info
How to buy: We are directly accepting orders and ship worldwide. Please contact Elphel for Lead Time and Quotes:
NC353L series camera modules:

NC353L
 → + USB, SATA, Serial & Sync ports → + GPS receiver
+ IMU
+ Compact Flash card / Internal 1.8" HDD/SSD
+ Calibrated lens
+ Multiplexer board → + 2-3 sensors


NC353L series cameras' overview table:

NC353L -PHG -369 -GEO -IMU-GPS -HDD -PHG3 Stereo Hammer
ETH + + + + + + + + +
USB(host) + + + + + + +
SATA + + + + + + +
SYNC/TRIGGER + + + + + + +
CF card support + + + + + +
IMU +
GPS (usb or serial) + +
Internal 1.8" HDD/SSD + +/-
MUX board 2 sensors 2 sensors
Calibrated lens + +

The default power supply is 48V. 12V modification is available.

Other custom modifications (e.g., add/remove modules) are available for all products. Please send your inquiries to sales@elphel.com or call 801.783.5555x107

Price list     Order



Current sensor's (MT9P006 - 1/2.5", 5MPix, color or mono) Resolution-FPS table



Standard Resolution max. FPS (Color) max. FPS (JP4 RAW)
Full Resolution 2592x1936 10.6 14
2K 2048x1088 23.9 29.5
Full HD (1080p) 1920x1088 25.2 30.9
HD (720p) 1280x720 57.9 60
PAL DV 720x576 100 100
NTSC DV 640x480 126 126
512x512 129 129
320x240 310 310



LineScan mode is available.




Equirectangular projection

Rectilinear corrected

Elphel 353 Camera Brochure

Calibrated sensor front ends and the heptaclops camera blog article


Price list 		NC353-PHG is the NC353 series network camera with a calibrated M12 (S-mount) lens and thermally compensated (<0.03um/°) sensor front end intended for use in the area of photogrammetry.

Features:
  • Calibrated fixed lens to compensate for the lenses distortions
    • 10" (0.1 pix) in the center 80% x 80% area
    • 30" (0.3 pix) maximal error over the full FoV
    • <0.03um/° thermal expansion
  • By default the fixed lens is focused on ~4-∞ m
  • 5MPix, 1/2.5", color or mono MT9P006 sensor
  • Full HD video (1080p@25fps)
  • Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog

Custom modifications (e.g., 12V) are available for all products. Please send your inquiries to sales@elphel.com or call 801.783.5555x107

Equirectangular projection

Rectilinear corrected

Elphel 353 Camera Brochure

Calibrated sensor front ends and the heptaclops camera blog article

Matching Images Demo
Price list 		NC353-369-PHG3 (NC353-369-PHG based) is 3 network cameras with calibrated M12 (S-mount) lenses and thermally compensated (<0.03um/°) sensor front ends intended for use in the area of photogrammetry.

Features:
  • 3xNC353-369-PHGs with known fixed relative orientation between them (provided with the calibration files)
  • Cameras are precisely synchronized
  • Calibrated fixed lens to compensate for the lenses distortions
    • 10" (0.1 pix) in the center 80% x 80% area
    • 30" (0.3 pix) maximal error over the full FoV
    • <0.03um/° thermal expansion
  • By default the fixed lens is focused on ~4-∞ m
  • (3x) 5MPix, 1/2.5", color MT9P006 sensor
  • (3x) Full HD video (1080p@25fps)
  • (3x) Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog

Comparison table for PHG series three-lens cameras:

NC353L-369-PHG3 NC353L-369-PHG3-IMU
USB(host) + +
SATA + +
SYNC + +
IMU - +
GPS - +
Weight 1088g 1120g
Width 110mm 110mm
Height 99mm 113mm
Length 138mm 138mm

Custom modifications (e.g., 12V) are available for all products. Please send your inquiries to sales@elphel.com or call 801.783.5555x107

Showing current products. Legacy NC353L page is moved to nc353_legacy

10393 series

Order:
  • Email (Sales Inquiry): sales@elphel.com
  • Phone: (801) 783-5555 x 107
  • Price list




 10393 series are high performance network multi-sensor (multi-)camera systems designed to be as flexible as possible for a wide range of machine vision applications:

Features:
  • Free Software and Open Hardware
  • 100% Free Software (GNU GPLv3) FPGA image processing and compression
  • FPGA image de-warping (distortion correction) and robust multiple view depth extraction coming soon
  • User/developer friendly: Python, PHP, JavaScript, C/C++, Verilog, CGI
  • Operating System: OpenEmbedded GNU/Linux (Yocto build)
  • Hardware:
    • 5MPix or 14MPix, 1/2.5" format sensors
    • Xilinx Zynq 7030 SoC - Dual-core ARM Cortex-A9 + FPGA, 800MHz
    • RAM: 1GB (system) and 0.5 GB (fpga) DDR3 memory
    • 1 GB NAND Flash
    • 1 GigE
    • μSD
    • m.2 SSD
    • μUSB2
    • eSATA+USB2 - 2-in-1 port
    • 4x sensor ports - routed to FPGA, each reconfigurable for general multi-purpose use
    • External sync port
    • support other extension boards (IMU, GPS)
    • WiFi: through a USB WiFi adapter
  • Power:
    • 18-75V or 12-36V
  • Performance:
    • Low latency streaming (1080p@30fps - ~35ms + transfer & display)
  • Without lens or adapters:
    • WxHxL: 40x45x123 mm
    • Weight: 215g
  • User Manual
  • SDK (for fpga or c/c++ development, a lot of things can be implemented with just Python, PHP and JavaScript)
  • more info
Custom modifications (e.g., 12V) are available for all products.

Product table

Model name Description 3D model
NC393-F-CS
  • single sensor
  • optional: internal SSD, IMU, GPS
NC393-M2260-F-CS
  • single sensor
  • internal SSD
NC393-M2260-F-CS-IMU
  • single sensor
  • internal SSD
  • IMU: ADIS16375 (inquire about other models)
MNC393-XCAM
  • Quad sensor stereo, 3D reconstructed scenes demo
  • included:
    • 4x sensors
    • calibrated camera and lenses (thermally compensated sensor front ends)
    • internal SSD
  • optional:
    • GPS receiver, IMU
NC393-DEV
  • 1-4x sensors
  • optional: internal SSD, IMU, GPS
NC393-H
  • 4x sensors
  • 3D printed parts
  • optional: internal SSD, IMU, GPS

Order:








MNC393. Customizable multi-sensor cameras. Learn more.

Features:

  • 3D printed parts - our template or modified by customer
  • Base parts made from aluminum
  • Based on the new 10393 system board (see NC393-CS)

Order:


NC353L-369 is a model 353 series camera capable of recording video and images to the external SATA mass storage device or internal CF cards. Serial port provides access to the root console that simplifies firmware development. Features:
  • 5MPix, 1/2.5", color or mono MT9P006 sensor
  • Full resolution: 2592x1944@15fps
  • Full HD video (1080p@25fps)
  • Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog
  • SATA port
  • 2 internal slots for Compact Flash cards
  • Serial console port
  • Opto-isolated I/O port (RJ14 connector) to trigger the camera or synchronize together multiple cameras
  • Without lens or adapters:
    • Weight: 230g
    • Width:  44mm
    • Height: 45mm
    • Length: 118mm
Custom modifications (e.g., 12V) are available for all products.
Elphel 353 Camera Brochure
KIT-NC353L-369
KIT-NC353L-369-12V
Price list
NC353L-369-GEO is a model 353 series camera for making geotagged video and images. Features:
  • 5MPix, 1/2.5", color or mono MT9P006 sensor
  • Full resolution: 2592x1944@15fps
  • Full HD video (1080p@25fps)
  • Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog
  • SATA port
  • 2 internal slots for Compact Flash cards
  • Serial console port
  • Opto-isolated I/O port (RJ14 connector) to trigger the camera or synchronize together multiple cameras
  • Ocean Server OS5000-US Digital compass (inside the camera)
  • Available GPS receivers (NMEA 0183):
  • Without lens , adapters and GPS receiver:
    • Weight: 230-235g
    • Width: 44mm
    • Height: 45mm
    • Length: 118mm
Elphel 353 Camera Brochure
Elphel 353 Camera Brochure KIT-NC353L-369-GEO
Price list
NC353L-369-HDD is a model 353 series camera with attached 1.8" for direct recording images/video. It includes:
  • 5MPix, 1/2.5", color or mono MT9P006 sensor
  • Full resolution: 2592x1944@15fps
  • Full HD video (1080p@25fps)
  • Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog
  • SATA port
  • 2 internal slots for Compact Flash cards
  • Serial console port
  • Opto-isolated I/O port (RJ14 connector) to trigger the camera or synchronize together multiple cameras
  • 1.8" 120GB ZIF-type HDD (options available)
  • Without lens or adapters:
    • Weight: ~400g
    • Width:  44mm (body), 60mm (HDD enclosure)
    • Height: 45mm (body), +12mm (HDD enclosure)
    • Length: 118mm (body), 90mm (HDD enclosure)
Elphel 353 Camera Brochure
KIT-NC353L-369-HDD
Price list
Order:
  • Email (Sales Inquiry): sales@elphel.com
  • Phone: (801) 783-5555 x 107
Learn more:


MNC393-XCAM is a Quad-sensor Stereo Camera.
Applications:
  • Long distance passive ranging - for 250mm base: at 2000m distance the error is 10%
  • 3D scene reconstruction
  • High resolution (2592x1936), high frame rate (14 fps max) photogrammetry
  • Real-time, low latency image acquisition and processing
  • One of our applications includes usage this camera's processed image sets in a convolutional neural network (CNN). Read more
3D reconstructed scene demo integrated with maps
More information
Price list


Eyesis4Pi-393 is the newest generation of the full-sphere multi-camera systems for stereophotogrammetric applications.
  • The system is calibrated to compensate for optical aberrations allowing to preserve full sensor resolution over the field of view.
  • Distortion calibration is performed for precise pixel-mapping to automatically stitch images into panoramas, and also for photogrammetry and 3D reconstruction.  
  • There are 24 x 5MPix sensors in the camera head, resulting in 120 MPix image acquisition. Panorama image resolution after stitching is 64 MPix, the equirectangular projection is 14000x7000.
  • High-precision Inertial Measurement Unit IMU (ADIS 16375, 2400 samples per second) is integrated with the camera, as well as 5Hz GPS (Locosys LS20031) to provide precise position and orientation of the camera.
  • Images, synchronized with IMU and GPS data, can be recorded to internal Solid State Drives (SSD), external swappable SSDs or to a PC over the network.
  • Optionally Eyesis4Pi-393 camera system includes PC for image downloading and post-processing with pre-installed SDK and Free and Open Source Software for camera calibration, image acquisition and panorama stitching.
  • Eyesis4Pi-393 can be mounted on a car for outdoor panoramic applications or carried by a person, which lets successfully create panoramas of small and narrow spaces.*

Automated panoramic imagery and 3-dimensional panoramas are the 2 main applications of Eyesise4Pi-393 camera.

More information










MNC393. Customizable multi-sensor cameras. Learn more.

Features:

  • 3D printed parts - our template or modified by customer
  • Base parts made from aluminum
  • Based on the new 10393 system board (see NC393-CS)

Order:


Hammer camera setup (MNC354-2B, MNC354-2B-HDD) utilises 2 sensors front ends and the 10359 multiplexer board to record synced stereo video. Features:
  • 5MPix, 1/2.5", color or mono MT9P006 sensor
  • Full resolution: 2592x1944@15fps
  • Full HD video (1080p@25fps)
  • Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog
  • SATA port
  • 2 internal slots for Compact Flash cards
  • Serial console port
  • Opto-isolated I/O port (RJ14 connector) to trigger the camera or synchronize together multiple cameras
  • 1.8" 120GB ZIF-type HDD (optional)
  • 2 sensor modules connected to a single system board
Elphel 353 Camera Brochure Price list
NC353L-369-IMU-GPS allows to save a separate log from Inertial Measurement Unit (orientation) and a GPS receiver (USB or serial)
  • 5MPix, 1/2.5", color or mono MT9P006 sensor
  • Full resolution: 2592x1944@15fps
  • Full HD video (1080p@25fps)
  • Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog
  • SATA port
  • 2 internal slots for Compact Flash cards
  • Serial console port
  • Opto-isolated I/O port (RJ14 connector) to trigger the camera or synchronize together multiple cameras
Elphel 353 Camera Brochure
KIT-NC353L-369-IMU/GPS
Price list
Tags: 
353
Free Software
open hardware
network camera