Elphel Eyesis4Pi

From ElphelWiki
Revision as of 06:32, 10 August 2011 by OneArtPlease (talk | contribs) (About)
Jump to: navigation, search

About

Eyesis4Pi Dimensions (mm)
Eyesis4Pi Head Contents Schematic
Eyesis4Pi Pole Contents Schematic

Elphel Eyesis4Pi is an open hardware / free software panoramic camera solution that is able to capture high-resolution - 64 MPix total (120 MPix before stitching) - 360° panoramas at a rate up to 5 frames per second at full resolution. It is the successor of the Elphel Eyesis. Images are recorded to 8 solid-state-discs (Eyesis4Pi Data Storage) which can store up to 11 hours of footage at full resolution. Meta-data like GPS-coordinates (geotags), viewing direction, movement speed, etc. are directly embedded into the images EXIF fields. Eyesis4Pi uses 24 sensor-front-ends and high-grade lenses that are triggered simultaneously with microsecond accuracy to ensure a full homogeneous spherical snapshot.

Usage Scenarios

The system was designed to be small and lightweight with a minimal distance between the entrance pupils (46.5mm) to achieve lowest possible parallax.

The primary usage scenario is to mount Eyesis4Pi on the roof of a vehicle. When driving at 50 mph (22.3 m/s) and recording at 5 FPS a full panorama is captured every 4.46 meters.

Operation & Monitoring

Eyesis is controlled from a laptop, via a web-based interface (Eyesis GUI). Which also displays real-time previews of your captured panorama footage.

Eyesis is supplied with 110V/220V AC and can be used with car power adapter (inverter), when mounted on a car roof. Power consumption is around ???W.

Models

4π (or 4Pi) corresponds to a full full spherical (360°x180°) field of view in steradians.

There are 2 version of the camera Eyesis4Pi with 24 image sensors and full spherical field of view and Eyesis3Pi with 16 sensors (without 8 bottom modules) with slightly smaller field of view.

Comparison between Eyesis and Eyesis4Pi

Parameter
Eyesis

Eyesis4Pi

(Eyesis 3Pi without 8 bottom modules)

Notes
Combined field of view (steradians)
3*π
4*π (3*π)
Number of image sensors
9
24 (16)

Angular resolution +/-30° from the horizon
≥4.2Mpix/steradian
≥4.2Mpix/steradian
1
Angular resolution +30° to +90°(zenith)
≥0.83Mpix/steradian
≥4.2Mpix/steradian 1
Angular resolution -30° to -90°(nadir) none ≥4.2Mpix/steradian (none) 1
Combined megapixels 45.0 120.0 (80.0)
Combined megapixels (w/o overlapping areas) 34.0 64.0 (48.0)
Combined megapixels (w/o overlapping areas,
worst case resolution)
29.0 52.8 (39.6) 1,2
Distance between entrance pupils
of adjacent horizontal lenses
34.5mm 46.5mm
Distance between entrance pupils
of horizontal and top/bottom lenses
75mm 50mm 3
Maximal frame rate 5fps 5fps 4
Maximal recording data rate 48MB/s 128MB/s (96Mb/s)
Maximal direct network data rate 30MB/s 80MB/s (60MB/s)
GPS receiver external, USB External/internal, USB/RS232
GPS pulse-per-second input no
yes

IMU none ADIS163xx,ADIS164xx
Data unload removable SSD in cradles eSATAx2
Storage devices type 2.5″ SSD 1.8″SSD
Number of storage devices 3
8 (6)


Notes:

  1. Angular resolution per pixel differs in the sub-camera FOV, minimal resolution is used.
  2. Zenith area for Eyesis (covered by fisheye lens) is calculated separately.
  3. For Eyesis the distance is measured from the entrance pupil of the horizontal lens to that of the top fisheye, for Eysis-4pi – to the entrance pupil of the lens immediately above/below the first one.
  4. Frame rate may be limited by the recording (or network if the SSD are not used) datarate for high compression quality (>0.3 bytes/pixel), required for the aberration correction.


Calibration

The sensor-front-ends (SFE) - which were especially developed for Eyesis4Pi - allow the focus plane to be shifted and rotated with very high accuracy. This allows extremely precise calibration of each lens and SFE which is done with every Eyesis4Pi during assembly with custom developed software. Check out this Elphel Development Blog post for more details.

Tech specs

Eyesis4Pi Camera

  • 24x Color 5Mpix CMOS sensors in array
  • Resolution - 64MPix (120MPix before stitching)
  • Up to 5 FPS at full resolution (120Mpix)
  • highly customizable
  • Web-based GUI
  • GPS powered geo-tagging
  • IMU powered 3D inertial measurement
  • Precise image capture synchronization
  • RAW or compressed image formats
  • High resolution lenses: 24x M12 lens mount
  • Very small parallax - distance between entrance pupils: 46.5 mm
  • Weatherproof camera body and camera pole


Eyesis Data Storage

  • located inside weatherproof camera pole
  • 8x swappable ???GB - 1.8" - SSDs (Total ???GB)
  • Enough space for up to ?? hours of full Resolution/FPS footage (depending on quality settings and actual image content)


Eyesis Computer

The Eyesis Computer is a high-end-workstation with small form factor. It is intended for image post-processing and not required for recording footage.

It comes with all Elphel developed software and tools required for processing panoramic images preinstalled.

  • Small form factor Shuttle PC
  • Intel Core i7-950 Quad-Core Processor
  • 16 GB DDR3 RAM
  • GeForce GTX 465 (Fermi) 1GB
  • 2 TB HDD


Tech Specs of a Single Image Sensor (Eyesis4Pi uses 24 of these, Eyesis3Pi uses 26 of these)

Color Image Sensor 1/2.5" bayer-pattern CMOS
Effective number of pixels 2592x1936 (5,018,112 pixels)
Aspect Ratio Chip 4:3, Region of interest freely adjustable in 16 pixel steps
Sensor Output 12 Bit ADC
Sensor Features Region of interest, on-chip binning and decimation
Dynamic Range 70 db (76 db at 2x2 binning)
Electronic Shutter 1 us to "very long" (~3h) in 1us steps
Gain Analog & Digital (0 db to 12 db continuous)
Retrieved from "importwiki?title=Elphel_Eyesis4Pi&oldid=10599


10353 series is a legacy product, previously used for Google Street View project




Elphel-Eyesis 4π is a panoramic and stereophotogrammetric camera that covers full sphere with the same high resolution, with it's 24 x 5Mpix sensors.
  • Main Features:
    • 4*π (360x180) coverage
    • Calibrated fixed lens to compensate for the lenses distortions
      • 10" (0.1 pix) in the center 80% x 80% area
      • 30" (0.3 pix) maximal error over the full FoV
      • <0.03um/° thermal expansion
    • 26 * 5Mpix, 1/2.5" format image sensors
    • 130 MPix Total resolution
    • 64 MPix Panoramic image resolution after stitching
    • 5 FPS - maximum frame rate
    • Integrated high-precision IMU and GPS
    • Recording to internal SSDs
    • Web Based GUI
    • Free Software and Open Hardware
  • Physical Characteristics:
    • Weight 10 Kg
    • Size 230 x 1350 mm
    • Power Consumption - 50W
    • Weatherproof
Image samples
More Info
How to buy: We are directly accepting orders and ship worldwide. Please contact Elphel for Lead Time and Quotes:
NC353L series camera modules:

NC353L
+ USB, SATA, Serial & Sync ports + GPS receiver
+ IMU
+ Compact Flash card / Internal 1.8" HDD/SSD
+ Calibrated lens
+ Multiplexer board + 2-3 sensors


NC353L series cameras' overview table:

NC353L -PHG -369 -GEO -IMU-GPS -HDD -PHG3 Stereo Hammer
ETH + + + + + + + + +
USB(host) + + + + + + +
SATA + + + + + + +
SYNC/TRIGGER + + + + + + +
CF card support + + + + + +
IMU +
GPS (usb or serial) + +
Internal 1.8" HDD/SSD + +/-
MUX board 2 sensors 2 sensors
Calibrated lens + +

The default power supply is 48V. 12V modification is available.

Other custom modifications (e.g., add/remove modules) are available for all products. Please send your inquiries to sales@elphel.com or call 801.783.5555x107

Price list     Order



Current sensor's (MT9P006 - 1/2.5", 5MPix, color or mono) Resolution-FPS table



Standard Resolution max. FPS (Color) max. FPS (JP4 RAW)
Full Resolution 2592x1936 10.6 14
2K 2048x1088 23.9 29.5
Full HD (1080p) 1920x1088 25.2 30.9
HD (720p) 1280x720 57.9 60
PAL DV 720x576 100 100
NTSC DV 640x480 126 126
512x512 129 129
320x240 310 310



LineScan mode is available.





Equirectangular projection

Rectilinear corrected

Elphel 353 Camera Brochure

Calibrated sensor front ends and the heptaclops camera blog article


Price list
NC353-PHG is the NC353 series network camera with a calibrated M12 (S-mount) lens and thermally compensated (<0.03um/°) sensor front end intended for use in the area of photogrammetry.

Features:
  • Calibrated fixed lens to compensate for the lenses distortions
    • 10" (0.1 pix) in the center 80% x 80% area
    • 30" (0.3 pix) maximal error over the full FoV
    • <0.03um/° thermal expansion
  • By default the fixed lens is focused on ~4-∞ m
  • 5MPix, 1/2.5", color or mono MT9P006 sensor
  • Full HD video (1080p@25fps)
  • Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog

Custom modifications (e.g., 12V) are available for all products. Please send your inquiries to sales@elphel.com or call 801.783.5555x107


Equirectangular projection

Rectilinear corrected

Elphel 353 Camera Brochure

Calibrated sensor front ends and the heptaclops camera blog article

Matching Images Demo
Price list
NC353-369-PHG3 (NC353-369-PHG based) is 3 network cameras with calibrated M12 (S-mount) lenses and thermally compensated (<0.03um/°) sensor front ends intended for use in the area of photogrammetry.

Features:
  • 3xNC353-369-PHGs with known fixed relative orientation between them (provided with the calibration files)
  • Cameras are precisely synchronized
  • Calibrated fixed lens to compensate for the lenses distortions
    • 10" (0.1 pix) in the center 80% x 80% area
    • 30" (0.3 pix) maximal error over the full FoV
    • <0.03um/° thermal expansion
  • By default the fixed lens is focused on ~4-∞ m
  • (3x) 5MPix, 1/2.5", color MT9P006 sensor
  • (3x) Full HD video (1080p@25fps)
  • (3x) Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog

Comparison table for PHG series three-lens cameras:

NC353L-369-PHG3 NC353L-369-PHG3-IMU
USB(host) + +
SATA + +
SYNC + +
IMU - +
GPS - +
Weight 1088g 1120g
Width 110mm 110mm
Height 99mm 113mm
Length 138mm 138mm

Custom modifications (e.g., 12V) are available for all products. Please send your inquiries to sales@elphel.com or call 801.783.5555x107

Showing current products. Legacy NC353L page is moved to nc353_legacy

10393 series

Order:
  • Email (Sales Inquiry): sales@elphel.com
  • Phone: (801) 783-5555 x 107
  • Price list





10393 series are high performance network multi-sensor (multi-)camera systems designed to be as flexible as possible for a wide range of machine vision applications:

Features:
  • Free Software and Open Hardware
  • 100% Free Software (GNU GPLv3) FPGA image processing and compression
  • FPGA image de-warping (distortion correction) and robust multiple view depth extraction coming soon
  • User/developer friendly: Python, PHP, JavaScript, C/C++, Verilog, CGI
  • Operating System: OpenEmbedded GNU/Linux (Yocto build)
  • Hardware:
    • 5MPix or 14MPix, 1/2.5" format sensors
    • Xilinx Zynq 7030 SoC - Dual-core ARM Cortex-A9 + FPGA, 800MHz
    • RAM: 1GB (system) and 0.5 GB (fpga) DDR3 memory
    • 1 GB NAND Flash
    • 1 GigE
    • μSD
    • m.2 SSD
    • μUSB2
    • eSATA+USB2 - 2-in-1 port
    • 4x sensor ports - routed to FPGA, each reconfigurable for general multi-purpose use
    • External sync port
    • support other extension boards (IMU, GPS)
    • WiFi: through a USB WiFi adapter
  • Power:
    • 18-75V or 12-36V
  • Performance:
    • Low latency streaming (1080p@30fps - ~35ms + transfer & display)
  • Without lens or adapters:
    • WxHxL: 40x45x123 mm
    • Weight: 215g
  • User Manual
  • SDK (for fpga or c/c++ development, a lot of things can be implemented with just Python, PHP and JavaScript)
  • more info
Custom modifications (e.g., 12V) are available for all products.

Product table


Model name Description 3D model
NC393-F-CS
  • single sensor
  • optional: internal SSD, IMU, GPS
NC393-M2260-F-CS
  • single sensor
  • internal SSD
NC393-M2260-F-CS-IMU
  • single sensor
  • internal SSD
  • IMU: ADIS16375 (inquire about other models)
MNC393-XCAM
  • Quad sensor stereo, 3D reconstructed scenes demo
  • included:
    • 4x sensors
    • calibrated camera and lenses (thermally compensated sensor front ends)
    • internal SSD
  • optional:
    • GPS receiver, IMU
NC393-DEV
  • 1-4x sensors
  • optional: internal SSD, IMU, GPS
NC393-H
  • 4x sensors
  • 3D printed parts
  • optional: internal SSD, IMU, GPS

Order:








MNC393. Customizable multi-sensor cameras. Learn more.

Features:

  • 3D printed parts - our template or modified by customer
  • Base parts made from aluminum
  • Based on the new 10393 system board (see NC393-CS)

Order:



NC353L-369 is a model 353 series camera capable of recording video and images to the external SATA mass storage device or internal CF cards. Serial port provides access to the root console that simplifies firmware development. Features:
  • 5MPix, 1/2.5", color or mono MT9P006 sensor
  • Full resolution: 2592x1944@15fps
  • Full HD video (1080p@25fps)
  • Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog
  • SATA port
  • 2 internal slots for Compact Flash cards
  • Serial console port
  • Opto-isolated I/O port (RJ14 connector) to trigger the camera or synchronize together multiple cameras
  • Without lens or adapters:
    • Weight: 230g
    • Width:  44mm
    • Height: 45mm
    • Length: 118mm
Custom modifications (e.g., 12V) are available for all products.
Elphel 353 Camera Brochure
KIT-NC353L-369
KIT-NC353L-369-12V
Price list

NC353L-369-GEO is a model 353 series camera for making geotagged video and images. Features:
  • 5MPix, 1/2.5", color or mono MT9P006 sensor
  • Full resolution: 2592x1944@15fps
  • Full HD video (1080p@25fps)
  • Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog
  • SATA port
  • 2 internal slots for Compact Flash cards
  • Serial console port
  • Opto-isolated I/O port (RJ14 connector) to trigger the camera or synchronize together multiple cameras
  • Ocean Server OS5000-US Digital compass (inside the camera)
  • Available GPS receivers (NMEA 0183):
  • Without lens , adapters and GPS receiver:
    • Weight: 230-235g
    • Width: 44mm
    • Height: 45mm
    • Length: 118mm
Elphel 353 Camera Brochure
Elphel 353 Camera Brochure KIT-NC353L-369-GEO
Price list

NC353L-369-HDD is a model 353 series camera with attached 1.8" for direct recording images/video. It includes:
  • 5MPix, 1/2.5", color or mono MT9P006 sensor
  • Full resolution: 2592x1944@15fps
  • Full HD video (1080p@25fps)
  • Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog
  • SATA port
  • 2 internal slots for Compact Flash cards
  • Serial console port
  • Opto-isolated I/O port (RJ14 connector) to trigger the camera or synchronize together multiple cameras
  • 1.8" 120GB ZIF-type HDD (options available)
  • Without lens or adapters:
    • Weight: ~400g
    • Width:  44mm (body), 60mm (HDD enclosure)
    • Height: 45mm (body), +12mm (HDD enclosure)
    • Length: 118mm (body), 90mm (HDD enclosure)
Elphel 353 Camera Brochure
KIT-NC353L-369-HDD
Price list

Order:
  • Email (Sales Inquiry): sales@elphel.com
  • Phone: (801) 783-5555 x 107

Learn more:


MNC393-XCAM is a Quad-sensor Stereo Camera.
Applications:
  • Long distance passive ranging - for 250mm base: at 2000m distance the error is 10%
  • 3D scene reconstruction
  • High resolution (2592x1936), high frame rate (14 fps max) photogrammetry
  • Real-time, low latency image acquisition and processing
  • One of our applications includes usage this camera's processed image sets in a convolutional neural network (CNN). Read more
3D reconstructed scene demo integrated with maps
More information
Price list



Eyesis4Pi-393 is the newest generation of the full-sphere multi-camera systems for stereophotogrammetric applications.
  • The system is calibrated to compensate for optical aberrations allowing to preserve full sensor resolution over the field of view.
  • Distortion calibration is performed for precise pixel-mapping to automatically stitch images into panoramas, and also for photogrammetry and 3D reconstruction.  
  • There are 24 x 5MPix sensors in the camera head, resulting in 120 MPix image acquisition. Panorama image resolution after stitching is 64 MPix, the equirectangular projection is 14000x7000.
  • High-precision Inertial Measurement Unit IMU (ADIS 16375, 2400 samples per second) is integrated with the camera, as well as 5Hz GPS (Locosys LS20031) to provide precise position and orientation of the camera.
  • Images, synchronized with IMU and GPS data, can be recorded to internal Solid State Drives (SSD), external swappable SSDs or to a PC over the network.
  • Optionally Eyesis4Pi-393 camera system includes PC for image downloading and post-processing with pre-installed SDK and Free and Open Source Software for camera calibration, image acquisition and panorama stitching.
  • Eyesis4Pi-393 can be mounted on a car for outdoor panoramic applications or carried by a person, which lets successfully create panoramas of small and narrow spaces.*

Automated panoramic imagery and 3-dimensional panoramas are the 2 main applications of Eyesise4Pi-393 camera.

More information












MNC393. Customizable multi-sensor cameras. Learn more.

Features:

  • 3D printed parts - our template or modified by customer
  • Base parts made from aluminum
  • Based on the new 10393 system board (see NC393-CS)

Order:


Hammer camera setup (MNC354-2B, MNC354-2B-HDD) utilises 2 sensors front ends and the 10359 multiplexer board to record synced stereo video. Features:
  • 5MPix, 1/2.5", color or mono MT9P006 sensor
  • Full resolution: 2592x1944@15fps
  • Full HD video (1080p@25fps)
  • Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog
  • SATA port
  • 2 internal slots for Compact Flash cards
  • Serial console port
  • Opto-isolated I/O port (RJ14 connector) to trigger the camera or synchronize together multiple cameras
  • 1.8" 120GB ZIF-type HDD (optional)
  • 2 sensor modules connected to a single system board
Elphel 353 Camera Brochure Price list

NC353L-369-IMU-GPS allows to save a separate log from Inertial Measurement Unit (orientation) and a GPS receiver (USB or serial)
  • 5MPix, 1/2.5", color or mono MT9P006 sensor
  • Full resolution: 2592x1944@15fps
  • Full HD video (1080p@25fps)
  • Ethernet: 100 Mbit/s
  • Recording formats: Quicktime, OGM, JPEG image sequence, JP4 RAW image
  • Free Software and Open Hardware
  • User/developer friendly: HTML, JavaScript, PHP, CGI, C/C++, Verilog
  • SATA port
  • 2 internal slots for Compact Flash cards
  • Serial console port
  • Opto-isolated I/O port (RJ14 connector) to trigger the camera or synchronize together multiple cameras

Elphel 353 Camera Brochure
KIT-NC353L-369-IMU/GPS
Price list