プレゼンテーション CA378 AOIS Software Setup Guide Raspi3 Ver1.0.0

Version 1.0.0

Dated: 2017/12/21

Home Page http://www.centuryarks.com/

CA378-AOIS for Raspberry Pi 3

Software Setup Guide

History

Date Version Comment

2017/12/21 v1.0.0 Initial Release

Contents

1. Environment configuration

2. Software install

3. Demonstration functions

3.1. Focus & OIS

3.2. High-speed video recording

3.3. 4K3K-resolution(12Mpixel) still image capturing

3.4. HDR still image capturing

Appendix

A.1. Directory structure

A.2. Setting file

1. Environment configuration

★Before installing the CA 378-AOIS software, please implement the following environment.

・Prerequisites

1. Basic setting of Rasbian (OS) is complete in your environment

2. SSP Library Install

Installation procedure:

(1) Register as user at Vision Processing Community.

https://www.visionproc.org/login_new_account.php?lang=en

(2) Download “SSP library 1.28” from the following site.

https://www.visionproc.org/download.php

(3) Install according to the procedure

https://www.visionproc.org/ssp_usage.php

※ By the following procedure,

Performance such as Start-up time / OIS initialization / Auto focus can be improved.

· Change of I2C communication speed

1. Open "/boot/config.txt" with an editor.

2. Add the following parameters.

3. Save the file and restart Raspberry Pi.

$ sudo nano /boot/config.txt

dtparam=i2c_baudrate=400000

1. Environment configuration

2. Software install

Please install by the following procedure.

· Installation procedure

1. Download " demo_v1.0.0_pi3.tar.gz " from the following site.

https://github.com/centuryarks/Sample/releases

2. Unzip the "demo_v1.0.0_pi3.tar.gz" file.

3. Execute "Install.sh" in the extracted folder.

4. A shortcut is created on the desktop.

Demo.sh

Hispeed.sh

$ cd demo

$ ./Install.sh

$ tar zxvf demo_v1.0.0_pi3.tar.gz

$ wget --no-check-certificate https://github.com/centuryarks/Sample/releases/download/v1.0/demo_v1.0.0_pi3.tar.gz

3. Demonstration functions

3.1. Focus & OIS

3.2. High-speed video recording

3.3. 4K3K-resolution(12Mpixel) still image capturing

3.4. HDR still image capturing

Procedure of starting Focus & OIS:

1. Click "demo.sh" on the desktop.

2. Click [Execute in Terminal].

3. After a while the GUI screen will be displayed.

4. Please change the distance of the object, or move the camera, confirm the function.

* For details of functions, refer to page 10-11.

3.1. Focus & OIS

Procedure of finishing Focus & OIS:

1. Click the [x]

3.1. Focus & OIS

The following section describes each function of Focus & OIS.

Function Description

LSC Check to enable shading correction.

※ Theoretical values have been set.

Focus Mode Direct: Directly specify the focus position.

Infinity: Set the focus position to infinity.

Macro: Set the focus position to the short distance.

Focus Position: Focus position.

Apply: Apply the settings.

Auto Focus ON: Enable auto focus.

Auto Focus OFF: Disable auto focus.

* Current debug control is for demo.

OIS Mode OFF: Disable OIS.

It corresponds to each OIS mode.

Zero Shutter

Exposure / Shake eval.

Movie

High SR Movie

View Finder

Apply: Apply the settings.

Still Capture 12M Normal: Capture 12Mpixel normal still image.

12M HDR: Capture 12Mpixel HDR still image.

3.1. Focus & OIS

Description of the script file:

It describes about the “script/preview.sh".

#!/bin/sh

cd /home/pi/demo

./bin/highspeed ./profile/IMX378_640x480_4x4.xml 953 256 2372 IMX378

Function Description

The first argument Specify the VPF profile.

The second argument Specify the analog gain.

Range: 0 – 978

Analog Gain = 1024 / (1024 –value)

The third argument Specify the digital gain.

Range: 256 to 4057

Digital gain = value / 256 [times]

The fourth argument Specify the shutter speed.

Conditions:

Long exposure: None

COARSE_INTEG_TIME = 500 (fourth argument)

LINE_LENGTH_PCK = 3000 (specified in the profile of the first argument)

Pixel rate [pixels / s] = 210 [MHz] * 4

Example:

Exposure time = (500 * 3000) / (210 [MHz] * 4) = 1.785 [msec]

Frame rate = 560 [fps]

* Please understand that Frame rate does not rise only by changing shutter speed.

The fifth argument specify IMX 378

3.1. Focus & OIS

Procedure of starting high-speed video recording:

1. Click "highspeed.sh" on the desktop.

2. Click [Execute in Terminal].

3. Preview will start automatically when you start up.

4. Press the [r] key on the keyboard at the timing you want to shoot.

* For detailed operation, refer to page 15

3.2. High-speed video recording

Procedure of finishing high-speed video recording:

(1) If you press any of [w], [W], [a] on the keyboard, you can save captured data in the specified format.

([w]: uncompressed, [W]: Motion JPEG, [a]: MP 4)

(2) Press [q] on the keyboard.

(* It does not exit even if clicking the [x] button.)

(3) Saved image data can be edited / played with general software.

#!/bin/sh

cd /home/pi/demo

#./bin/highspeed ./profile/IMX378_640x480_250fps_10bit_2lane.xml 978 384 1000 IMX378

./bin/highspeed ./profile/IMX378_640x200_500fps_10bit_2lane.xml 978 768 500 IMX378

By exchanging the third and fourth rows,

You can change the image size and frame rate.

3.2. High-speed video recording

Description of the script file:

It describes about the “script/highspeed.sh".

Function Description

The first argument Specify the VPF profile.

The second argument Specify the analog gain.

Range: 0 – 978

Analog Gain = 1024 / (1024 –value)

The third argument Specify the digital gain.

Range: 256 to 4057

Digital gain = value / 256 [times]

The fourth argument Specify the shutter speed.

Conditions:

Long exposure: None

COARSE_INTEG_TIME = 500 (fourth argument)

LINE_LENGTH_PCK = 3000 (specified in the profile of the first argument)

Pixel rate [pixels / s] = 210 [MHz] * 4

Example:

Exposure time = (500 * 3000) / (210 [MHz] * 4) = 1.785 [msec]

Frame rate = 560 [fps]

* Please understand that Frame rate does not rise only by changing shutter speed.

The fifth argument specify IMX 378

The following section describes the functions of high-speed video recording.

Activate SSP Viewer and correspond to the following key command.

Command Description

q Quit

rGo to recording mode

vGo to real-time preview mode

wMovie file output (uncompressed)

W Movie file output (Motion JPEG format)

a Movie file output (MP4 format)

pPause

s Jump to start frame

e Jump to end frame

zExport current frame

xExport entire frames

tToggle show /hide message

Command Description

0 to 5 Adjust preview speed

9Play with skipping 5 frames

8Play without skipping

[Space] Show next frame

mShow back frame

fForward 100 frames

bBack 100 frames

FForward 200 frames

BBack 200 frames

c Perform simple white balance gain adjustment

3.2. High-speed video recording

Procedure of capturing 12Mpixel still image:

1. Adjust the focus.

(It is useful to turn on Auto Focus and turn Auto Focus OFF when focus is on)

2. Click the [12M Normal] button

3.3. 12Mpixel still image capturing

3. The image is taken at the timing when Frame count becomes 20 (initial setting).

(Currently you can use only in the countdown system, manual push is planned for the future.)

4. The display method is explained in the following two procedures.

(1) How to display still images with Raspberry Pi

(2) How to display still images in environments such as PCs and smartphones.

3.3. 12Mpixel still image capturing

(1) How to display still images with Raspberry Pi:

1. Install UFRaw.

2. Start UFRaw.

3. Select "/home/pi/demo/IMX378_3968x3008.dng".

4. Set the color management Camera profile to "No profile".

5. Set Gamma to "1.0".

34

$ sudo apt-get update

$ sudo apt-get install ufraw

$ ufraw

5

3.3. 12Mpixel still image capturing

(2) How to display still images in environments such as PCs and smartphones:

1. Please download "/home/pi/demo/IMX378_3968x3008.dng" on PC or smartphone with WinSCP etc.

2. Display dng file with Adobe Photoshop Lightroom etc.

※ Please set the color management function to none.

12

* In order to perform accurate color management,

adjustment of color management is required separately.

3.3. 12Mpixel still image capturing

Procedure of capturing HDR still image:

1. Adjust the focus.

(It is useful to turn on Auto Focus and turn Auto Focus OFF when focus is on)

2. Click the [12M HDR] button.

3.4. HDR still image capturing

3. The image is taken at the timing when Frame count becomes 10.

(Currently you can use only in the countdown system, manual push is planned for the future.)

4. The display method is the same as 12M still image shooting.

* Refer to the procedure of page 18-19.

* Only with extracting long storage and short storage,

HDR setting and tone mapping method will be described in separate document.

4

3

3.4. HDR still image capturing

Appendix

A.1. About the directory structure

The following section describes the directory structure of the software.

Function Descripution

bin DemoGUI: Demonstration software

Demo.ini: Demonstration software setting file

Highspeed: High-speed video recording program

raw2dng: RAW to dng file converting program

raw2hdr: Program that extracts HDR long storage and short

storage from RAW

stillsampleRAW 16: Still image capturing program

profile This is a profile describing register values to send to the

sensor.

You can use the profile used in VPF as it is.

script Script files are described.

It can be customized according to specifications.

demo.sh

highspeed.sh

preview.sh

stillCapture12M_HDR.sh

stillCapture12M_Normal.sh

src It is a set of demo software source code.

A.2. About the setting file

The following section describes the "demo.ini" of the setting file.

# DEMO Setting

preview = /home/pi/demo/script/preview.sh

stillCapture12M_Normal = /home/pi/demo/script/stillCapture12M_Normal.sh

stillCapture12M_HDR = /home/pi/demo/script/stillCapture12M_HDR.sh

stillCaptureFrame = 20

gyroGainRateX=1.0

gyroGainRateY=1.0

autoFocusGain=2.0

autoFocusConfidenceThreshold=10

autoFocusMoveLimit=100

Function Description

preview Script path for preview

stillCapture12M_Normal Script path for capturing 12M normal still images

stillCapture12M_HDR Script path for capturing 12M HDR still image

stillCaptureFrame You can specify the countdown frame for still

image capturing.

* If it is set to 10 or less, it is possible to fail.

gyroGainRateX

gyroGainRateY

It is valid only when OIS calibration result is

written in EEPROM.

Currently, since the value of Gyro gain is too

effective, the rate is adjusted.

autoFocusGain Adjust the autofocus gain.

autoFocusConfidenceThreshold Specify the threshold value of the confidence

level of Phase Difference.

autoFocusMoveLimit Limit the amount of focus movement at one time.

If OIS calibration is already done,

The following log is output to Terminal.

プレゼンテーション CA378 AOIS Software Setup Guide Raspi3 Ver1.0.0

CA378-AOIS_SoftwareSetupGuide_Raspi3_ver1.0.0

Navigation menu

Versions of this User Manual:

Views

Navigation