2.7.2. Camera¶

Video can be captured on the AM62Ax using either a USB UVC camera or a MIPI CSI-2 compliant camera. The camera driver is based on the Video for Linux 2 (V4L2) API. Examples are given below to show video capturing by a USB camera as well as a CSI-2 camera.

2.7.2.1. USB UVC Camera¶

Plug in a USB UVC compliant camera and boot the EVM to Linux. Use the v4l2-ctl command to verify the camera is detected:

# v4l2-ctl --list-devices
TI-CSI2RX (platform:30102000.ticsi2rx):
        /dev/media0

wave5-dec (platform:wave5-dec):
        /dev/video0

wave5-enc (platform:wave5-enc):
        /dev/video1

HD Web Camera: HD Web Camera (usb-xhci-hcd.1.auto-1):
        /dev/video2
        /dev/video3
        /dev/media1

GStreamer can be used to capture the video. The captured video can be simultaneously sent to the HDMI display if a display is connected. Below is an example of using GStreamer to stream video (make sure to change videoX to the actual video device number):

# gst-launch-1.0 v4l2src device="/dev/videoX" ! video/x-raw, width=640, height=480 ! kmssink driver-name=tidss

The captured video can also be stored to a file and played out on the host PC. Instead of using kmssink as the GStreamer sink, a file sink can be used, for example:

# gst-launch-1.0 v4l2src num-buffers=50 device="/dev/videoX" ! video/x-raw, width=640, height=480 ! filesink location=cam-cap.yuv

Then the captured file can be played out on the host PC using an application such as mplayer:

$ mplayer -demuxer rawvideo -rawvideo w=640:h=480:format=yuy2 cam-cap.yuv

2.7.2.2. CSI-2 Camera¶

AM62Ax supports MIPI CSI-2 compliant cameras. The AM62Ax SK EVM has a CSI-2 camera connector that is compatible with the Raspberry Pi A & B Camera.

Connect a CSI-2 Camera to the EVM

The CSI-2 camera connector is located at the bottom side of the EVM. A CSI-2 camera can be connected to the EVM as shown below:

../_images/Academy_Eval_imx219_am62ax_sk.png

Apply Device Tree Overlay

Since any camera sensor can be connected to the EVM, the base dtb in the Processor SDK does not include the device tree node for any particular camera sensor. Therefore, the device tree node for a particular sensor should be added in as an overlay. The Processor SDK contains a pre-built device tree overlay for the IMX219 camera sensor, as shown below:

# ls /boot/*imx219.dtbo -l
-rw-r--r-- 1 root root     1923 Feb 23  2023 k3-am62a7-sk-csi2-imx219.dtbo

The device tree overlay can be applied in one of the following two ways:

Open file /run/media/mmcblk1p1/uEnv.txt and add the following line at the end of the file if it’s not already there, and then reboot the EVM:

name_overlays=k3-am62a7-sk-csi2-imx219.dtbo

Reboot the EVM and stop at U-Boot prompt, and add the following environment variable:

=>setenv name_overlays k3-am62a7-sk-csi2-imx219.dtbo
=>saveenv
=>boot

Verify the Camera Is Detected

Boot the EVM to Linux and use the v4l2-ctl --list-devices command to verify the camera is detected. The command should return something similar to below:

# v4l2-ctl --list-devices
j721e-csi2rx (platform:30102000.ticsi2rx):
        /dev/video2
        /dev/video3
        /dev/video4
        /dev/video5
        /dev/video6
        /dev/video7
        /dev/media0

wave5-dec (platform:wave5-dec):
        /dev/video0

wave5-enc (platform:wave5-enc):
        /dev/video1

The above command displays multiple video nodes (/dev/videoX). Each of these video nodes corresponds to a logical stream of data. If the IMX219 camera is the only connected CSI-2 camera, then the first node under j721e-csi2rx is used.

Capture Video

Because the IMX219 is a raw image sensor, the ISP on the SoC needs to be used in order to stream video. Below commands first configure the format for the sensor and then stream video (stop the out-of-box Edge AI demo before streaming):

# media-ctl -V '"imx219 4-0010":0 [fmt:SRGGB10_1X10/1920x1080 field:none]'
# gst-launch-1.0 -v v4l2src device=/dev/video2 io-mode=dmabuf-import ! \
  video/x-bayer, width=1920, height=1080, framerate=30/1, format=rggb10 ! \
  tiovxisp sink_0::device=/dev/v4l-subdev2 sensor-name="SENSOR_SONY_IMX219_RPI" \
  dcc-isp-file=/opt/imaging/imx219/dcc_viss_10b.bin sink_0::dcc-2a-file=/opt/imaging/imx219/dcc_2a_10b.bin format-msb=9 ! \
  video/x-raw, format=NV12, width=1920, height=1080, framerate=30/1 ! kmssink driver-name=tidss

For more details on configuring the sensor to different formats and using the ISP to process raw image data, please refer to Camera Development section.

	Linux Academy for AM62AX