CSI Manual on Pi 5

From Geekworm Wiki
Jump to navigation Jump to search

This tutorial is only for C790 and C779. It should be noted that C790 supports audio and supports resolution up to 1080P@60HZ, but C779 does not support audio and the resolution is only 1080P@50HZ


1. Edit /boot/config.txt (sudo permission required).

sudo nano /boot/config.txt
Add the following content:
dtoverlay=tc358743
If your modules C790 support audio, add the following content to enable audio support. If you use C779, please ignore this step
dtoverlay=tc358743-audio
Then reboot the raspberry Pi.

2. Execute the following command to find the media node corresponding to the CSI as media0, under the rp1-cfe (platform: 1f00128000.csi) field:

v4l2-ctl --list-devices
blikvm@blikvm:~ $ v4l2-ctl --list-devices
pispbe (platform:1000880000.pisp_be):
        /dev/video20
        /dev/video21
        /dev/video22
        /dev/video23
        /dev/video24
        /dev/video25
        /dev/video26
        /dev/video27
        /dev/video28
        /dev/video29
        /dev/video30
        /dev/video31
        /dev/video32
        /dev/video33
        /dev/video34
        /dev/video35
        /dev/video36
        /dev/video37
        /dev/media1
        /dev/media2

rp1-cfe (platform:1f00128000.csi):
        /dev/video0
        /dev/video1
        /dev/video2
        /dev/video3
        /dev/video4
        /dev/video5
        /dev/video6
        /dev/video7
        /dev/media0

rpivid (platform:rpivid):
        /dev/video19
        /dev/media3

PS: Please remember the media number in line 33. The following commands must use the same media number.

3. Locate the node corresponding to tc358743 as v4l-subdev2, and the pad0 of rp1-cfe-csi2_ch0 as video0:

Note: The /dev/media0 here comes from the media number obtained in the previous step. 

 blikvm@blikvm:~ $ media-ctl -d /dev/media0 -p
 Media controller API version 6.1.63

 Media device information
 ------------------------
 driver          rp1-cfe
 model           rp1-cfe
 serial
 bus info        platform:1f00128000.csi
 hw revision     0x114666
 driver version  6.1.63

 Device topology
 - entity 1: csi2 (8 pads, 8 links)
             type V4L2 subdev subtype Unknown flags 0
             device node name /dev/v4l-subdev0
         pad0: Sink
                 [fmt:SRGGB10_1X10/640x480 field:none colorspace:raw xfer:none ycbcr:601 quantization:full-range]
                 <- "tc358743 4-000f":0 [ENABLED,IMMUTABLE]
         pad1: Sink
                 [fmt:unknown/8192x1 field:none]
         pad2: Sink
                 [fmt:SRGGB10_1X10/640x480 field:none colorspace:raw xfer:none ycbcr:601 quantization:full-range]
         pad3: Sink
                 [fmt:SRGGB10_1X10/640x480 field:none colorspace:raw xfer:none ycbcr:601 quantization:full-range]
         pad4: Source
                 [fmt:SRGGB10_1X10/640x480 field:none colorspace:raw xfer:none ycbcr:601 quantization:full-range]
                 -> "rp1-cfe-csi2_ch0":0 []
                 -> "pisp-fe":0 []
         pad5: Source
                 [fmt:unknown/8192x1 field:none]
                 -> "rp1-cfe-embedded":0 []
         pad6: Source
                 [fmt:SRGGB10_1X10/640x480 field:none colorspace:raw xfer:none ycbcr:601 quantization:full-range]
                 -> "rp1-cfe-csi2_ch2":0 []
                 -> "pisp-fe":0 []
         pad7: Source
                 [fmt:SRGGB10_1X10/640x480 field:none colorspace:raw xfer:none ycbcr:601 quantization:full-range]
                 -> "rp1-cfe-csi2_ch3":0 []
                 -> "pisp-fe":0 []

 - entity 10: pisp-fe (5 pads, 7 links)
             type V4L2 subdev subtype Unknown flags 0
             device node name /dev/v4l-subdev1
         pad0: Sink
                 [fmt:SRGGB16_1X16/640x480 field:none colorspace:raw xfer:none ycbcr:601 quantization:full-range]
                 <- "csi2":4 []
                 <- "csi2":6 []
                 <- "csi2":7 []
         pad1: Sink
                 [fmt:FIXED/8192x1 field:none]
                 <- "rp1-cfe-fe_config":0 []
         pad2: Source
                 [fmt:SRGGB16_1X16/640x480 field:none colorspace:raw xfer:none ycbcr:601 quantization:full-range]
                 -> "rp1-cfe-fe_image0":0 []
         pad3: Source
                 [fmt:SRGGB16_1X16/640x480 field:none colorspace:raw xfer:none ycbcr:601 quantization:full-range]
                 -> "rp1-cfe-fe_image1":0 []
         pad4: Source
                 [fmt:FIXED/8192x1 field:none]
                 -> "rp1-cfe-fe_stats":0 []

 - entity 16: tc358743 4-000f (1 pad, 1 link)
             type V4L2 subdev subtype Unknown flags 0
             device node name /dev/v4l-subdev2
         pad0: Source
                 [fmt:RGB888_1X24/640x480 field:none colorspace:srgb]
                 [dv.caps:BT.656/1120 min:640x350@13000000 max:1920x1200@165000000 stds:CEA-861,DMT,CVT,GTF caps:progressive,reduced-blanking,custom]
                 [dv.detect:BT.656/1120 1920x1080p24 (2750x1125) stds: flags:]
                 [dv.current:BT.656/1120 640x480p59 (800x525) stds:CEA-861,DMT flags:has-cea861-vic]
                 -> "csi2":0 [ENABLED,IMMUTABLE]

 - entity 18: rp1-cfe-csi2_ch0 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video0
         pad0: Sink
                 <- "csi2":4 []

 - entity 22: rp1-cfe-embedded (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video1
         pad0: Sink
                 <- "csi2":5 []

 - entity 26: rp1-cfe-csi2_ch2 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video2
         pad0: Sink
                 <- "csi2":6 []

 - entity 30: rp1-cfe-csi2_ch3 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video3
         pad0: Sink
                 <- "csi2":7 []

 - entity 34: rp1-cfe-fe_image0 (1 pad, 1 link)
             type Node subtype V4L flags 1
             device node name /dev/video4
         pad0: Sink
                 <- "pisp-fe":2 []

 - entity 38: rp1-cfe-fe_image1 (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video5
         pad0: Sink
                 <- "pisp-fe":3 []

 - entity 42: rp1-cfe-fe_stats (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video6
         pad0: Sink
                 <- "pisp-fe":4 []

 - entity 46: rp1-cfe-fe_config (1 pad, 1 link)
             type Node subtype V4L flags 0
             device node name /dev/video7
         pad0: Source
                 -> "pisp-fe":1 []

4. To query the current input source information, if the resolution displays as 0, it indicates that no input source signal has been detected. In this case, you should check the hardware connections and follow the steps mentioned above to troubleshoot.

v4l2-ctl -d /dev/v4l-subdev2 --query-dv-timings
blikvm@blikvm:~ $ v4l2-ctl -d /dev/v4l-subdev2 --query-dv-timings
    Active width: 1920
    Active height: 1080
    Total width: 2750
    Total height: 1125
    Frame format: progressive
    Polarities: -vsync -hsync
    Pixelclock: 74250000 Hz (24.00 frames per second)
    Horizontal frontporch: 0
    Horizontal sync: 830
    Horizontal backporch: 0
    Vertical frontporch: 0
    Vertical sync: 45
    Vertical backporch: 0
    Standards:
    Flags:

5. Confirm the current input source information. 

v4l2-ctl -d /dev/v4l-subdev2 --set-dv-bt-timings query

X1300v1.0-setting5.png


6. Initialize media0. 

media-ctl -d /dev/media0 -r

Note: The /dev/media0 here comes from the media number obtained in the step 2.


7. Connect CSI2's pad4 to rp1-cfe-csi2_ch0's pad0. 

media-ctl -d /dev/media0 -l ''\''csi2'\'':4 -> '\''rp1-cfe-csi2_ch0'\'':0 [1]'

8. Configure the media node. 

media-ctl -d /dev/media0 -V ''\''csi2'\'':0 [fmt:RGB888_1X24/1920x1080 field:none colorspace:srgb]'
media-ctl -d /dev/media0 -V ''\''csi2'\'':4 [fmt:RGB888_1X24/1920x1080 field:none colorspace:srgb]'

Note: The /dev/media0 here comes from the media number obtained in the step 2.


9. Set the output format. 

v4l2-ctl -v width=1920,height=1080,pixelformat=RGB3

10. Capture two frames for testing to verify if tc358743 is functioning properly. Other methods, such as using GStreamer, are not currently available. 

v4l2-ctl --verbose -d /dev/video0 --set-fmt-video=width=1920,height=1080,pixelformat='RGB3' --stream-mmap=4 --stream-skip=3 --stream-count=2 --stream-to=hdmiin.yuv --stream-poll


11. If you have installed a desktop version of Raspberry Pi, you can use ffplay to directly play YUV files. 

ffplay -f rawvideo -video_size 1920x1080 -pixel_format bgr24 hdmiin.yuv

On a Windows computer, you can use software like 7yuv to view .yuv files. For the tutorial with an input format of 19201080, you should select BGR888 in the top right corner of 7yuv and set the resolution to 19201080 to view the two frames you just captured.


Return to C790 / C779

Add your comment
Geekworm Wiki welcomes all comments. If you do not want to be anonymous, register or log in. It is free.


Anonymous user #2

one day 12 hours 27 minutes ago
Score 0++

edwin@cary:~ $ v4l2-ctl -d /dev/v4l-subdev2 --set-dv-bt-timings query VIDIOC_QUERY_DV_TIMINGS: failed: Inappropriate ioctl for device VIDIOC_S_DV_TIMINGS: failed: Inappropriate ioctl for device

edwin@cary:~ $

Permalink | Reply

Anonymous user #1

5 months ago
Score 0++
Anyway to get Chrome/Firefox to recognize it as a webcam? I've tried piping the video through workarounds where you can pipe the video to v4l2loopback, but that was exceptionally slow.

Permalink | Reply

Retrieved from "https://wiki.geekworm.com/index.php?title=CSI_Manual_on_Pi_5&oldid=21780"