View source for CSI Audio Video capturing using GStreamer

{{GD Template Impl}}

This article  describes how the X630 can be combined with the X630-A2 to capture stereo sound Audio and Video using GStreamer


Capturing stereo audio with the X630-A2 from the HDMI source is supported.

If you need to run RASPISTILL or RASPIVID again after the GStreamer is installed. You will need to reinstall a fresh Raspberry Pi OS and follow [[X630-Hardware-Reset | this guide]]

'''1. After the device is booted, update your Raspberry Pi by running the following commands in a terminal window:'''
 sudo apt-get update
 sudo apt-get upgrade -y

'''2. Install necessary dependency and remaining plugins for GStreamer'''
 sudo apt-get install libx264-dev libjpeg-dev
 sudo apt-get install libgstreamer1.0-dev libgstreamer-plugins-base1.0-dev libgstreamer-plugins-bad1.0-dev gstreamer1.0-plugins-ugly gstreamer1.0-tools

'''3. With all GStreamer modules installed let's test the installation with (not via SSH)'''
 gst-launch-1.0 --version
 gst-launch-1.0 videotestsrc ! videoconvert ! autovideosink
[[File:TestRPi-X630.png]]

'''4. Edit /boot/config.txt and enter the following'''
 sudo nano /boot/config.txt
Then add the following comments:
 dtoverlay=tc358743
 dtoverlay=tc358743-audio
 dtoverlay=cma,cma-128
Save and exit with ctrl + x, followed by y when prompted to save, and then enter.

'''5. Reboot the Raspberry Pi'''
 sudo reboot

'''6. Once rebooted and check that the audio drivers / card is available to ALSA.'''
 arecord  -l
If the X630 module and drivers have been installed correctly you should see something similar to:

[[File:Arecord-X630.jpg]]

Note: card 2 means that the card number for the TC358743XBG is "2" and it might be different.

'''7. Create an EDID file so it can be loaded into the chip to allow it to tell the HDMI source what resolutions are supported.'''
 sudo nano edid.txt
then enter the following:
<pre>
00ffffffffffff005262888800888888
1c150103800000780aEE91A3544C9926
0F505400000001010101010101010101
010101010101011d007251d01e206e28
5500c48e2100001e8c0ad08a20e02d10
103e9600138e2100001e000000fc0054
6f73686962612d4832430a20000000FD
003b3d0f2e0f1e0a202020202020014f
020321434e041303021211012021a23c
3d3e1f2309070766030c00300080E300
7F8c0ad08a20e02d10103e9600c48e21
0000188c0ad08a20e02d10103e960013
8e210000188c0aa01451f01600267c43
00138e21000098000000000000000000
00000000000000000000000000000000
00000000000000000000000000000028
</pre>
Save and exit with ctrl + x, followed by y when prompted to save, and then enter.

'''8. Push this to the device using'''
 v4l2-ctl --set-edid=file=edid.txt --fix-edid-checksums

'''9. To print the currently detected timings'''
 v4l2-ctl --query-dv-timings

'''10. To select the currently detected timings'''
 v4l2-ctl --set-dv-bt-timings query

'''11. Capture the incoming audio (no video)'''
 arecord -D hw:x,0 -V stereo -r 48000 -f S16_LE -c 2 audio.wav

Note: '''hw:x''' - You must replace "x" with correct audio card number.

Press ctrl + c to finish a recording, the file will be saved to /home/pi

'''12. Capture the incoming video and audio'''
 gst-launch-1.0 v4l2src io-mode=0 ! video/x-raw, format=UYVY, framerate=25/1 ! v4l2h264enc output-io-mode=4 ! video/x-h264,profile=high ! h264parse ! queue ! matroskamux name=mux ! filesink location=video.mkv alsasrc device=hw:2 ! audio/x-raw,rate=48000,channels=2 ! audioconvert ! avenc_aac bitrate=48000 ! aacparse ! queue ! mux.

Note: '''alsasrc device=hw:<span style="color:red;>2</span> - "<span style="color:red;>2</span>'''" means the audio card number, You must change to correct audio card number.

Press ctrl + c to finish a recording, the file will be saved to /home/pi


<!--Add review function! -->
<comments />

<!--Please choose the  -->
<!--Remove other categories, just keep the appropriate categories -->

[[Category:Product Manual]]
[[Category:Raspberry pi]]
[[Category:Knowledge]]