libcamera_sama5d27_som1_ek1.X
This application demonstrates the use of ISC and LCDC peripherals. The camera module used in this application is ov5640 or ov2640 and PDA TM5000 LCD display. This application capture raw video frames from ov5640 or ov2640 camera module using parallel interface and display the captured frames on the TM5000 display using SAMA5D27-SOM1-EK1 target board.
| Hardware components | Images | Details |
|---|---|---|
| Development Board |  |
SAMA5D27-SOM1-EK1 |
| Camera Module |   |
ov2640 image sensor or Ov5640 image sensor |
| PDA TM500 Display |  |
PDA TM500 Display |
- Reference application for the SAMA5D27-SOM1-EK1 development Board
- Image Sensor Controller (ISC) driver
- Time system service, RTT peripheral library and driver
- Graphics Acceleration using integrated display controller (LCDC)
- I2C and Image sensor driver
The Project Graph diagram shows the Harmony components that are included in this application. Lines between components are drawn to satisfy components that depend on a capability that another component provides.
The I2C driver in this project is used for communication with the image sensor.
The pins are configured as follows through the MCC Pin Configuration tool:
| Pin ID | Custom Name | Function | Direction | Latch | Open Drain | PIO Interrupt | Pull Up | Pull Down | Glitch/Debounce Filter | Drive Strength |
|---|---|---|---|---|---|---|---|---|---|---|
| PA10 | LED_RED | LED_AH | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 |
| PA29 | PB_USER | SWITCH_AL | n/a | n/a | No | Disabled | Yes | No | Glitch Filter | 0x0 |
| PA31 | LED_BLUE | LED_AH | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 |
| PB1 | LED_GREEN | LED_AH | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 |
| PB11 | LCDC_LCDDAT0 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB12 | LCDC_LCDDAT1 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB13 | LCDC_LCDDAT2 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB14 | LCDC_LCDDAT3 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB15 | LCDC_LCDDAT4 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB16 | LCDC_LCDDAT5 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB17 | LCDC_LCDDAT6 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB18 | LCDC_LCDDAT7 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB19 | LCDC_LCDDAT8 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB20 | LCDC_LCDDAT9 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB21 | LCDC_LCDDAT10 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB22 | LCDC_LCDDAT11 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB23 | LCDC_LCDDAT12 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB24 | LCDC_LCDDAT13 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB25 | LCDC_LCDDAT14 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB26 | LCDC_LCDDAT15 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB27 | LCDC_LCDDAT16 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB28 | LCDC_LCDDAT17 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB29 | LCDC_LCDDAT18 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB30 | LCDC_LCDDAT19 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PB31 | LCDC_LCDDAT20 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC0 | LCDC_LCDDAT21 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC1 | LCDC_LCDDAT22 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC2 | LCDC_LCDDAT23 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC3 | LCDC_LCDPWM | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC4 | LCDC_LCDDISP | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC5 | LCDC_LCDVSYNC | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC6 | LCDC_LCDHSYNC | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC7 | LCDC_LCDPCK | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC8 | LCDC_LCDDEN | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC13 | ISC_D4 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC14 | ISC_D5 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC15 | ISC_D6 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC16 | ISC_D7 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC17 | ISC_D8 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC18 | ISC_D9 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC19 | ISC_D10 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC20 | ISC_D11 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC21 | ISC_PCK | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC22 | ISC_VSYNC | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC23 | ISC_HSYNC | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PC24 | ISC_MCK | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PD1 | BSP_MAXTOUCH_CHG | GPIO | In | n/a | No | Disabled | No | No | Glitch Filter | 0x0 |
| PD2 | UART1_URXD1 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PD3 | UART1_UTXD1 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PD4 | TWIHS1_TWD1 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PD5 | TWIHS1_TWCK1 | n/a | n/a | No | Disabled | No | No | Glitch Filter | 0x0 | |
| PD6 | CAMERA_RESET | GPIO | Out | High | No | Disabled | No | No | Glitch Filter | 0x0 |
| PD7 | CAMERA_PWD | GPIO | Out | High | No | Disabled | No | No | Glitch Filter | 0x0 |
The peripheral clocks need to be turned on for "UART1" "TWIHS1", "ISC", "LCDC", "PIO" and "TC0".
The ISC clock need to be Enabled.
The interrupts should be enabled in the "Interrupt for
- Enable 30 -- Two Wire Interface 1
- Enable 35 -- TC(0, 1, 2)
- Enable 41 -- USB High Speed
- Enable 45 -- LCD Controller
- Enable 46 -- Camera Inerface
- Enable 68 -- Parallel IO Controller
Note: The ov2640 or ov5640 image sensor is an off-the-shelf module and is not officially supported by MPLAB Harmony 3. While a driver for this module is included as part of this demo, it is not guaranteed to be complete. Nor are the ov2640 or ov5640 configuration values guaranteed to be optimal. The primary purpose of this application is to demonstrate the functionality of the Image Sensor Controller (ISC) on the SSAMA5D27-SOM1-EK1 board.
MPU32"s do not have an internal flash memory to boot from. Hence the boot process for these mpu's is different than for flash based MCUs. The boot process is described in detail in the device datasheets, but the general flow is as follows:
- On power-up the device executes the first stage bootloader from internal ROM. This looks for an second stage bootloader on external non-volatile memory such as eMMC, SD, NAND flash, NOR-SPI and QSPI as second stage boot devices. For SD and eMMC, ROM bootloader expects a file named “boot.bin” to reside in the root directory of a FAT file system.
- The second stage bootloader is copied to on-chip SRAM and executed. The second stage boot loader initialize the external DRAM and its controller, then load other program from external non-volatile memory into DRAM and execute it. The second stage bootloader must be configured for the board in use and for the external NVM containing the application. A comprehensive description of the boot process for the Microchip MPU's can be found in this application note: https://ww1.microchip.com/downloads/en/AppNotes/AN2791-Booting-from-External-Non-Volatile-Memory-on-SAMA5D2-MPU-Application-Note-DS00002791A.pdf
- The vision application is linked to run/debug on the external DRAM. During a debug process, MPLAB X will first run (load) the at91bootstrap program and this file can be found in the .X folder whose function is to initialize the chip, its clocks, debug port to view log messages and initialize the external DRAM.
Below are Project configuration steps to Debug or Run Vision application. On the MPLAB X IDE, right click on the project and click “Properties”.
- In “Connected Hardware Tool”, select J�Link or J-Tag, and in “Compiler Toolchain”, select XC32 and click apply.
- Under Categories, click on “Bootstrap”, ensure that “Use bootstrap” is checked and the path to the bootstrap.elf file is set.
- The harmony.bin should be generated as a post-build command. Under Categories, click on "Building", ensure that "Execute this line after build" is checked and set "${MP_CC_DIR}/xc32-objcopy -O binary ${DISTDIR}/${PROJECTNAME}.${IMAGE_TYPE}.elf ${DISTDIR}/harmony.bin"
The parent directory for this application is in vision/apps/ibcamera_display. To build this application, use MPLAB X IDE to open the vision/apps/libcamera_display/firmware/libcamera_sama5d27_som1_ek1.X project and press F11.
If the build is successfull, then a harmony.bin file is generate in vision/apps/libcamera_display/firmware/libcamera_sama5d27_som1_ek1.X/dist/isc_sama5d27_som1_ek1_tm5000/production folder.
The following table lists configuration properties:
| Project Name | BSP Used | Description |
|---|---|---|
| libcamera_sama5d27_som1_ek1.X | SAMA5D27-SOM1-EK1 | SAMA5D27-SOM1-EK1 using the parallel interface to capture video frames from the ov2640 image sensor or Ov5640 image sensor with PDA TM500 Display |
Latest release prebuilt binaries are available for a SAMA5D27-SOM1-EK1 board is here
Configure the hardware as follows:
- The OV5640 or OV2640 camera module is wired to the ISC header (J27) on the SAMA5D27-SOM1-EK1 board using the following wiring diagram:
| Module Function | Camera Module Pin | ISC Pin | ISC Function |
|---|---|---|---|
| VCC | 1 | 1 | 3.3 VCC |
| GND | 2 | 2 | GND |
| SCL | 3 | 7 (PD05) | TWI Clock |
| SDA | 4 | 8 (PD04) | TWI Data |
| VSYNC | 5 | 12 (PC22) | VSYNC |
| HREF | 6 | 14 (PC23) | HSYNC |
| PCLK | 7 | 16 (PC21) | PCLK |
| XCLK | 8 | 10 (PC24) | MCLK |
| DOUT9 | 9 | 25 (PC20) | D11 |
| DOUT8 | 10 | 24 (PC19) | D10 |
| DOUT7 | 11 | 23 (PC18) | D09 |
| DOUT6 | 12 | 22 (PC17) | D08 |
| DOUT5 | 13 | 21 (PC16) | D07 |
| DOUT4 | 14 | 20 (PC15) | D06 |
| DOUT3 | 15 | 19 (PC14) | D05 |
| DOUT2 | 16 | 18 (PC13) | D04 |
| DOUT1 | 17 | ~ | |
| DOUT0 | 18 | ~ | |
| RESET | 19 | 5 (PD06) | RESET |
| PWDN | 20 | 6 (PD07) | PWDN |
| AFVDD | 21 | ~ | ~ |
| STB | 22 | ~ | ~ |
Note: For 8-bit image sensor data D[7:0] is aligned to ISC_D[4:11]. For 10-bit image sensor data D[9:0] is aligned to ISC_D[2:11]. For 12-bit image sensor data D[11:0] is aligned to ISC_D[0:11].
-
Connect the ribbon cable from the display to the LCD connector on the SAMA5D27-SOM1-EK1 board.
-
Take an SD Card formatted with the FAT32 file system and copy the boot.bin binary file from vision/apps/libcamera_display/firmware/libcamera_sama5d27_som1_ek1.X/bootstrap/som1_ek1 folder. and copy the harmony.bin file generated from the "Building the Application" section.
-
Insert the SD card to J12 of the SAMA5D27-SOM1-EK1 board and power up the board by connecting a powered USB cable to either J17 or J10 USB port on the SSAMA5D27-SOM1-EK1 board.
-
optionally you can capture debug messages on serial console such as teraterm or Putty on host machine by connecting an USB cable to J10 port on the SSAMA5D27-SOM1-EK1 board.
The LCD should display a Live camera feed on successful power-on. See reference image.
