sample_embedding_folder2/0721522.txt

Ticket Name: TDA2: Camera raw data input to TDA2X is supported?

Query Text:
Part Number: TDA2 Dear TI: Does TI TDA2x support Camera raw data input? (We have one NIR camera module which only has the senor output but without ISP, and we need to connect it to TDA2x. Can this be supported?) Thanks and best regards He Wei

Responses:
Hi He Wei, Yes, we could capture using the VIP port of TDA2x. Can you provided more details on the camera interface (details such as number of data-lines, pixel clock speed, supported sync signals (hSync, vSync, DE (Data enable)) etc...) Also, what is the data format of video being streamed by sensor and which data format would be required? Regards, Sujith

Hi Sujith, I work with He Wei. Our camera is a standalone camera, means it will send video output thru DVP parallel port once power up. So no I2C setup required for the camera. Can you guide us or show some example on how to setup TDA2x to receive the RAW data and display on HDMI? For your information, data transferred is - 1280x800, - 12bit raw data - hsync, vsync, pclk (75Mhz) - 30 fps Your support is much appreciated Thank you Chee Peng

Hi chee Peng, Yes, it is possible to capture this stream over VIP. We have a similar example to capture 12bit raw data on VIP using AR0132 sensor in PDK drivers. You could refer to this example to get the idea about how to configure VIP. Regards, Brijesh

Hi, Can you please refer the VIP Capture demo application for the VIP configurations. It's available at \ti_components\drivers\pdk\packages\ti\drv\vps\examples\vip\captureVip\src\CaptureVip_main.h Refer the configurations used for "Aptina AR0132->VIP1_S1_PORTA SCH 12-bit Discrete Sync (HSYNC/VSYNC)" Please note that depending on your board/schematics, you might have to update the instance of VIP that can be used. Regards, Sujith

Hi Sujith, This looks useful. Let me try, i shall get back to you.

Hi Sujith, I updated to 16bit raw as following, But I still faced following error. Any idea? What do you think? [IPU1-0] 23.916031 s: CAPTURE: Create in progress !!! [IPU1-0] 23.916244 s: CAPTURE: VIP1 Slice0 PortA capture mode is [16-bit] !!! [IPU1-0] 24.075764 s: CAPTURE: Create Done !!! [IPU1-0] 24.077258 s: ALGORITHM: Create in progress (algId = 12) !!! [IPU1-0] 24.077441 s: Assertion @ Line: 308 in vpeSwMs/vpeSwMsLink_algPlugin.c: 0 : failed !!! [IPU1-0] 24.077899 s: Assertion @ Line: 308 in vpeSwMs/vpeSwMsLink_algPlugin.c: 0 : failed !!!

Hi Chee Peng, From the log, it seems like capture creation is completed successfully. It's the SWMS link which is creating a problem. The SWMS will not support RAW 12 data format. You would require s/w module to convert RAW12 to YUV data format. As an experiment, In function AlgorithmLink_dmaSwMsCreate () in file \apps\src\rtos\alg_plugins\dmaSwMs\dmaSwMsLink_algPlugin.c change line pDmaSwMsObj->dataFormat = System_Link_Ch_Info_Get_Flag_Data_Format(pDmaSwMsObj->prevLinkQueInfo.chInfo[0].flags); to pDmaSwMsObj->dataFormat = SYSTEM_DF_YUV422I_UYVY; Regards, Sujith

Hi Sujith, Thank you for suggestion. The error at vpeSwMs/vpeSwMsLink_algPlugin.c Adjust \apps\src\rtos\alg_plugins\dmaSwMs\dmaSwMsLink_algPlugin.c will not affect. Anyway, I adjusted at vpeSwMs/vpeSwMsLink_algPlugin.c It gave more error as following I tried traced it, the error deep at Ti component..... What do you think?

Hi Chee Peng, It seems like the data type is not overridden. As the very first error that you are seeing is being reported by VPE for wrong data-type. Can you please debug on this front? Regards, Sujith

Hi Sujith, Thank you for suggest. It is deep in TI component driver. I have unclear how to debug. In fact, I have TDA2x and AR0132 headboard. May I suggest you try stream AR0132 on TDA2x? What do you think? regards cheepeng

Hi Cheepeng, I don't have AR0132 board with me to try it out. Another method would be to hardcode the data-type in Capture Link itself. I will send you the details in few minutes. Regards, Sujith

Please try In file \vision_sdk\links_fw\src\rtos\links_ipu\iss_capture\issCaptureLink_drv.c and function IssCaptureLink_drvCreate () Update pQueChInfo->flags = System_Link_Ch_Info_Set_Flag_Data_Format(pQueChInfo->flags, pObj->createArgs.outParams[chIdx].dataFormat); pQueChInfo->flags = System_Link_Ch_Info_Set_Flag_Data_Format(pQueChInfo->flags, SYSTEM_DF_YUV422I_UYVY); Regards, Sujith

Dear Sujith, Still same result... [IPU1-0] 23.916031 s: CAPTURE: Create in progress !!! [IPU1-0] 23.916244 s: CAPTURE: VIP1 Slice0 PortA capture mode is [16-bit] !!! [IPU1-0] 24.075764 s: CAPTURE: Create Done !!! [IPU1-0] 24.077258 s: ALGORITHM: Create in progress (algId = 12) !!! [IPU1-0] 24.077441 s: Assertion @ Line: 308 in vpeSwMs/vpeSwMsLink_algPlugin.c: 0 : failed !!! [IPU1-0] 24.077899 s: Assertion @ Line: 308 in vpeSwMs/vpeSwMsLink_algPlugin.c: 0 : failed !!!

Dear Sujith, Seems we stuck here, based on the TDA2x, there is "NO ISP on chip" so Can we say it is not possible for TDA2X to support camera module without ISP? Or otherwise we need to implement a software ISP on chip for it to work? Thanks and best regards He Wei

Hi He Wei, Yes, you are right. TDA2Px/TDA3x comes in with built in ISP. Please check if these devices can meet your needs. Regards, Sujith

Dear Sujith, Thanks for the confirmation, another question is if TI has the some kind daughter board like FPD-LINK III Deserializer board with integrated the ISP module? I am asking this question because we have few TDA2X boards on hand and need to find a way for it to work with our NIR raw camera.. Thanks and best regards He Wei

Hi He Wei, I am not aware of any add-on board with this capability. What is expected from the ISP? Regards, Sujith

Dear Sujith, The concern is that if the NIR camera with the raw data output can't support on TDA2x directly (seems we still didn't get it successfully after trying so far), we may need to have extra ISP to perform the raw data to YUV conversion first then we can use on TDA2x?? Thanks and best regards He Wei

Hi He Wei, Yes, that correct on the ISP. We should be able to get the capture working though. Regards, Sujith

Hi He Wei, Chee Peng, Is your query answered? Regards, Sujith