Overview

Embedded vision systems are the keystones to many advanced capabilities in modern applications, including augmented vision, automotive, machine vision, medical, and smart city cameras. Modern vision systems require high resolution, high frame rates, and increasing pixel depth, presenting significant data rate and memory bandwidth challenges. AMD offers both cost-optimized and high-performance MIPI-based solutions for camera sensor capture and display, supporting- D-PHY, C-PHY, CSI-2, and DSI protocols. Additionally, AMD offers a breadth of image signal processing IP for color conversion, correction, balancing, and other operations required by many image sensor applications. The flexibility of AMD devices helps to meet the unique requirements of every design and enables developers to meet those needs as well as differentiate their solutions.

AMD MIPI IP Cores

CSI-2

Receiver and Transmitter Controller Subsystems

  • Support of 1-4 D-PHY Lanes for MIPI CSI-2 Transmitter
  • Support 1-4 D-PHY Lanes and 1-3 C-CPHY lanes for MIPI CSI-2 Receiver
  • Line rates ranging from 80 to 4500 Mb/s for D-PHY and 400 to 4500 Msps for C-PHY
  • Multiple data type support (RAW, RGB, YUV)
  • Support of 1, 2, 4 and 8 pixels per clock
  • Filtering based on virtual channel (VC) IDs
  • AXI4-compliant interface with support for 4K resolution imagers and processors
  • Internal D-PHY/C-PHY allows direct connection to image sources
  • Small resource count 
Learn More

DSI

Receiver and Transmitter Controller Subsystems

  • 1-4 lane support
  • Standard PPI interface from/to D-PHY and C-PHY
  • Support for all mandatory data types
  • Virtual channel (1 to 4) programmable end of transmission packet (EoTp) generation support
  • Low power (LP) and ultra-low power (ULP) mode generation
  • Multilane interoperability
  • ECC generation for packet headers
  • CRC generation for data bytes (can be optional)
  • Pixel byte conversion based on data format
  • AXI4-Lite interface to access more registers
  • AXI4-compliant for input video streams
Learn More

AMD devices support multiple MIPI configurations, from single to multiple links, different data rates, and data types, and can mix receive and transmit datapaths on a single device. AMD devices are also expandable, limited only by the number of I/Os. C-PHY will require dedicated pinouts to accommodate for three distinct voltages levels and is expandable up to three lanes. To further accelerate or streamline solutions, programmable logic enables integration of the entire image signal processing (ISP) chain while remaining scalable and field upgradable as ISP algorithms improve.

MIPI Support across AMD Products

Cost-Optimized Portfolio High-Performance Devices
  • Second-generation Versal™ devices will support higher bandwidth C-PHY physical interfaces
    • Support for CSI-2 and DSI protocols
    • Reduced I/O count for higher bandwidth with dedicated pinout
    • C-PHY Bandwidth up to 4.5 GS/s (~10.28 Gb/s)
  • High-performance devices have built-in support for the D-PHY physical layer
    • Versal adaptive SoCs have data rates up to 3200 Mb/s per lane with up to 32 MP image resolution
    • 2nd Gen Versal adaptive SoCs will support up to 4.5 Gb/s D-PHY data rates
  • These devices also have dedicated engines for real-time processing, graphics processing, video encoding and decoding, waveform, packet processing, and machine learning /artificial intelligence engines
  • Featured devices:

Applications

AMD offers MIPI-based solutions for camera sensor capture and display through cost-optimized and high-performance devices that enable edge-type applications across a broad set of markets.

Automotive

The AMD automotive portfolio solves industry challenges within ADAS, automated driving, in-vehicle Infotainment & driver information, and electrification & networking. Our adaptable architecture allows users to achieve low-latency compute and the ability to connect a wide array of interfaces – including MIPI. As enhancements to the MIPI protocol are released in the toolchain, flexible silicon from AMD can adapt – letting users design their systems with the latest interfaces for the fastest data transmission possible. AMD is introducing C-PHY support for reduced I/O count and higher bandwidth MIPI applications.

Learn More

Industrial

Smart cities and smart retail require a complex mix of compute requirements spanning from the cloud to the edge. AMD industrial vision solutions deliver camera and image processing platforms with optimal performance, power, and cost while also offering low latency and high reliability. AMD offerings include heterogeneous embedded processing, I/O flexibility, hardware-based deterministic control, and comprehensive solutions able to handle harsh environments over industrial life cycles. The Vitis™ unified software platform and Vitis AI development environment simplify development of accelerated applications and AI inference across AMD hardware platforms, enabling video security equipment manufacturers and AI developers to rapidly create scalable and differentiated products.

Learn More

Consumer Electronics

Consumer products implement machine learning to improve autonomy, user interaction, and situational awareness. Traditional applications such as DSLR cameras, printers, and video conferencing are now being accompanied by camera-enabled robots and drones, TVs, virtual reality headsets, and smart appliances. AMD offers high-resolution MIPI interfaces along with machine learning, video compression, and a wide variety of AV interfaces to achieve adaptable, low-cost, single-chip solutions. This high level of integration is enabling the next wave of immersive consumer video and imaging products with increasing levels of autonomy and analytics.

Learn More

Aerospace & Defense

With 30+ continuous years of heritage and support, AMD delivers the broadest product portfolio for enabling the next generation of advancements in ground-based, airborne, and space systems. Commercial-grade and defense-grade variants of Zynq™ UltraScale+™ MPSoC devices satisfy requirements for MIPI sensor imaging and connectivity. Various platforms are available, including the UAV and Robotics Platform, which is built on the ZU7EV device with support for dual 4Kp60 MIPI connectivity in a software programmable platform.

Learn More

Broadcast & Pro A/V

Whether the application is conferencing and collaboration, digital cinema, or traditional broadcast, MIPI allows for the integration of the latest sensor technology for broadcast and professional video capture applications. MIPI IP, combined with any-to-any media connectivity, a video codec unit (VCU), and 8K-capable video processing elements, enable the latest developments in applications such as intelligent digital signage, 4K UHD broadcast, machine learning collaboration, and high quality, low bit rate live streaming.

Learn More

Evaluation Kits

AMD offers high-performance, low-power consumption MIPI-based solutions for camera sensor capture and display, supporting D-PHY, CSI-2, and DSI protocols.

 

Available Platforms

The SP701 evaluation kit, equipped with the best-in-class performance-per-watt Spartan 7 FPGA, is built for designs requiring sensor fusion such as industrial networking, embedded vision, and automotive applications. The SP701 features video interfaces including MIPI CSI, DSI, and HDMI. It also features high I/O availability and I/O expansion capability via Pmods and FMC connectors making it the largest IP development canvas for Spartan 7 FPGA users.

Learn More

The ZCU102 Evaluation Kit enables designers to jumpstart designs for automotive, industrial, video, and communications applications. This kit features an AMD Zynq™ UltraScale+™ MPSoC with a quad-core Arm® Cortex®-A53, dual-core Cortex-R5F real-time processors, and a Mali™-400 MP2 graphics processing unit based on 16nm FinFET+ programmable logic fabric by AMD. The ZCU102 supports all major peripherals and interfaces, enabling development for a wide range of applications.

Learn More

The AMD VCK190 is the first Versal™ AI Core series evaluation kit, enabling designers to develop solutions using AI and DSP engines capable of delivering over 100X greater compute performance compared to current server class CPUs. With a breadth of connectivity options and standardized development flows, the Versal AI Core series VC1902 adaptive SoC, providing the portfolio's highest AI inference and signal processing throughput for cloud, network, and edge applications.

Learn More

The VEK280 Evaluation Kit is a new evaluation platform based on the AMD Versal™ AI Edge Series VE2802 device. The VEK280 board targets AIE-ML applications with increased compute performance, lower latency, and a higher level of integration enabled by the Versal AI Edge Series device. As an adaptive SoC, the Versal AI Edge Series allows developers to rapidly evolve their sensor fusion and AI algorithms while leveraging a scalable device portfolio for diverse performance and power profiles from edge to endpoint. As an evaluation platform, the primary focus for the VEK280 board is to enable evaluation and development of Versal AI Edge Series-based applications. The VEK280 board is not intended to be used in volume production and does not require complete reliability and production qualification.

Learn More

The VEK385 Evaluation Kit is equipped with the AMD Versal™ AI Edge Series Gen 2 2VE3858 adaptive SoC, which delivers end-to-end acceleration for AI-driven embedded systems—all in a single device and built on a foundation of enhanced safety and security. The kit comes with a breadth of connectivity options, development tools, and example designs to accelerate prototyping across a broad range of embedded markets, including those with high-security, high-reliability, long-lifecycle, and safety-critical applications. The VEK385 evaluation board is not intended to be used in volume production and does not require complete reliability and production qualification. Note: The VEK385 Evaluation Kit is also recommended for Versal Prime Series Gen 2 evaluations.

Learn More

Get Started

Description Device Support
Spartan™ 7 FPGA SP701 Application Example
This example showcases a CSI-2 Subsystem IP with a PCAM camera module (Digilent), which is a popular interface used by MIPI CSI camera modules, and a DSI Subsystem IP with a display. These are both controlled by a MicroBlaze™ soft processor and all the IP is integrated in the Vivado™ Design Suite. The D-PHY is implemented on the SP701 Evaluation Kit using passive components.		 AMD Spartan 7 FPGA
Zynq UltraScale+ MPSoC ZCU102 and Versal Adaptive SoC VCK190 application example
This design demonstrates the use of the MIPI CSI-2 RX (decodes and processes video data) and MIPI DSI TX subsystems on the Zynq™ UltraScale+™ ZCU102 board or Versal™ adaptive SoC VCK190 board. The system receives images captured by the IMX274 image sensor. Processed images are then displayed on either an HDMI monitor or a MIPI DSI display.		 AMD Zynq UltraScale+ MPSoC
AMD Versal adaptive SoC

Resources

MIPI RX C-PHY/D-PHY Product Guide (PG435)

The AMD MIPI RX C-PHY/D-PHY core is designed for reception of video or pixel data from a sensor or processor. The core is used as the physical layer for higher level protocols such as the Mobile Industry Processor Interface (MIPI) Camera Serial Interface (CSI-2) and Display Serial Interface (DSI).

View Product Guide

MIPI TX C-PHY/D-PHY Product Guide (PG436)

The MIPI TX C-PHY/D-PHY core is designed for the transmission of video or pixel data for camera and display interfaces. The core is used as the physical layer for higher-level protocols such as the Mobile Industry Processor Interface (MIPI) Camera Serial Interface (CSI-2) and Display Serial Interface (DSI).

View Product Guide

Stay Informed

Join the adaptive SoC and FPGA notification list to receive the latest news and updates.

Sign Up