MIPI Connectivity for Imaging

The Xilinx Automotive (XA) portfolio solves industry challenges within ADAS, Automated Driving, In-Vehicle Infotainment & Driver Information, and Electrification & Networking. Adaptable architecture allows customers to achieve low-latency compute and the ability to connect a wide array of interfaces – including MIPI. As enhancements to the MIPI protocol are released in the toolchain, Xilinx's flexible silicon can adapt – letting customers design their systems with the latest interfaces for the fastest data transmission possible.

Smart Cities and Smart Retail require a complex mix of compute requirements spanning from the cloud to the edge. Xilinx Industrial Vision solutions deliver camera and image processing platforms with optimal performance, power, and cost – while also offering low latency and high reliability. Xilinx offerings include heterogeneous embedded processing, I/O flexibility, hardware-based deterministic control, and comprehensive solutions able to handle harsh environments over industrial life cycles. The Vitis™ unified software platform and Vitis™ AI development environment simplify development of accelerated applications and AI inference across Xilinx hardware platforms, enabling video security equipment manufacturers and AI developers to rapidly create scalable and differentiated products.

Consumer products implement machine learning to improve autonomy, user interaction, and situational awareness. Traditional applications such as DSLR cameras, printers, and video conferencing are now being accompanied by camera-enabled robots and drones, TVs, virtual reality headsets, and smart appliances. Xilinx offers high-resolution MIPI interfaces along with machine learning, video compression, and a wide variety of AV interfaces to achieve adaptable, low-cost, single-chip solutions. This high level of integration is enabling the next wave of immersive consumer video and imaging products with increasing levels of autonomy and analytics.

With 30+ continuous years of heritage and support, Xilinx delivers the broadest product portfolio for enabling the next generation of advancements in ground-based, airborne, and space systems. Commercial-grade and Defense-grade variants of Zynq® UltraScale+™ MPSoC devices satisfy requirements for MIPI sensor imaging and connectivity. Various platforms are available including the UAV and Robotics Platform, which is built on the ZU7EV device with support for dual 4Kp60 MIPI connectivity in a software programmable platform.

Whether the application is conferencing and collaboration, digital cinema, or traditional broadcast, MIPI allows for the integration of the latest sensor technology for broadcast and professional video capture applications. MIPI IP, combined with any-to-any media connectivity, a Video Codec Unit (VCU), and 8K capable video processing elements, enables the latest developments in applications such as intelligent digital signage, 4K UHD broadcast, machine learning collaboration, and high quality, low bit rate live streaming.

Xilinx offers high-performance, low-power consumption MIPI-based solutions for camera sensor capture and display, supporting D-PHY, CSI-2, and DSI protocols.

Spartan-7 SP701 Evaluation Kit

The SP701 Evaluation Kit, equipped with the best-in-class performance-per-watt Spartan®-7 FPGA, is built for designs requiring sensor fusion such as industrial networking, embedded vision, and automotive applications. The SP701 features video interfaces including MIPI CSI, DSI, and HDMI. It also features high I/O availability and I/O expansion capability via Pmods and FMC connectors making it the largest IP development canvas for Spartan-7 FPGA users.
Learn more >

Featuring the Spartan-7 XC7S100 FPGA

Zybo Z7: Zynq-7000 ARM/FPGA SoC Development Kit

The Zybo Z7 from Digilent is built around the Zynq-7000 device, integrating dual Arm® Cortex®-A9 processors with 7 series programmable logic. The Zybo Z7 kit offers a video-capable feature set that includes a MIPI CSI-2 compatible Pcam connector, HDMI input and output, high DDR3L bandwidth, and other multimedia and connectivity peripherals. This feature set provides an affordable solution for complex embedded vision applications.

Featuring the Zynq-7000 XCZ7010 SoC or XC7Z020 SoC

Zynq UltraScale+ MPSoC ZCU104 Evaluation Kit

The ZCU104 Evaluation Kit enables designers to jumpstart designs for embedded vision applications such as surveillance, Advanced Driver Assisted Systems (ADAS), machine vision, Augmented Reality (AR), drones, and medical imaging. This kit features a Zynq® UltraScale+™ MPSoC EV device with integrated video codec and supports many common peripherals and interfaces for embedded vision applications. The included ZU7EV device is equipped with a quad-core Arm® Cortex®-A53 applications processor, dual-core Cortex-R5F real-time processor, Mali™-400 MP2 graphic processing unit, 4KP60 capable H.264/H.265 video codec, and 16nm FinFET+ programmable logic.
Learn More >

Featuring the Zynq UltraScale+ XCZU7EV-2FFVC1156 MPSoC

Ultra96-V2 Zynq UltraScale+ ZU3EG

Ultra96-V2, is an Arm-based development board built around the Zynq UltraScale+™ MPSoC. Available in commercial and industrial temperature grades, Ultra96-V2 has been designed with a certified radio module from Microchip. Additional power control and monitoring is possible with the included Infineon Pmics. Engineers have options of connecting to Ultra96-V2 through a Webserver using integrated wireless access point capability or to use the provided Linux Matchbox windows environment that can be viewed on the integrated Mini DisplayPort video output. Multiple application examples and onboard development options are provided as examples.
Learn More >

Featuring the Zynq UltraScale+ MPSoC ZU3EG A484

Versal AI Core Series VCK190 Evaluation Kit

The VCK190 kit is the first Versal™ AI Core series evaluation kit, enabling designers to develop solutions using AI and DSP engines capable of delivering over 100X greater compute performance than today's server-class CPUs.
With a breadth of connectivity options and standardized development flows, the VCK190 kit features the Versal AI Core series VC1902 device, providing the portfolio's highest AI inference and signal processing throughput.
Learn More >

Featuring the Versal VC1902 ACAP

Autonomous Control & Robotics

The UAV and Robotics Platform (URP) meets the typical processing requirements encountered when designing robotics and UAV applications. It is a Zynq UltraScale+ MPSoC based platform, providing a broad spectrum of processing capabilities. The small form factor board integrates sensors-on-board, software, and FPGA logic. With its motor control units, position sensors, obstacle detection interfaces, and communication resources, the URP can be used for many applications.
Learn More >

• Fully integrated high-performance navigation sensors
• Multi-camera and sensor fusion
• High-bandwidth connectivity
• Onboard hosting of autopilot on real-time processing cores
• Reliable high-speed motor control solution
• High-performance infrastructure for video processing
• High-level-synthesis supports rapid algorithm development and implementation

• H.265 codec VCU supporting 4K60fps
• Dimensions: 135 mm x 68.4 mm x 10 mm
• Onboard high-efficiency power supplies
• Support for NVMe SSD, PCIe, Gigabit Ethernet, DisplayPort, HDMI
• Advanced debug support
• Industrial temperature (-40°C +85°C)

• Dual 4K camera interfaces
• High-performance DDR4 memory 64bits + 8bits ECC
• Navigation sensors
• Positional sensors
• Quad motion control interfaces
• Support for NVMe SSD, PCIe, Ethernet, DisplayPort, HDMI
  

• Ease of use within Vivado Design Suite and IP Integrator
• Pre-built reference designs available for Spartan-7, Zynq UltraScale+, and Versal ACAP devices
  
• Available plug-and-play IP for hardware accelerated Image Signal Processing (ISP) flexibility
• No previous FPGA experience necessary