Vulkan.Extensions.VK_QCOM_image_processing

Name

VK_QCOM_image_processing - device extension

VK_QCOM_image_processing

Name String

VK_QCOM_image_processing

Extension Type

Device extension

Registered Extension Number

441

Revision

1

Extension and Version Dependencies

• Requires support for Vulkan 1.0
• Requires VK_KHR_format_feature_flags2 to be enabled for any device-level functionality

Contact

• Jeff Leger @jackohound%0A*Here describe the issue or question you have about the VK_QCOM_image_processing extension*

Extension Proposal

VK_QCOM_image_processing

Other Extension Metadata

Last Modified Date

2022-07-08

Interactions and External Dependencies

• This extension requires SPV_QCOM_image_processing
• This extension provides API support for GL_QCOM_image_processing

Contributors

• Jeff Leger, Qualcomm Technologies, Inc.
• Ruihao Zhang, Qualcomm Technologies, Inc.

Description

GPUs are commonly used to process images for various applications from 3D graphics to UI and from composition to compute applications. Simple scaling and filtering can be done with bilinear filtering, which comes for free during texture sampling. However, as screen sizes get larger and more use-cases rely on GPU such as camera and video post-processing needs, there is increasing demand for GPU to support higher order filtering and other advanced image processing.

This extension introduces a new set of SPIR-V built-in functions for image processing. It exposes the following new imaging operations

• The OpImageSampleWeightedQCOM instruction takes 3 operands: sampled image, weight image, and texture coordinates. The instruction computes a weighted average of an MxN region of texels in the sampled image, using a set of MxN weights in the /weight image/.
• The OpImageBoxFilterQCOM instruction takes 3 operands: /sampled image, box size, and texture coordinates. Note that box size/ specifies a floating point width and height in texels. The instruction computes a weighted average of all texels in the sampled image that are covered (either partially or fully) by a box with the specified size and centered at the specified texture coordinates.
• The OpImageBlockMatchSADQCOM and OpImageBlockMatchSSDQCOM instructions each takes 5 operands: target image, /target coordinates, reference image, reference coordinates, and block size/. Each instruction computes an error metric, that describes whether a block of texels in the target image matches a corresponding block of texels in the reference image. The error metric is computed per-component. OpImageBlockMatchSADQCOM computes "Sum Of Absolute Difference" and OpImageBlockMatchSSDQCOM computes "Sum of Squared Difference".

Each of the image processing instructions operate only on 2D images. The instructions do not-support sampling of mipmap, multi-plane, multi-layer, multi-sampled, or depth/stencil images. The instructions can be used in any shader stage.

Implementations of this this extension should support these operations natively at the HW instruction level, offering potential performance gains as well as ease of development.

New Structures

• Extending ImageViewCreateInfo:

  • ImageViewSampleWeightCreateInfoQCOM

• Extending PhysicalDeviceFeatures2, DeviceCreateInfo:

  • PhysicalDeviceImageProcessingFeaturesQCOM

• Extending PhysicalDeviceProperties2:

  • PhysicalDeviceImageProcessingPropertiesQCOM

New Enum Constants

• QCOM_IMAGE_PROCESSING_EXTENSION_NAME

• QCOM_IMAGE_PROCESSING_SPEC_VERSION

• Extending DescriptorType:

  • DESCRIPTOR_TYPE_BLOCK_MATCH_IMAGE_QCOM
  • DESCRIPTOR_TYPE_SAMPLE_WEIGHT_IMAGE_QCOM

• Extending ImageUsageFlagBits:

  • IMAGE_USAGE_SAMPLE_BLOCK_MATCH_BIT_QCOM
  • IMAGE_USAGE_SAMPLE_WEIGHT_BIT_QCOM

• Extending SamplerCreateFlagBits:

  • SAMPLER_CREATE_IMAGE_PROCESSING_BIT_QCOM

• Extending StructureType:

  • STRUCTURE_TYPE_IMAGE_VIEW_SAMPLE_WEIGHT_CREATE_INFO_QCOM
  • STRUCTURE_TYPE_PHYSICAL_DEVICE_IMAGE_PROCESSING_FEATURES_QCOM
  • STRUCTURE_TYPE_PHYSICAL_DEVICE_IMAGE_PROCESSING_PROPERTIES_QCOM

If VK_KHR_format_feature_flags2 is supported:

• Extending FormatFeatureFlagBits2:

  • FORMAT_FEATURE_2_BLOCK_MATCHING_BIT_QCOM
  • FORMAT_FEATURE_2_BOX_FILTER_SAMPLED_BIT_QCOM
  • FORMAT_FEATURE_2_WEIGHT_IMAGE_BIT_QCOM
  • FORMAT_FEATURE_2_WEIGHT_SAMPLED_IMAGE_BIT_QCOM

Version History

• Revision 1, 2022-07-08 (Jeff Leger)

See Also

ImageViewSampleWeightCreateInfoQCOM, PhysicalDeviceImageProcessingFeaturesQCOM, PhysicalDeviceImageProcessingPropertiesQCOM

Document Notes

For more information, see the Vulkan Specification

This page is a generated document. Fixes and changes should be made to the generator scripts, not directly.

Documentation

data ImageViewSampleWeightCreateInfoQCOM

VkImageViewSampleWeightCreateInfoQCOM - Structure describing weight sampling parameters for image view

Description

The filterCenter specifies the origin or center of the filter kernel, as described in Weight Sampling Operation. The numPhases describes the number of sub-pixel filter phases as described in Weight Sampling Phases.

Valid Usage (Implicit)

See Also

VK_QCOM_image_processing, Extent2D, Offset2D, StructureType

Constructors

ImageViewSampleWeightCreateInfoQCOM

Fields

• filterCenter :: Offset2D

  filterCenter is a Offset2D describing the location of the weight filter origin.

• filterSize :: Extent2D

  filterSize is a Extent2D specifying weight filter dimensions.

• numPhases :: Word32

  numPhases is number of sub-pixel filter phases.

  numPhases must be a power of two squared value (i.e., 1, 4, 16, 64, 256, etc.)

  numPhases must be less than or equal to ::maxWeightFilterPhases

Instances

Show ImageViewSampleWeightCreateInfoQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

showsPrec :: Int -> ImageViewSampleWeightCreateInfoQCOM -> ShowS

show :: ImageViewSampleWeightCreateInfoQCOM -> String

showList :: [ImageViewSampleWeightCreateInfoQCOM] -> ShowS

Storable ImageViewSampleWeightCreateInfoQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

sizeOf :: ImageViewSampleWeightCreateInfoQCOM -> Int

alignment :: ImageViewSampleWeightCreateInfoQCOM -> Int

peekElemOff :: Ptr ImageViewSampleWeightCreateInfoQCOM -> Int -> IO ImageViewSampleWeightCreateInfoQCOM

pokeElemOff :: Ptr ImageViewSampleWeightCreateInfoQCOM -> Int -> ImageViewSampleWeightCreateInfoQCOM -> IO ()

peekByteOff :: Ptr b -> Int -> IO ImageViewSampleWeightCreateInfoQCOM

pokeByteOff :: Ptr b -> Int -> ImageViewSampleWeightCreateInfoQCOM -> IO ()

peek :: Ptr ImageViewSampleWeightCreateInfoQCOM -> IO ImageViewSampleWeightCreateInfoQCOM

poke :: Ptr ImageViewSampleWeightCreateInfoQCOM -> ImageViewSampleWeightCreateInfoQCOM -> IO ()

FromCStruct ImageViewSampleWeightCreateInfoQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

peekCStruct :: Ptr ImageViewSampleWeightCreateInfoQCOM -> IO ImageViewSampleWeightCreateInfoQCOM

ToCStruct ImageViewSampleWeightCreateInfoQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

withCStruct :: ImageViewSampleWeightCreateInfoQCOM -> (Ptr ImageViewSampleWeightCreateInfoQCOM -> IO b) -> IO b

pokeCStruct :: Ptr ImageViewSampleWeightCreateInfoQCOM -> ImageViewSampleWeightCreateInfoQCOM -> IO b -> IO b

withZeroCStruct :: (Ptr ImageViewSampleWeightCreateInfoQCOM -> IO b) -> IO b

pokeZeroCStruct :: Ptr ImageViewSampleWeightCreateInfoQCOM -> IO b -> IO b

cStructSize :: Int

cStructAlignment :: Int

Zero ImageViewSampleWeightCreateInfoQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

zero :: ImageViewSampleWeightCreateInfoQCOM

data PhysicalDeviceImageProcessingFeaturesQCOM

VkPhysicalDeviceImageProcessingFeaturesQCOM - Structure describing image processing features that can be supported by an implementation

Members

This structure describes the following features:

Description

If the PhysicalDeviceImageProcessingFeaturesQCOM structure is included in the pNext chain of the PhysicalDeviceFeatures2 structure passed to getPhysicalDeviceFeatures2, it is filled in to indicate whether each corresponding feature is supported. PhysicalDeviceImageProcessingFeaturesQCOM can also be used in the pNext chain of DeviceCreateInfo to selectively enable these features.

Valid Usage (Implicit)

See Also

VK_QCOM_image_processing, Bool32, StructureType

Constructors

PhysicalDeviceImageProcessingFeaturesQCOM

Fields

• textureSampleWeighted :: Bool

  textureSampleWeighted indicates that the implementation supports shader modules that declare the TextureSampleWeightedQCOM capability.

• textureBoxFilter :: Bool

  textureBoxFilter indicates that the implementation supports shader modules that declare the TextureBoxFilterQCOM capability.

• textureBlockMatch :: Bool

  textureBlockMatch indicates that the implementation supports shader modules that declare the TextureBlockMatchQCOM capability.

Instances

Eq PhysicalDeviceImageProcessingFeaturesQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

(==) :: PhysicalDeviceImageProcessingFeaturesQCOM -> PhysicalDeviceImageProcessingFeaturesQCOM -> Bool

(/=) :: PhysicalDeviceImageProcessingFeaturesQCOM -> PhysicalDeviceImageProcessingFeaturesQCOM -> Bool

Show PhysicalDeviceImageProcessingFeaturesQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

showsPrec :: Int -> PhysicalDeviceImageProcessingFeaturesQCOM -> ShowS

show :: PhysicalDeviceImageProcessingFeaturesQCOM -> String

showList :: [PhysicalDeviceImageProcessingFeaturesQCOM] -> ShowS

Storable PhysicalDeviceImageProcessingFeaturesQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

sizeOf :: PhysicalDeviceImageProcessingFeaturesQCOM -> Int

alignment :: PhysicalDeviceImageProcessingFeaturesQCOM -> Int

peekElemOff :: Ptr PhysicalDeviceImageProcessingFeaturesQCOM -> Int -> IO PhysicalDeviceImageProcessingFeaturesQCOM

pokeElemOff :: Ptr PhysicalDeviceImageProcessingFeaturesQCOM -> Int -> PhysicalDeviceImageProcessingFeaturesQCOM -> IO ()

peekByteOff :: Ptr b -> Int -> IO PhysicalDeviceImageProcessingFeaturesQCOM

pokeByteOff :: Ptr b -> Int -> PhysicalDeviceImageProcessingFeaturesQCOM -> IO ()

peek :: Ptr PhysicalDeviceImageProcessingFeaturesQCOM -> IO PhysicalDeviceImageProcessingFeaturesQCOM

poke :: Ptr PhysicalDeviceImageProcessingFeaturesQCOM -> PhysicalDeviceImageProcessingFeaturesQCOM -> IO ()

FromCStruct PhysicalDeviceImageProcessingFeaturesQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

peekCStruct :: Ptr PhysicalDeviceImageProcessingFeaturesQCOM -> IO PhysicalDeviceImageProcessingFeaturesQCOM

ToCStruct PhysicalDeviceImageProcessingFeaturesQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

withCStruct :: PhysicalDeviceImageProcessingFeaturesQCOM -> (Ptr PhysicalDeviceImageProcessingFeaturesQCOM -> IO b) -> IO b

pokeCStruct :: Ptr PhysicalDeviceImageProcessingFeaturesQCOM -> PhysicalDeviceImageProcessingFeaturesQCOM -> IO b -> IO b

withZeroCStruct :: (Ptr PhysicalDeviceImageProcessingFeaturesQCOM -> IO b) -> IO b

pokeZeroCStruct :: Ptr PhysicalDeviceImageProcessingFeaturesQCOM -> IO b -> IO b

cStructSize :: Int

cStructAlignment :: Int

Zero PhysicalDeviceImageProcessingFeaturesQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

zero :: PhysicalDeviceImageProcessingFeaturesQCOM

data PhysicalDeviceImageProcessingPropertiesQCOM

VkPhysicalDeviceImageProcessingPropertiesQCOM - Structure containing image processing properties

Members

• sType is the type of this structure.

• pNext is NULL or a pointer to a structure extending this structure.
• maxWeightFilterPhases is the maximum value that can be specified for ImageViewSampleWeightCreateInfoQCOM::numPhases. in weight image sampling operations.
• maxWeightFilterDimension is a Extent2D describing the largest dimensions (width and height) that can be specified for ImageViewSampleWeightCreateInfoQCOM::filterSize.
• maxBlockMatchRegion is a Extent2D describing the largest dimensions (width and height) that can be specified for blockSize in block matching operations.
• maxBoxFilterBlockSize is a Extent2D describing the the maximum dimensions (width and height) that can be specified for blocksize in box filter sampling operations.

Description

If the PhysicalDeviceImageProcessingPropertiesQCOM structure is included in the pNext chain of the PhysicalDeviceProperties2 structure passed to getPhysicalDeviceProperties2, it is filled in with each corresponding implementation-dependent property.

These are properties of the image processing information of a physical device.

Valid Usage (Implicit)

See Also

VK_QCOM_image_processing, Extent2D, StructureType

Constructors

PhysicalDeviceImageProcessingPropertiesQCOM

Fields

• maxWeightFilterPhases :: Word32
• maxWeightFilterDimension :: Extent2D
• maxBlockMatchRegion :: Extent2D
• maxBoxFilterBlockSize :: Extent2D

Instances

Show PhysicalDeviceImageProcessingPropertiesQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

showsPrec :: Int -> PhysicalDeviceImageProcessingPropertiesQCOM -> ShowS

show :: PhysicalDeviceImageProcessingPropertiesQCOM -> String

showList :: [PhysicalDeviceImageProcessingPropertiesQCOM] -> ShowS

Storable PhysicalDeviceImageProcessingPropertiesQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

sizeOf :: PhysicalDeviceImageProcessingPropertiesQCOM -> Int

alignment :: PhysicalDeviceImageProcessingPropertiesQCOM -> Int

peekElemOff :: Ptr PhysicalDeviceImageProcessingPropertiesQCOM -> Int -> IO PhysicalDeviceImageProcessingPropertiesQCOM

pokeElemOff :: Ptr PhysicalDeviceImageProcessingPropertiesQCOM -> Int -> PhysicalDeviceImageProcessingPropertiesQCOM -> IO ()

peekByteOff :: Ptr b -> Int -> IO PhysicalDeviceImageProcessingPropertiesQCOM

pokeByteOff :: Ptr b -> Int -> PhysicalDeviceImageProcessingPropertiesQCOM -> IO ()

peek :: Ptr PhysicalDeviceImageProcessingPropertiesQCOM -> IO PhysicalDeviceImageProcessingPropertiesQCOM

poke :: Ptr PhysicalDeviceImageProcessingPropertiesQCOM -> PhysicalDeviceImageProcessingPropertiesQCOM -> IO ()

FromCStruct PhysicalDeviceImageProcessingPropertiesQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

peekCStruct :: Ptr PhysicalDeviceImageProcessingPropertiesQCOM -> IO PhysicalDeviceImageProcessingPropertiesQCOM

ToCStruct PhysicalDeviceImageProcessingPropertiesQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

withCStruct :: PhysicalDeviceImageProcessingPropertiesQCOM -> (Ptr PhysicalDeviceImageProcessingPropertiesQCOM -> IO b) -> IO b

pokeCStruct :: Ptr PhysicalDeviceImageProcessingPropertiesQCOM -> PhysicalDeviceImageProcessingPropertiesQCOM -> IO b -> IO b

withZeroCStruct :: (Ptr PhysicalDeviceImageProcessingPropertiesQCOM -> IO b) -> IO b

pokeZeroCStruct :: Ptr PhysicalDeviceImageProcessingPropertiesQCOM -> IO b -> IO b

cStructSize :: Int

cStructAlignment :: Int

Zero PhysicalDeviceImageProcessingPropertiesQCOM

Defined in Vulkan.Extensions.VK_QCOM_image_processing

Methods

zero :: PhysicalDeviceImageProcessingPropertiesQCOM

type QCOM_IMAGE_PROCESSING_SPEC_VERSION = 1

pattern QCOM_IMAGE_PROCESSING_SPEC_VERSION :: forall a. Integral a => a

type QCOM_IMAGE_PROCESSING_EXTENSION_NAME = "VK_QCOM_image_processing"

pattern QCOM_IMAGE_PROCESSING_EXTENSION_NAME :: forall a. (Eq a, IsString a) => a