Added in API level 21

StreamConfigurationMap

public final class StreamConfigurationMap
extends Object

java.lang.Object
   ↳ android.hardware.camera2.params.StreamConfigurationMap


Immutable class to store the available stream configurations to set up Surfaces for creating a capture session with CameraDevice.createCaptureSession(SessionConfiguration).

This is the authoritative list for all output formats (and sizes respectively for that format) that are supported by a camera device.

This also contains the minimum frame durations and stall durations for each format/size combination that can be used to calculate effective frame rate when submitting multiple captures.

An instance of this object is available from CameraCharacteristics using the CameraCharacteristics#SCALER_STREAM_CONFIGURATION_MAP key and the CameraCharacteristics#get method.

CameraCharacteristics characteristics = cameraManager.getCameraCharacteristics(cameraId);
 StreamConfigurationMap configs = characteristics.get(
         CameraCharacteristics.SCALER_STREAM_CONFIGURATION_MAP);
 

Summary

Public methods

boolean equals(Object obj)

Check if this StreamConfigurationMap is equal to another StreamConfigurationMap.

Size[] getHighResolutionOutputSizes(int format)

Get a list of supported high resolution sizes, which cannot operate at full BURST_CAPTURE rate.

Range[]<Integer> getHighSpeedVideoFpsRanges()

Get a list of supported high speed video recording FPS ranges.

Range[]<Integer> getHighSpeedVideoFpsRangesFor(Size size)

Get the frame per second ranges (fpsMin, fpsMax) for input high speed video size.

Size[] getHighSpeedVideoSizes()

Get a list of supported high speed video recording sizes.

Size[] getHighSpeedVideoSizesFor(Range<Integer> fpsRange)

Get the supported video sizes for an input high speed FPS range.

int[] getInputFormats()

Get the image format input formats in this stream configuration.

Size[] getInputSizes(int format)

Get the supported input sizes for this input format.

int[] getOutputFormats()

Get the image format output formats in this stream configuration.

<T> long getOutputMinFrameDuration(Class<T> klass, Size size)

Get the minimum frame duration for the class/size combination (in nanoseconds).

long getOutputMinFrameDuration(int format, Size size)

Get the minimum frame duration for the format/size combination (in nanoseconds).

Size[] getOutputSizes(int format)

Get a list of sizes compatible with the requested image format.

<T> Size[] getOutputSizes(Class<T> klass)

Get a list of sizes compatible with klass to use as an output.

long getOutputStallDuration(int format, Size size)

Get the stall duration for the format/size combination (in nanoseconds).

<T> long getOutputStallDuration(Class<T> klass, Size size)

Get the stall duration for the class/size combination (in nanoseconds).

int[] getValidOutputFormatsForInput(int inputFormat)

Get the image format output formats for a reprocessing input format.

int hashCode()

Returns a hash code value for the object.

boolean isOutputSupportedFor(Surface surface)

Determine whether or not the surface in its current state is suitable to be included in a session as an output.

boolean isOutputSupportedFor(int format)

Determine whether or not output surfaces with a particular user-defined format can be passed createCaptureSession.

static <T> boolean isOutputSupportedFor(Class<T> klass)

Determine whether or not output streams can be configured with a particular class as a consumer.

String toString()

Return this StreamConfigurationMap as a string representation.

Inherited methods

Public methods

equals

Added in API level 21
public boolean equals (Object obj)

Check if this StreamConfigurationMap is equal to another StreamConfigurationMap.

Two vectors are only equal if and only if each of the respective elements is equal.

Parameters
obj Object: the reference object with which to compare.

Returns
boolean true if the objects were equal, false otherwise

getHighResolutionOutputSizes

Added in API level 23
public Size[] getHighResolutionOutputSizes (int format)

Get a list of supported high resolution sizes, which cannot operate at full BURST_CAPTURE rate.

This includes all output sizes that cannot meet the 20 fps frame rate requirements for the BURST_CAPTURE capability. This does not include the stall duration, so for example, a JPEG or RAW16 output resolution with a large stall duration but a minimum frame duration that's above 20 fps will still be listed in the regular getOutputSizes(int) list. All the sizes on this list that are less than 24 megapixels are still guaranteed to operate at a rate of at least 10 fps, not including stall duration. Sizes on this list that are at least 24 megapixels are allowed to operate at less than 10 fps.

For a device that does not support the BURST_CAPTURE capability, this list will be null, since resolutions in the getOutputSizes(int) list are already not guaranteed to meet >= 20 fps rate requirements. For a device that does support the BURST_CAPTURE capability, this list may be empty, if all supported resolutions meet the 20 fps requirement.

Parameters
format int

Returns
Size[] an array of supported slower high-resolution sizes, or null if the BURST_CAPTURE capability is not supported

getHighSpeedVideoFpsRanges

Added in API level 21
public Range[]<Integer> getHighSpeedVideoFpsRanges ()

Get a list of supported high speed video recording FPS ranges.

When CameraMetadata#REQUEST_AVAILABLE_CAPABILITIES_CONSTRAINED_HIGH_SPEED_VIDEO is supported in CameraCharacteristics#REQUEST_AVAILABLE_CAPABILITIES, this method will list the supported high speed video FPS range configurations. Application can then use getHighSpeedVideoSizesFor(Range) to query available sizes for one of returned FPS range.

To enable high speed video recording, application must create a constrained create high speed capture session via CameraDevice#createConstrainedHighSpeedCaptureSession, and submit a CaptureRequest list created by CameraConstrainedHighSpeedCaptureSession.createHighSpeedRequestList(CaptureRequest) to this session. The application must select the video size from this method and FPS range from getHighSpeedVideoFpsRangesFor(Size) to configure the constrained high speed session and generate the high speed request list. For example, if the application intends to do high speed recording, it can select one FPS range reported by this method, query the video sizes corresponding to this FPS range by getHighSpeedVideoSizesFor(Range) and use one of reported sizes to create a high speed capture session. Note that for the use case of multiple output streams, application must select one unique size from this method to use (e.g., preview and recording streams must have the same size). Otherwise, the high speed session creation will fail. Once the high speed capture session is created, the application can set the FPS range in the recording request lists via CameraConstrainedHighSpeedCaptureSession.createHighSpeedRequestList(CaptureRequest).

The FPS ranges reported by this method will have below characteristics:

  • The fpsMin and fpsMax will be a multiple 30fps.
  • The fpsMin will be no less than 30fps, the fpsMax will be no less than 120fps.
  • At least one range will be a fixed FPS range where fpsMin == fpsMax.
  • For each fixed FPS range, there will be one corresponding variable FPS range [30, fps_max] or [60, fps_max]. These kinds of FPS ranges are suitable for preview-only use cases where the application doesn't want the camera device always produce higher frame rate than the display refresh rate. Both 30fps and 60fps preview rate will not be supported for the same recording rate.
  • Returns
    Range[]<Integer> an array of supported high speed video recording FPS ranges The upper bound of returned ranges is guaranteed to be larger or equal to 120.

    getHighSpeedVideoFpsRangesFor

    Added in API level 21
    public Range[]<Integer> getHighSpeedVideoFpsRangesFor (Size size)

    Get the frame per second ranges (fpsMin, fpsMax) for input high speed video size.

    See getHighSpeedVideoFpsRanges() for how to enable high speed recording.

    The FPS ranges reported in this method must not be used to setup capture requests that are submitted to unconstrained capture sessions, or it will result in IllegalArgumentExceptions.

    See getHighSpeedVideoFpsRanges() for the characteristics of the returned FPS ranges.

    Parameters
    size Size: one of the sizes returned by getHighSpeedVideoSizes()

    Returns
    Range[]<Integer> an array of supported high speed video recording FPS ranges The upper bound of returned ranges is guaranteed to be greater than or equal to 120.

    Throws
    IllegalArgumentException if input size does not exist in the return value of getHighSpeedVideoSizes

    getHighSpeedVideoSizes

    Added in API level 21
    public Size[] getHighSpeedVideoSizes ()

    Get a list of supported high speed video recording sizes.

    When CameraMetadata#REQUEST_AVAILABLE_CAPABILITIES_CONSTRAINED_HIGH_SPEED_VIDEO is supported in CameraCharacteristics#REQUEST_AVAILABLE_CAPABILITIES, this method will list the supported high speed video size configurations. All the sizes listed will be a subset of the sizes reported by getOutputSizes(int) for processed non-stalling formats (typically ImageFormat#PRIVATE ImageFormat#YUV_420_888, etc.)

    To enable high speed video recording, application must create a constrained create high speed capture session via CameraDevice#createConstrainedHighSpeedCaptureSession, and submit a CaptureRequest list created by CameraConstrainedHighSpeedCaptureSession.createHighSpeedRequestList(CaptureRequest) to this session. The application must select the video size from this method and FPS range from getHighSpeedVideoFpsRangesFor(Size) to configure the constrained high speed session and generate the high speed request list. For example, if the application intends to do high speed recording, it can select the maximum size reported by this method to create high speed capture session. Note that for the use case of multiple output streams, application must select one unique size from this method to use (e.g., preview and recording streams must have the same size). Otherwise, the high speed session creation will fail. Once the size is selected, application can get the supported FPS ranges by getHighSpeedVideoFpsRangesFor(Size), and use these FPS ranges to setup the recording request lists via CameraConstrainedHighSpeedCaptureSession.createHighSpeedRequestList(CaptureRequest).

    Returns
    Size[] an array of supported high speed video recording sizes

    getHighSpeedVideoSizesFor

    Added in API level 21
    public Size[] getHighSpeedVideoSizesFor (Range<Integer> fpsRange)

    Get the supported video sizes for an input high speed FPS range.

    See getHighSpeedVideoSizes() for how to enable high speed recording.

    Parameters
    fpsRange Range: one of the FPS range returned by getHighSpeedVideoFpsRanges()

    Returns
    Size[] An array of video sizes to create high speed capture sessions for high speed streaming use cases.

    Throws
    IllegalArgumentException if input FPS range does not exist in the return value of getHighSpeedVideoFpsRanges

    getInputFormats

    Added in API level 23
    public int[] getInputFormats ()

    Get the image format input formats in this stream configuration.

    All image formats returned by this function will be defined in either ImageFormat or in PixelFormat (and there is no possibility of collision).

    Returns
    int[] an array of integer format

    getInputSizes

    Added in API level 23
    public Size[] getInputSizes (int format)

    Get the supported input sizes for this input format.

    The format must have come from getInputFormats(); otherwise null is returned.

    Parameters
    format int: a format from getInputFormats()

    Returns
    Size[] a non-empty array of sizes, or null if the format was not available.

    getOutputFormats

    Added in API level 21
    public int[] getOutputFormats ()

    Get the image format output formats in this stream configuration.

    All image formats returned by this function will be defined in either ImageFormat or in PixelFormat (and there is no possibility of collision).

    Formats listed in this array are guaranteed to return true if queried with isOutputSupportedFor(int).

    Returns
    int[] an array of integer format

    getOutputMinFrameDuration

    Added in API level 21
    public long getOutputMinFrameDuration (Class<T> klass, 
                    Size size)

    Get the minimum frame duration for the class/size combination (in nanoseconds).

    This assumes that the klass is set up to use ImageFormat#PRIVATE. For user-defined formats, use getOutputMinFrameDuration(int, android.util.Size).

    klass should be one of the ones which is supported by isOutputSupportedFor(java.lang.Class).

    size should be one of the ones returned by getOutputSizes(int).

    This corresponds to the minimum frame duration (maximum frame rate) possible when only that stream is configured in a session, with all processing (typically in android.*.mode) set to either OFF or FAST.

    When multiple streams are used in a session, the minimum frame duration will be max(individual stream min durations). See getOutputStallDuration(int, Size) for details of timing for formats that may cause frame rate slowdown when they are targeted by a capture request.

    For devices that do not support manual sensor control (CameraMetadata.REQUEST_AVAILABLE_CAPABILITIES_MANUAL_SENSOR), this function may return 0.

    The minimum frame duration of a stream (of a particular format, size) is the same regardless of whether the stream is input or output.

    Parameters
    klass Class: a class which is supported by isOutputSupportedFor(java.lang.Class) and has a non-empty array returned by getOutputSizes(java.lang.Class)

    size Size: an output-compatible size

    Returns
    long a minimum frame duration > 0 in nanoseconds, or 0 if the minimum frame duration is not available.

    Throws
    IllegalArgumentException if klass or size was not supported
    NullPointerException if size or klass was null

    getOutputMinFrameDuration

    Added in API level 21
    public long getOutputMinFrameDuration (int format, 
                    Size size)

    Get the minimum frame duration for the format/size combination (in nanoseconds).

    format should be one of the ones returned by getOutputFormats().

    size should be one of the ones returned by getOutputSizes(int).

    This corresponds to the minimum frame duration (maximum frame rate) possible when only that stream is configured in a session, with all processing (typically in android.*.mode) set to either OFF or FAST.

    When multiple streams are used in a session, the minimum frame duration will be max(individual stream min durations). See getOutputStallDuration(int, Size) for details of timing for formats that may cause frame rate slowdown when they are targeted by a capture request.

    For devices that do not support manual sensor control (CameraMetadata.REQUEST_AVAILABLE_CAPABILITIES_MANUAL_SENSOR), this function may return 0.

    The minimum frame duration of a stream (of a particular format, size) is the same regardless of whether the stream is input or output.

    Parameters
    format int: an image format from ImageFormat or PixelFormat

    size Size: an output-compatible size

    Returns
    long a minimum frame duration > 0 in nanoseconds, or 0 if the minimum frame duration is not available.

    Throws
    IllegalArgumentException if format or size was not supported
    NullPointerException if size was null

    getOutputSizes

    Added in API level 21
    public Size[] getOutputSizes (int format)

    Get a list of sizes compatible with the requested image format.

    The format should be a supported format (one of the formats returned by getOutputFormats()).

    As of API level 23, the getHighResolutionOutputSizes(int) method can be used on devices that support the BURST_CAPTURE capability to get a list of high-resolution output sizes that cannot operate at the preferred 20fps rate. This means that for some supported formats, this method will return an empty list, if all the supported resolutions operate at below 20fps. For devices that do not support the BURST_CAPTURE capability, all output resolutions are listed through this method.

    Parameters
    format int: an image format from ImageFormat or PixelFormat

    Returns
    Size[] an array of supported sizes, or null if the format is not a supported output

    getOutputSizes

    Added in API level 21
    public Size[] getOutputSizes (Class<T> klass)

    Get a list of sizes compatible with klass to use as an output.

    Some of the supported classes may support additional formats beyond ImageFormat#PRIVATE; this function only returns sizes for ImageFormat#PRIVATE. For example, ImageReader supports ImageFormat#YUV_420_888 and ImageFormat#PRIVATE, this method will only return the sizes for ImageFormat#PRIVATE for ImageReader class.

    If a well-defined format such as NV21 is required, use getOutputSizes(int) instead.

    The klass should be a supported output, that querying #isOutputSupportedFor(Class) should return true.

    Parameters
    klass Class: a non-null Class object reference

    Returns
    Size[] an array of supported sizes for ImageFormat#PRIVATE format, or null iff the klass is not a supported output.

    Throws
    NullPointerException if klass was null

    getOutputStallDuration

    Added in API level 21
    public long getOutputStallDuration (int format, 
                    Size size)

    Get the stall duration for the format/size combination (in nanoseconds).

    format should be one of the ones returned by getOutputFormats().

    size should be one of the ones returned by getOutputSizes(int).

    A stall duration is how much extra time would get added to the normal minimum frame duration for a repeating request that has streams with non-zero stall.

    For example, consider JPEG captures which have the following characteristics:

    • JPEG streams act like processed YUV streams in requests for which they are not included; in requests in which they are directly referenced, they act as JPEG streams. This is because supporting a JPEG stream requires the underlying YUV data to always be ready for use by a JPEG encoder, but the encoder will only be used (and impact frame duration) on requests that actually reference a JPEG stream.
    • The JPEG processor can run concurrently to the rest of the camera pipeline, but cannot process more than 1 capture at a time.

    In other words, using a repeating YUV request would result in a steady frame rate (let's say it's 30 FPS). If a single JPEG request is submitted periodically, the frame rate will stay at 30 FPS (as long as we wait for the previous JPEG to return each time). If we try to submit a repeating YUV + JPEG request, then the frame rate will drop from 30 FPS.

    In general, submitting a new request with a non-0 stall time stream will not cause a frame rate drop unless there are still outstanding buffers for that stream from previous requests.

    Submitting a repeating request with streams (call this S) is the same as setting the minimum frame duration from the normal minimum frame duration corresponding to S, added with the maximum stall duration for S.

    If interleaving requests with and without a stall duration, a request will stall by the maximum of the remaining times for each can-stall stream with outstanding buffers.

    This means that a stalling request will not have an exposure start until the stall has completed.

    This should correspond to the stall duration when only that stream is active, with all processing (typically in android.*.mode) set to FAST or OFF. Setting any of the processing modes to HIGH_QUALITY effectively results in an indeterminate stall duration for all streams in a request (the regular stall calculation rules are ignored).

    The following formats may always have a stall duration:

    The following formats will never have a stall duration:

    All other formats may or may not have an allowed stall duration on a per-capability basis; refer to android.request.availableCapabilities for more details.

    See android.sensor.frameDuration for more information about calculating the max frame rate (absent stalls).

    Parameters
    format int: an image format from ImageFormat or PixelFormat

    size Size: an output-compatible size

    Returns
    long a stall duration >= 0 in nanoseconds

    Throws
    IllegalArgumentException if format or size was not supported
    NullPointerException if size was null

    getOutputStallDuration

    Added in API level 21
    public long getOutputStallDuration (Class<T> klass, 
                    Size size)

    Get the stall duration for the class/size combination (in nanoseconds).

    This assumes that the klass is set up to use ImageFormat#PRIVATE. For user-defined formats, use getOutputMinFrameDuration(int, android.util.Size).

    klass should be one of the ones with a non-empty array returned by getOutputSizes(java.lang.Class).

    size should be one of the ones returned by getOutputSizes(java.lang.Class).

    See getOutputStallDuration(int, android.util.Size) for a definition of a stall duration.

    Parameters
    klass Class: a class which is supported by isOutputSupportedFor(java.lang.Class) and has a non-empty array returned by getOutputSizes(java.lang.Class)

    size Size: an output-compatible size

    Returns
    long a minimum frame duration >= 0 in nanoseconds

    Throws
    IllegalArgumentException if klass or size was not supported
    NullPointerException if size or klass was null

    getValidOutputFormatsForInput

    Added in API level 23
    public int[] getValidOutputFormatsForInput (int inputFormat)

    Get the image format output formats for a reprocessing input format.

    When submitting a CaptureRequest with an input Surface of a given format, the only allowed target outputs of the CaptureRequest are the ones with a format listed in the return value of this method. Including any other output Surface as a target will throw an IllegalArgumentException. If no output format is supported given the input format, an empty int[] will be returned.

    All image formats returned by this function will be defined in either ImageFormat or in PixelFormat (and there is no possibility of collision).

    Formats listed in this array are guaranteed to return true if queried with isOutputSupportedFor(int).

    Parameters
    inputFormat int

    Returns
    int[] an array of integer format

    hashCode

    Added in API level 21
    public int hashCode ()

    Returns a hash code value for the object. This method is supported for the benefit of hash tables such as those provided by HashMap.

    The general contract of hashCode is:

    • Whenever it is invoked on the same object more than once during an execution of a Java application, the hashCode method must consistently return the same integer, provided no information used in equals comparisons on the object is modified. This integer need not remain consistent from one execution of an application to another execution of the same application.
    • If two objects are equal according to the equals method, then calling the hashCode method on each of the two objects must produce the same integer result.
    • It is not required that if two objects are unequal according to the equals method, then calling the hashCode method on each of the two objects must produce distinct integer results. However, the programmer should be aware that producing distinct integer results for unequal objects may improve the performance of hash tables.

    Returns
    int a hash code value for this object.

    isOutputSupportedFor

    Added in API level 21
    public boolean isOutputSupportedFor (Surface surface)

    Determine whether or not the surface in its current state is suitable to be included in a session as an output.

    Not all surfaces are usable with the CameraDevice, and not all configurations of that surface are compatible. Some classes that provide the surface are compatible with the CameraDevice in general (see isOutputSupportedFor(java.lang.Class), but it is the caller's responsibility to put the surface into a state that will be compatible with the CameraDevice.

    Reasons for a surface being specifically incompatible might be:

    • Using a format that's not listed by getOutputFormats()
    • Using a format/size combination that's not listed by getOutputSizes(int)
    • The surface itself is not in a state where it can service a new producer.

    Surfaces from flexible sources will return true even if the exact size of the Surface does not match a camera-supported size, as long as the format (or class) is supported and the camera device supports a size that is equal to or less than 1080p in that format. If such as Surface is used to create a capture session, it will have its size rounded to the nearest supported size, below or equal to 1080p. Flexible sources include SurfaceView, SurfaceTexture, and ImageReader.

    This is not an exhaustive list; see the particular class's documentation for further possible reasons of incompatibility.

    Parameters
    surface Surface: a non-null Surface object reference

    Returns
    boolean true if this is supported, false otherwise

    Throws
    NullPointerException if surface was null
    IllegalArgumentException if the Surface endpoint is no longer valid

    isOutputSupportedFor

    Added in API level 21
    public boolean isOutputSupportedFor (int format)

    Determine whether or not output surfaces with a particular user-defined format can be passed createCaptureSession.

    This method determines that the output format is supported by the camera device; each output surface target may or may not itself support that format. Refer to the class which provides the surface for additional documentation.

    Formats for which this returns true are guaranteed to exist in the result returned by getOutputSizes(int).

    Parameters
    format int: an image format from either ImageFormat or PixelFormat

    Returns
    boolean true iff using a surface with this format will be supported with CameraDevice#createCaptureSession(SessionConfiguration)

    Throws
    IllegalArgumentException if the image format was not a defined named constant from either ImageFormat or PixelFormat

    isOutputSupportedFor

    Added in API level 21
    public static boolean isOutputSupportedFor (Class<T> klass)

    Determine whether or not output streams can be configured with a particular class as a consumer.

    The following list is generally usable for outputs:

    • ImageReader - Recommended for image processing or streaming to external resources (such as a file or network)
    • MediaRecorder - Recommended for recording video (simple to use)
    • MediaCodec - Recommended for recording video (more complicated to use, with more flexibility)
    • SurfaceHolder - Recommended for low-power camera preview with SurfaceView
    • SurfaceTexture - Recommended for OpenGL-accelerated preview processing or compositing with TextureView

    Generally speaking this means that creating a Surface from that class may provide a producer endpoint that is suitable to be used with CameraDevice#createCaptureSession(SessionConfiguration).

    Since not all of the above classes support output of all format and size combinations, the particular combination should be queried with isOutputSupportedFor(android.view.Surface).

    Parameters
    klass Class: a non-null Class object reference

    Returns
    boolean true if this class is supported as an output, false otherwise

    Throws
    NullPointerException if klass was null

    toString

    Added in API level 21
    public String toString ()

    Return this StreamConfigurationMap as a string representation.

    "StreamConfigurationMap(Outputs([w:%d, h:%d, format:%s(%d), min_duration:%d, stall:%d], ... [w:%d, h:%d, format:%s(%d), min_duration:%d, stall:%d]), Inputs([w:%d, h:%d, format:%s(%d)], ... [w:%d, h:%d, format:%s(%d)]), ValidOutputFormatsForInput( [in:%d, out:%d, ... %d], ... [in:%d, out:%d, ... %d]), HighSpeedVideoConfigurations( [w:%d, h:%d, min_fps:%d, max_fps:%d], ... [w:%d, h:%d, min_fps:%d, max_fps:%d]))".

    Outputs([w:%d, h:%d, format:%s(%d), min_duration:%d, stall:%d], ... [w:%d, h:%d, format:%s(%d), min_duration:%d, stall:%d]), where [w:%d, h:%d, format:%s(%d), min_duration:%d, stall:%d] represents an output configuration's width, height, format, minimal frame duration in nanoseconds, and stall duration in nanoseconds.

    Inputs([w:%d, h:%d, format:%s(%d)], ... [w:%d, h:%d, format:%s(%d)]), where [w:%d, h:%d, format:%s(%d)] represents an input configuration's width, height, and format.

    ValidOutputFormatsForInput([in:%s(%d), out:%s(%d), ... %s(%d)], ... [in:%s(%d), out:%s(%d), ... %s(%d)]), where [in:%s(%d), out:%s(%d), ... %s(%d)] represents an input format and its valid output formats.

    HighSpeedVideoConfigurations([w:%d, h:%d, min_fps:%d, max_fps:%d], ... [w:%d, h:%d, min_fps:%d, max_fps:%d]), where [w:%d, h:%d, min_fps:%d, max_fps:%d] represents a high speed video output configuration's width, height, minimal frame rate, and maximal frame rate.

    Returns
    String string representation of StreamConfigurationMap