Display HDR video in EDR with AVFoundation and Metal

RSS for tag

Discuss the WWDC22 Session Display HDR video in EDR with AVFoundation and Metal

Posts under wwdc2022-110565 tag

7 Posts

Post

Replies

Boosts

Views

Activity

How to improve quality in terms of readability and resolution for images taken using AVCaptureVideoDataOutput()?
We are using AVCaptureVideoDataOutput() as photo output Instance, to capture images. But there was major reduction in the quality of the image as compared to UIImagePickerController which we were using previously. We cannot use AVCapturePhotoOutput or AVCaptureStillImageOutput for capturing the photoOutput as we need to capture  every  single frame of the camera for live filtering  with some filters. Is there a way we can improve the quality of the images taken using AVCaptureVideoDataOutput(), and make the quality equivalent to the image taken using UIImagePickerController?
0
1
735
Feb ’23
HDR video rendering bugs
I use AVSimpleBufferDisplayLayer(iOS14+) / MetalLayer(iOS16) to show HDR videos in my app.The video content is displayed well, and it is easy to find the brightness is higher than SDR video. But I found some bugs: 1.When playing the HDR video especially the content is white, the UI is darker than video content, that makes users can't see the UI clearly. I haven't found a way to increase the UI's brightness to suit the HDR video content as now SDR video content do. 2.When playing the HDR video, screenrecording makes the HDR content darker, I think it is an abnormal thing.
0
0
1.1k
Nov ’22
UI looks terriable when playing HDR video
Problem: When playing HDR video, the screen is brighter, the UI seems not only brighter but also darker! It makes the UI blurred, influence user experience! I also tried system photo app, it also has this bad case. I take photos to show you what the bad case looks like. SDR: HDR: Expect: The UI’s brightness fit HDR video, just like playing SDR video.
2
1
1.5k
Sep ’22
Apple.PHASE Unity Plug-in as AVAudioNode
Hi, my name is Jakob, we are working on sound creation apps with a visual and spatial approach in Unity. For iOS, we are using the "Unity as a library"-approach, so we have a native app part which is written in Swift and access to the AVAudioSession. Everything works great, except for one feature: We want to send the audio data generated with our app as binaural mix to another host app. To do so, we need to feed that data into an AVAudioUnit in our native iOS app. There are different approaches and we keep on making research and working on solutions. Could your new native spatial audio Unity plug-in Apple.PHASE might be a direct bridge feeding an AVAudioNode and combine the needs in between music and spatial audio content creators. Thanks a lot in advance & all the best!
0
0
1.6k
Sep ’22
Will the iPhone not handle static metadata on HDR10?
I'm trying two different playback strategies to play HDR10 videos on iPhone: A:Use VideoToolBox to decode the video, and then hand it over to AVSampleBufferDisplayLayer on the screen B:Use AVPlayer player I found this tow has the same effect Then I copied a HDR10 video and deleted its static metadata, named it HDR10-No-Static-Metadata, then handed it to player A, and handed the original video to player B , compared the two effects, and found that they were still the same. Does this mean that iOS is not referencing static metadata when playing HDR10 video? Any help would be appreciated.
1
0
820
Aug ’22
How to capture 48 MP Apple ProRAW?
Hello, We are developing to shoot 48MP Apple Pro Raw feature in my app, but we couldn't find any documentation on shooting 48MP Apple Pro Raw. Is it possible to shoot 48MP Apple ProRaw with a third-party app? Any help is much appreciated. Thanks.
Replies
9
Boosts
1
Views
5.5k
Activity
Sep ’23
What is the Metal pixel format corresponding to kCVPixelFormatType_Lossless_420YpCbCr10PackedBiPlanarVideoRange?
I couldn't find Metal pixel format corresponding to kCVPixelFormatType_Lossless_420YpCbCr10PackedBiPlanarVideoRange
Replies
0
Boosts
0
Views
977
Activity
Apr ’23
How to improve quality in terms of readability and resolution for images taken using AVCaptureVideoDataOutput()?
We are using AVCaptureVideoDataOutput() as photo output Instance, to capture images. But there was major reduction in the quality of the image as compared to UIImagePickerController which we were using previously. We cannot use AVCapturePhotoOutput or AVCaptureStillImageOutput for capturing the photoOutput as we need to capture  every  single frame of the camera for live filtering  with some filters. Is there a way we can improve the quality of the images taken using AVCaptureVideoDataOutput(), and make the quality equivalent to the image taken using UIImagePickerController?
Replies
0
Boosts
1
Views
735
Activity
Feb ’23
HDR video rendering bugs
I use AVSimpleBufferDisplayLayer(iOS14+) / MetalLayer(iOS16) to show HDR videos in my app.The video content is displayed well, and it is easy to find the brightness is higher than SDR video. But I found some bugs: 1.When playing the HDR video especially the content is white, the UI is darker than video content, that makes users can't see the UI clearly. I haven't found a way to increase the UI's brightness to suit the HDR video content as now SDR video content do. 2.When playing the HDR video, screenrecording makes the HDR content darker, I think it is an abnormal thing.
Replies
0
Boosts
0
Views
1.1k
Activity
Nov ’22
UI looks terriable when playing HDR video
Problem: When playing HDR video, the screen is brighter, the UI seems not only brighter but also darker! It makes the UI blurred, influence user experience! I also tried system photo app, it also has this bad case. I take photos to show you what the bad case looks like. SDR: HDR: Expect: The UI’s brightness fit HDR video, just like playing SDR video.
Replies
2
Boosts
1
Views
1.5k
Activity
Sep ’22
Apple.PHASE Unity Plug-in as AVAudioNode
Hi, my name is Jakob, we are working on sound creation apps with a visual and spatial approach in Unity. For iOS, we are using the "Unity as a library"-approach, so we have a native app part which is written in Swift and access to the AVAudioSession. Everything works great, except for one feature: We want to send the audio data generated with our app as binaural mix to another host app. To do so, we need to feed that data into an AVAudioUnit in our native iOS app. There are different approaches and we keep on making research and working on solutions. Could your new native spatial audio Unity plug-in Apple.PHASE might be a direct bridge feeding an AVAudioNode and combine the needs in between music and spatial audio content creators. Thanks a lot in advance & all the best!
Replies
0
Boosts
0
Views
1.6k
Activity
Sep ’22
Will the iPhone not handle static metadata on HDR10?
I'm trying two different playback strategies to play HDR10 videos on iPhone: A:Use VideoToolBox to decode the video, and then hand it over to AVSampleBufferDisplayLayer on the screen B:Use AVPlayer player I found this tow has the same effect Then I copied a HDR10 video and deleted its static metadata, named it HDR10-No-Static-Metadata, then handed it to player A, and handed the original video to player B , compared the two effects, and found that they were still the same. Does this mean that iOS is not referencing static metadata when playing HDR10 video? Any help would be appreciated.
Replies
1
Boosts
0
Views
820
Activity
Aug ’22