Post

Replies

Boosts

Views

Activity

Reply to EDR doesn't work on iOS?
To enable EDR rendering, all we do is to set the colorPixelFormat to MTLPixelFormatRGBA16Float (note: RGBA, not BGRA) and wantsExtendedDynamicRangeContent to YES. We don't change the colorSpace since it is already set to extended linear sRGB when setting the other properties. As soon as we render pixel values outside [0...1], the screen switches to EDR mode and the potential and current HDR headroom adjust accordingly.
Topic: Graphics & Games SubTopic: Metal Tags:
Mar ’23
Reply to High CPU usage with CoreImage vs Metal
Every time you render a CIImage with a CIContext, CI does a filter graph analysis to determine the best path for rendering the image (determining intermediates, region of interest, kernel concatenation, etc.). This can be quite CPU-intensive. If you only have a few simple operations to perform on your image, and you can easily implement them in Metal directly, you are probably better off using that. However, I would also suggest you file Feedback with the Core Image team and report your findings. We also observe a very heavy CPU load in our apps, caused by Core Image. Maybe they find a way to further optimize the graph analysis – especially for consecutive render calls with the same instructions.
Topic: Graphics & Games SubTopic: General Tags:
Jul ’23
Reply to Core Image drawing corruption
Hmm, this is really hard to debug without seeing the actual filters. But if I would need to guess, I'd say the implementation of the ROI callback (passed when calling the CIKernel) is wrong. I can also recommend using a MTKView for displaying a CIImage instead of using Core Graphics. There is a sample from Apple showing how to do that.
Topic: UI Frameworks SubTopic: AppKit Tags:
Jul ’23
Reply to EDR doesn't work on iOS?
To enable EDR rendering, all we do is to set the colorPixelFormat to MTLPixelFormatRGBA16Float (note: RGBA, not BGRA) and wantsExtendedDynamicRangeContent to YES. We don't change the colorSpace since it is already set to extended linear sRGB when setting the other properties. As soon as we render pixel values outside [0...1], the screen switches to EDR mode and the potential and current HDR headroom adjust accordingly.
Topic: Graphics & Games SubTopic: Metal Tags:
Replies
Boosts
Views
Activity
Mar ’23
Reply to Unable to change Photos permission of iPad app on Mac
Also filed as FB12119140. Thanks!
Topic: App & System Services SubTopic: Core OS Tags:
Replies
Boosts
Views
Activity
Apr ’23
Reply to Current EDR headroom does not increase when lowering iPhone brightness.
I think this is a design decision from Apple's side. You are not supposed to set the pixel brightness to more than 8x the current brightness of the screen. Otherwise, you could "blind" the user with very bright pixels, even though they set the screen to be dim.
Topic: App & System Services SubTopic: Core OS Tags:
Replies
Boosts
Views
Activity
May ’23
Reply to [Unknown process name] CGImageCreate: invalid image byte order info for bitsPerPixel != 32 = 16384
Please provide a bit more context, e.g., what is the byte order info and pixel format you are setting?
Topic: Media Technologies SubTopic: General Tags:
Replies
Boosts
Views
Activity
May ’23
Reply to High CPU usage with CoreImage vs Metal
Every time you render a CIImage with a CIContext, CI does a filter graph analysis to determine the best path for rendering the image (determining intermediates, region of interest, kernel concatenation, etc.). This can be quite CPU-intensive. If you only have a few simple operations to perform on your image, and you can easily implement them in Metal directly, you are probably better off using that. However, I would also suggest you file Feedback with the Core Image team and report your findings. We also observe a very heavy CPU load in our apps, caused by Core Image. Maybe they find a way to further optimize the graph analysis – especially for consecutive render calls with the same instructions.
Topic: Graphics & Games SubTopic: General Tags:
Replies
Boosts
Views
Activity
Jul ’23
Reply to HEIF10 representation doesn't contain alpha channel
Filed as FB12389932. Thanks!
Topic: Media Technologies SubTopic: General Tags:
Replies
Boosts
Views
Activity
Jul ’23
Reply to Core Image drawing corruption
Can you please upload some screenshots to show what "corrupted" means? Thanks!
Topic: UI Frameworks SubTopic: AppKit Tags:
Replies
Boosts
Views
Activity
Jul ’23
Reply to Core Image drawing corruption
Hmm, this is really hard to debug without seeing the actual filters. But if I would need to guess, I'd say the implementation of the ROI callback (passed when calling the CIKernel) is wrong. I can also recommend using a MTKView for displaying a CIImage instead of using Core Graphics. There is a sample from Apple showing how to do that.
Topic: UI Frameworks SubTopic: AppKit Tags:
Replies
Boosts
Views
Activity
Jul ’23
Reply to GenerateAssetSymbols wrongly renaming image assets
Filed as FB12901757. Thanks for looking into this!
Replies
Boosts
Views
Activity
Aug ’23
Reply to CIColor.init(color: UIColor) not working properly on macOS 14 Catalyst
FB12914857. Thanks for looking into this!
Topic: App & System Services SubTopic: Core OS Tags:
Replies
Boosts
Views
Activity
Aug ’23
Reply to Issues with new MLE5Engine in Core ML
Also filed as FB12966266, including a demo project. Thanks for looking into this!
Topic: Machine Learning & AI SubTopic: Core ML Tags:
Replies
Boosts
Views
Activity
Aug ’23
Reply to Popover tips not affected by tip view modifiers
Filed under FB13121690. Thanks for looking into this!
Topic: UI Frameworks SubTopic: SwiftUI Tags:
Replies
Boosts
Views
Activity
Sep ’23
Reply to TipViewStyle with default dismiss button
You can also access the tip through the configuration. I think you can simply add a button to your tip layout that invalidates the tip when tapped: Button(action: { configuration.tip.invalidate(reason: .tipClosed) }, label: { Image(systemName: "xmark") })
Topic: App & System Services SubTopic: General Tags:
Replies
Boosts
Views
Activity
Sep ’23
Reply to SwiftUI: popoverTip prevents other modal views from appearing
Filed as FB13168973. Thanks!
Topic: UI Frameworks SubTopic: SwiftUI Tags:
Replies
Boosts
Views
Activity
Sep ’23
Reply to Issues with new MLE5Engine in Core ML
The issues seem to have been fixed on iOS 17.1 beta 2. Thanks a lot!
Topic: Machine Learning & AI SubTopic: Core ML Tags:
Replies
Boosts
Views
Activity
Oct ’23