[Mac/iOS] feat: Add RTCYUVHelper for darwin. #28

cloudwebrtc · 2022-05-17T15:37:11Z

fix flutter-webrtc/flutter-webrtc#948
fix flutter-webrtc/flutter-webrtc#782

hiroshihorie

Nice !

~~So after this, FlutterRTCVideoRenderer needs to be updated ?~~
You already have a PR for that also 🙂

* feat: Add RTCYUVHelper for darwin. * chore: Add newline end of files.

[Mac/iOS] feat: Add RTCYUVHelper for darwin. (#28) Cross-platform `RTCMTLVideoView` for both iOS / macOS (#40) rotationOverride should not be assign (#44) [ObjC] Expose properties / methods required for AV1 codec support (#60) Workaround: Render PixelBuffer in RTCMTLVideoView (#58) Co-authored-by: Hiroshi Horie <548776+hiroshihorie@users.noreply.github.com>

[Mac/iOS] feat: Add RTCYUVHelper for darwin. (#28) Cross-platform `RTCMTLVideoView` for both iOS / macOS (#40) rotationOverride should not be assign (#44) [ObjC] Expose properties / methods required for AV1 codec support (#60) Workaround: Render PixelBuffer in RTCMTLVideoView (#58) Improve iOS/macOS H264 encoder (#70) Co-authored-by: Hiroshi Horie <548776+hiroshihorie@users.noreply.github.com>

[Mac/iOS] feat: Add RTCYUVHelper for darwin. (#28) Cross-platform `RTCMTLVideoView` for both iOS / macOS (#40) rotationOverride should not be assign (#44) [ObjC] Expose properties / methods required for AV1 codec support (#60) Workaround: Render PixelBuffer in RTCMTLVideoView (#58) Improve iOS/macOS H264 encoder (#70) fix: fix video encoder not resuming correctly upon foregrounding (#75). Co-authored-by: Hiroshi Horie <548776+hiroshihorie@users.noreply.github.com>

[Mac/iOS] feat: Add RTCYUVHelper for darwin. (#28) Cross-platform `RTCMTLVideoView` for both iOS / macOS (#40) rotationOverride should not be assign (#44) [ObjC] Expose properties / methods required for AV1 codec support (#60) Workaround: Render PixelBuffer in RTCMTLVideoView (#58) Improve iOS/macOS H264 encoder (#70) fix: fix video encoder not resuming correctly upon foregrounding (#75). add PrivacyInfo.xcprivacy to darwin frameworks. (#112) Add NSPrivacyCollectedDataTypes key to xcprivacy file (#114) Thread-safe `RTCInitFieldTrialDictionary` (#116) Co-authored-by: Hiroshi Horie <548776+hiroshihorie@users.noreply.github.com>

[Mac/iOS] feat: Add RTCYUVHelper for darwin. (#28) Cross-platform `RTCMTLVideoView` for both iOS / macOS (#40) rotationOverride should not be assign (#44) [ObjC] Expose properties / methods required for AV1 codec support (#60) Workaround: Render PixelBuffer in RTCMTLVideoView (#58) Improve iOS/macOS H264 encoder (#70) fix: fix video encoder not resuming correctly upon foregrounding (#75). Fix camera rotation (#92) add PrivacyInfo.xcprivacy to darwin frameworks. (#112) Add NSPrivacyCollectedDataTypes key to xcprivacy file (#114) Thread-safe `RTCInitFieldTrialDictionary` (#116) Set RTCCameraVideoCapturer initial zoom factor (#121) Unlock configuration before starting capture session #122 Co-authored-by: Hiroshi Horie <548776+hiroshihorie@users.noreply.github.com>

Use M125 as the latest version and migrate historical patches to m125 Patches Group: ## 1. Update README.md b6c65fc * Add Apache-2.0 license and some note to README.md. (#9) * Updated readme detailing changes from original (#42) * Adding membrane framework (#51) * Updated readme (#83) ## 2. Audio Device Optimization 7454824 * allow listen-only mode in AudioUnit, adjust when category changes (#2) * release mic when category changes (#5) * Change defaults to iOS defaults (#7) * Sync audio session config (#8) * feat: support bypass voice processing for iOS. (#15) * Remove MacBookPro audio pan right code (#22) * fix: Fix can't open mic alone when built-in AEC is enabled. (#29) * feat: add audio device changes detect for windows. (#41) * fix Linux compile (#47) * AudioUnit: Don't rely on category switch for mic indicator to turn off (#52) * Stop recording on mute (turn off mic indicator) (#55) * Cherry pick audio selection from m97 release (#35) * [Mac] Allow audio device selection (#21) * RTCAudioDeviceModule.outputDevice / inputDevice getter and setter (#80) * Allow custom audio processing by exposing AudioProcessingModule (#85) * Expose audio sample buffers for Android (#89) * feat: add external audio processor for android. (#103) * android: make audio output attributes modifiable (#118) * Fix external audio processor sample rate calculation (#108) * Expose remote audio sample buffers on RTCAudioTrack (#84) * Fix memory leak when creating audio CMSampleBuffer #86 ## 3. Simulcast/SVC support for iOS/Android. b0b9fe9 - Simulcast support for iOS SDK (#4) - Support for simulcast in Android SDK (#3) - include simulcast headers for mac also (#10) - Fix simulcast using hardware encoder on Android (#48) - Add scalabilityMode support for AV1/VP9. (#90) ## 4. Android improvements. 9aaaab5 - Start/Stop receiving stream method for VideoTrack (#25) - Properly remove observer upon deconstruction (#26) - feat: Expose setCodecPreferences/getCapabilities for android. (#61) - fix: add WrappedVideoDecoderFactory.java. (#74) ## 5. Darwin improvements a13ea17 - [Mac/iOS] feat: Add RTCYUVHelper for darwin. (#28) - Cross-platform `RTCMTLVideoView` for both iOS / macOS (#40) - rotationOverride should not be assign (#44) - [ObjC] Expose properties / methods required for AV1 codec support (#60) - Workaround: Render PixelBuffer in RTCMTLVideoView (#58) - Improve iOS/macOS H264 encoder (#70) - fix: fix video encoder not resuming correctly upon foregrounding (#75). - add PrivacyInfo.xcprivacy to darwin frameworks. (#112) - Add NSPrivacyCollectedDataTypes key to xcprivacy file (#114) - Thread-safe `RTCInitFieldTrialDictionary` (#116) - Set RTCCameraVideoCapturer initial zoom factor (#121) - Unlock configuration before starting capture session (#122) ## 6. Desktop Capture for macOS. 841d78f - [Mac] feat: Support screen capture for macOS. (#24) (#36) - fix: Get thumbnails asynchronously. (#37) - fix: Use CVPixelBuffer to build DesktopCapture Frame, fix the crash caused by non-CVPixelBuffer frame in RTCVideoEncoderH264 that cannot be cropped. (#63) - Fix the crash when setting the fps of the virtual camera. (#62) ## 7. Frame Cryptor Support. fc08745 - feat: Frame Cryptor (aes gcm/cbc). (#54) - feat: key ratchet/derive. (#66) - fix: skip invalid key when decryption failed. (#81) - Improve e2ee, add setSharedKey to KeyProvider. (#88) - add failure tolerance for framecryptor. (#91) - fix h264 freeze. (#93) - Fix/send frame cryptor events from signaling thread (#95) - more improvements for E2EE. (#96) - remove too verbose logs (#107) - Add key ring size to keyProviderOptions. (#109) ## 8. Other improvements. eed6c8a - Added yuv_helper (#57) - ABGRToI420, ARGBToI420 & ARGBToRGB24 (#65) - more yuv wrappers (#87) - Fix naming for yuv helper (#113) - Fix missing `RTC_OBJC_TYPE` macros (#100) --------- Co-authored-by: Hiroshi Horie <548776+hiroshihorie@users.noreply.github.com> Co-authored-by: David Zhao <dz@livekit.io> Co-authored-by: davidliu <davidliu@deviange.net> Co-authored-by: Angelika Serwa <angelika.serwa@gmail.com> Co-authored-by: Théo Monnom <theo.monnom@outlook.com>

[Mac/iOS] feat: Add RTCYUVHelper for darwin. (webrtc-sdk#28) Cross-platform `RTCMTLVideoView` for both iOS / macOS (webrtc-sdk#40) rotationOverride should not be assign (webrtc-sdk#44) [ObjC] Expose properties / methods required for AV1 codec support (webrtc-sdk#60) Workaround: Render PixelBuffer in RTCMTLVideoView (webrtc-sdk#58) Improve iOS/macOS H264 encoder (webrtc-sdk#70) fix: fix video encoder not resuming correctly upon foregrounding (webrtc-sdk#75). Co-authored-by: Hiroshi Horie <548776+hiroshihorie@users.noreply.github.com>

feat: Add RTCYUVHelper for darwin.

b09bc89

cloudwebrtc requested review from davidliu, davidzhao and hiroshihorie May 17, 2022 15:37

cloudwebrtc changed the title ~~feat: Add RTCYUVHelper for darwin.~~ [Mac/iOS] feat: Add RTCYUVHelper for darwin. May 17, 2022

cloudwebrtc mentioned this pull request May 17, 2022

MacOS libyuv_internal.a needs to be built for arm64 support flutter-webrtc/flutter-webrtc#948

Closed

hiroshihorie approved these changes May 17, 2022

View reviewed changes

chore: Add newline end of files.

ab4e116

cloudwebrtc merged commit 59fde2a into m97_release May 18, 2022

cloudwebrtc deleted the feat/add-yuv-helper-for-darwin branch May 18, 2022 05:04

davidliu pushed a commit that referenced this pull request Jul 17, 2022

[Mac/iOS] feat: Add RTCYUVHelper for darwin. (#28)

ba895f1

* feat: Add RTCYUVHelper for darwin. * chore: Add newline end of files.

davidliu pushed a commit that referenced this pull request Jul 21, 2022

[Mac/iOS] feat: Add RTCYUVHelper for darwin. (#28)

e91f2df

* feat: Add RTCYUVHelper for darwin. * chore: Add newline end of files.

cloudwebrtc added a commit that referenced this pull request Jan 18, 2023

[Mac/iOS] feat: Add RTCYUVHelper for darwin. (#28)

e0f9739

* feat: Add RTCYUVHelper for darwin. * chore: Add newline end of files.

cloudwebrtc added a commit that referenced this pull request Jun 5, 2023

[Mac/iOS] feat: Add RTCYUVHelper for darwin. (#28)

3808ee0

* feat: Add RTCYUVHelper for darwin. * chore: Add newline end of files.

cloudwebrtc mentioned this pull request Jun 12, 2023

update to m114 #76

Merged

cloudwebrtc mentioned this pull request May 22, 2024

Update to m125. #119

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Mac/iOS] feat: Add RTCYUVHelper for darwin. #28

[Mac/iOS] feat: Add RTCYUVHelper for darwin. #28

cloudwebrtc commented May 17, 2022

hiroshihorie left a comment •

edited

Loading

[Mac/iOS] feat: Add RTCYUVHelper for darwin. #28

[Mac/iOS] feat: Add RTCYUVHelper for darwin. #28

Conversation

cloudwebrtc commented May 17, 2022

hiroshihorie left a comment • edited Loading

Choose a reason for hiding this comment

hiroshihorie left a comment •

edited

Loading