Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace gsutil-based CloudNode with local authentication proxies and HTTP output support #47

Closed
joeyparrish opened this issue Jan 16, 2020 · 1 comment · Fixed by #103 or #191
Closed
Assignees
Labels
priority: P2 Smaller impact or easy workaround type: bug Something isn't working correctly
Milestone

Comments

@joeyparrish
Copy link
Member

Our Shaka Player History live stream is having an issue during playback in which we get HTTP 403 errors close to the live edge.

The cloud upload node already has logic to avoid this:

  1. Snapshot manifests and playlists
  2. Upload all segments, but no manifests or playlists
  3. Upload snapshots of manifests and playlists

This is meant to make sure we never upload a manifest or playlist which refers to a segment that isn't fully available yet. It doesn't seem to work well enough, though.

It's possible that there's some additional latency between uploading a segment and it being available, and that manifest/playlist uploads might need to be delayed. But that would certainly be in conflict with future low-latency streaming work. It also makes me wonder why the playlists aren't subject to the same latency.

I haven't carefully measured the final segments of the playlists on upload by Streamer & download by Player, so it's possible I'm making some bad assumptions about this issue. A more detailed investigation is needed.

@joeyparrish joeyparrish added the type: bug Something isn't working correctly label Jan 16, 2020
@joeyparrish joeyparrish added this to the v1.0 milestone Jan 16, 2020
@joeyparrish
Copy link
Member Author

Our current plan is to replace CloudNode with Shaka Packager's recent HTTP upload support and a local authentication proxy.

@joeyparrish joeyparrish changed the title Cloud upload race condition or latency issue? Replace gsutil-based CloudNode with local authentication proxies and HTTP output support Sep 8, 2021
@joeyparrish joeyparrish added the priority: P2 Smaller impact or easy workaround label Oct 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
priority: P2 Smaller impact or easy workaround type: bug Something isn't working correctly
Projects
None yet
2 participants