Philo MSO #17821

Aniruddh-J · 2018-10-07T01:01:18Z

Added new Philo MSO.

Please follow the guide below

You will be asked some questions, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your pull request (like that [x])
Use Preview tab to see how your pull request will actually look like

Before submitting a pull request make sure you have:

At least skimmed through adding new extractor tutorial and youtube-dl coding conventions sections
Searched the bugtracker for similar pull requests
Checked the code with flake8

In order to be accepted and merged into youtube-dl each piece of code must be in public domain or released under Unlicense. Check one of the following options:

I am the original author of this code and I am willing to release it under Unlicense
I am not the original author of this code but it is in public domain or released under Unlicense (provide reliable evidence)

What is the purpose of your pull request?

Description of your pull request and other information

Explanation of your pull request in arbitrary form goes here. Please make sure the description explains the purpose and effect of your pull request and is worded well enough to be understood. Provide as much context and examples as possible.

Added new MSO, Philo.

youtube-dl <url> --ap-mso=Philo --ap-username=<username> --ap-password=None

Philo has unique authentication method. Instead of regular username and password. Philo sends an OTP to your email/phone. You use that as the password.

Addresses #17395

Added new Philo MSO.

Aniruddh-J · 2018-10-07T01:51:58Z

I'd love to share my account but that won't help because Philo sends OTP. Is there any other way you can suggest?

ppritcha · 2018-10-07T14:13:07Z

Philo has a free trial that the maintainers could probably use for testing. The site says "Start your free trial with just your mobile number."

DavidZ912 · 2018-10-21T06:59:25Z

What exactly should we put as our username? I have tried my email and my phone number but i never get a code also i can't input anything when i get to the point it ask for the account password even if i had received the code.

Aniruddh-J · 2018-10-21T16:02:48Z

What exactly should we put as our username? I have tried my email and my phone number but i never get a code also i can't input anything when i get to the point it ask for the account password even if i had received the code.

Use 'None' as account password.

DavidZ912 · 2018-10-21T23:38:04Z

What exactly should we put as our username? I have tried my email and my phone number but i never get a code also i can't input anything when i get to the point it ask for the account password even if i had received the code.

Use 'None' as account password.

I tried that but when i put the account password in the command i just get ERROR: This video is only available via cable service provider subscription that is not currently supported. You may want to use --cookies.

Here is one I'm trying for example.

python -m youtube_dl https://www.sciencechannel.com/tv-shows/spaces-deepest-secrets/full-episodes/mystery-of-the-northern-lights --ap-mso=Philo --ap-username=myemail@gmail.com --ap-password=None

DavidZ912 · 2018-10-21T23:39:07Z

What exactly should we put as our username? I have tried my email and my phone number but i never get a code also i can't input anything when i get to the point it ask for the account password even if i had received the code.

Use 'None' as account password.

I tried that but when i put the account password in the command i just get ERROR: This video is only available via cable service provider subscription that is not currently supported. You may want to use --cookies.

Here is one I'm trying for example.

python -m youtube_dl https://www.sciencechannel.com/tv-shows/spaces-deepest-secrets/full-episodes/mystery-of-the-northern-lights --ap-mso=Philo --ap-username=myemail@gmail.com --ap-password=None

DavidZ912 · 2018-10-21T23:39:49Z

I tried that but when i put the account password in the command i just get ERROR: This video is only available via cable service provider subscription that is not currently supported. You may want to use --cookies.

Here is one I'm trying for example.

python -m youtube_dl https://www.sciencechannel.com/tv-shows/spaces-deepest-secrets/full-episodes/mystery-of-the-northern-lights --ap-mso=Philo --ap-username=myemail@gmail.com --ap-password=None

DavidZ912 · 2018-10-21T23:40:16Z

I tried that but when i put the account password in the command i just get ERROR: This video is only available via cable service provider subscription that is not currently supported. You may want to use --cookies.

Here is one I'm trying for example.

python -m youtube_dl https://www.sciencechannel.com/tv-shows/spaces-deepest-secrets/full-episodes/mystery-of-the-northern-lights --ap-mso=Philo --ap-username=myemail@gmail.com --ap-password=None

Aniruddh-J · 2018-10-22T14:02:07Z

Can you add verbose mode by using -v option and paste the output here? You can remove your email from output and add a fake email.

DavidZ912 · 2018-10-22T19:29:44Z

`youtube-dl-philo>python -m youtube_dl https://www.sciencechannel.com/tv-shows/spaces-deepest-secrets/full-episodes/mystery-of-the-northern-lights -v --ap-mso=Philo --ap-username=fake@gmail.com --ap-password=None
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://www.sciencechannel.com/tv-shows/spaces-deepest-secrets/full-episodes/mystery-of-the-northern-lights', '-v', '--ap-mso=Philo', '--ap-username=PRIVATE', '--ap-password=PRIVATE']
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dl version 2018.10.05
[debug] Python version 3.6.7 (CPython) - Windows-10-10.0.18262-SP0
[debug] exe versions: ffmpeg N-91666-g70d2bab80b, ffprobe N-91666-g70d2bab80b
[debug] Proxy map: {}
[Discovery] mystery-of-the-northern-lights: Downloading webpage
[Discovery] mystery-of-the-northern-lights: Downloading JSON metadata
ERROR: This video is only available via cable service provider subscription that is not currently supported. You may want to use --cookies.
Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 604, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\YoutubeDL.py", line 2211, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 532, in open
response = meth(req, response)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 642, in http_response
'http', request, response, code, msg, hdrs)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 570, in error
return self._call_chain(*args)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 504, in _call_chain
result = func(*args)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 650, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\discovery.py", line 87, in _real_extract
'Authorization': 'Bearer ' + access_token,
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 864, in _download_json
expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 842, in _download_json_handle
expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 632, in _download_webpage_handle
urlh = self._request_webpage(url_or_request, video_id, note, errnote, fatal, data=data, headers=headers, query=query, expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 617, in _request_webpage
raise ExtractorError(errmsg, sys.exc_info()[2], cause=err)
youtube_dl.utils.ExtractorError: Unable to download JSON metadata: HTTP Error 403: Forbidden (caused by <HTTPError 403: 'Forbidden'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 604, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\YoutubeDL.py", line 2211, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 532, in open
response = meth(req, response)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 642, in http_response
'http', request, response, code, msg, hdrs)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 570, in error
return self._call_chain(*args)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 504, in _call_chain
result = func(*args)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 650, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\discovery.py", line 87, in _real_extract
'Authorization': 'Bearer ' + access_token,
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 864, in _download_json
expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 842, in _download_json_handle
expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 632, in _download_webpage_handle
urlh = self._request_webpage(url_or_request, video_id, note, errnote, fatal, data=data, headers=headers, query=query, expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 617, in _request_webpage
raise ExtractorError(errmsg, sys.exc_info()[2], cause=err)
youtube_dl.utils.ExtractorError: Unable to download JSON metadata: HTTP Error 403: Forbidden (caused by <HTTPError 403: 'Forbidden'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\YoutubeDL.py", line 792, in extract_info
ie_result = ie.extract(url)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 507, in extract
ie_result = self._real_extract(url)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\discovery.py", line 98, in _real_extract
' is not currently supported. You may want to use --cookies.', expected=True)
youtube_dl.utils.ExtractorError: This video is only available via cable service provider subscription that is not currently supported. You may want to use --cookies.`

Here ya go sorry for the multiple comments last time not sure how that happened.

Aniruddh-J · 2018-10-23T02:20:28Z

Do you see Philo when you use --ap-list-mso?

DavidZ912 · 2018-10-23T03:16:27Z

Yes i see it.

DavidZ912 · 2018-10-23T03:21:21Z

If i leave out --ap-password=None it seems to go farther but i get to a point i assume it wants the code they send and it wont let me enter anything i also never get a code.

`python -m youtube_dl https://www.sciencechannel.com/tv-shows/spaces-deepest-secrets/full-episodes/mystery-of-the-northern-lights -v --ap-mso=Philo --ap-username=fake@gmail.com
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://www.sciencechannel.com/tv-shows/spaces-deepest-secrets/full-episodes/mystery-of-the-northern-lights', '-v', '--ap-mso=Philo', '--ap-username=PRIVATE']
Type TV provider account password and press [Return]:
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dl version 2018.10.05
[debug] Python version 3.6.7 (CPython) - Windows-10-10.0.18262-SP0
[debug] exe versions: ffmpeg N-91666-g70d2bab80b, ffprobe N-91666-g70d2bab80b
[debug] Proxy map: {}
[Discovery] mystery-of-the-northern-lights: Downloading webpage
[Discovery] mystery-of-the-northern-lights: Downloading JSON metadata
ERROR: This video is only available via cable service provider subscription that is not currently supported. You may want to use --cookies.
Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 604, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\YoutubeDL.py", line 2211, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 532, in open
response = meth(req, response)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 642, in http_response
'http', request, response, code, msg, hdrs)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 570, in error
return self._call_chain(*args)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 504, in _call_chain
result = func(*args)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 650, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\discovery.py", line 87, in _real_extract
'Authorization': 'Bearer ' + access_token,
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 864, in _download_json
expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 842, in _download_json_handle
expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 632, in _download_webpage_handle
urlh = self._request_webpage(url_or_request, video_id, note, errnote, fatal, data=data, headers=headers, query=query, expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 617, in _request_webpage
raise ExtractorError(errmsg, sys.exc_info()[2], cause=err)
youtube_dl.utils.ExtractorError: Unable to download JSON metadata: HTTP Error 403: Forbidden (caused by <HTTPError 403: 'Forbidden'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 604, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\YoutubeDL.py", line 2211, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 532, in open
response = meth(req, response)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 642, in http_response
'http', request, response, code, msg, hdrs)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 570, in error
return self._call_chain(*args)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 504, in _call_chain
result = func(*args)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 650, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\discovery.py", line 87, in _real_extract
'Authorization': 'Bearer ' + access_token,
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 864, in _download_json
expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 842, in _download_json_handle
expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 632, in _download_webpage_handle
urlh = self._request_webpage(url_or_request, video_id, note, errnote, fatal, data=data, headers=headers, query=query, expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 617, in _request_webpage
raise ExtractorError(errmsg, sys.exc_info()[2], cause=err)
youtube_dl.utils.ExtractorError: Unable to download JSON metadata: HTTP Error 403: Forbidden (caused by <HTTPError 403: 'Forbidden'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\YoutubeDL.py", line 792, in extract_info
ie_result = ie.extract(url)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 507, in extract
ie_result = self._real_extract(url)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\discovery.py", line 98, in _real_extract
' is not currently supported. You may want to use --cookies.', expected=True)
youtube_dl.utils.ExtractorError: This video is only available via cable service provider subscription that is not currently supported. You may want to use --cookies.`

Aniruddh-J · 2018-10-23T09:46:58Z

Okay can you try running directly from source this way:

youtube_dl/__main__.py <URL> --ap-mso=Philo --ap-username=<your_email> --ap-password=None

Or can you also try using some other website that uses Adobe Pass authentication? For example, Lifetime Network website requires TV provider authentication. Try running this URL just for test: https://www.mylifetime.com/shows/you/season-1/episode-7

DavidZ912 · 2018-10-23T21:15:00Z

Looks like the same problem that way.

`[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://www.investigationdiscovery.com/tv-shows/in-plain-sight/full-episodes/teenage-rage', '-v', '--ap-mso=Philo', '--ap-username=PRIVATE', '--ap-password=PRIVATE']
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dl version 2018.10.05
[debug] Python version 3.6.7 (CPython) - Windows-10-10.0.18262-SP0
[debug] exe versions: none
[debug] Proxy map: {}
[Discovery] teenage-rage: Downloading webpage
[Discovery] teenage-rage: Downloading JSON metadata
ERROR: This video is only available via cable service provider subscription that is not currently supported. You may want to use --cookies.
Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 604, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\YoutubeDL.py", line 2211, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 532, in open
response = meth(req, response)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 642, in http_response
'http', request, response, code, msg, hdrs)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 570, in error
return self._call_chain(*args)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 504, in _call_chain
result = func(*args)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 650, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\discovery.py", line 87, in _real_extract
'Authorization': 'Bearer ' + access_token,
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 864, in _download_json
expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 842, in _download_json_handle
expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 632, in _download_webpage_handle
urlh = self._request_webpage(url_or_request, video_id, note, errnote, fatal, data=data, headers=headers, query=query, expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 617, in _request_webpage
raise ExtractorError(errmsg, sys.exc_info()[2], cause=err)
youtube_dl.utils.ExtractorError: Unable to download JSON metadata: HTTP Error 403: Forbidden (caused by <HTTPError 403: 'Forbidden'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 604, in _request_webpage
return self._downloader.urlopen(url_or_request)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\YoutubeDL.py", line 2211, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 532, in open
response = meth(req, response)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 642, in http_response
'http', request, response, code, msg, hdrs)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 570, in error
return self._call_chain(*args)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 504, in _call_chain
result = func(*args)
File "C:\Users\thena\AppData\Local\Programs\Python\Python36\lib\urllib\request.py", line 650, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\discovery.py", line 87, in _real_extract
'Authorization': 'Bearer ' + access_token,
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 864, in _download_json
expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 842, in _download_json_handle
expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 632, in _download_webpage_handle
urlh = self._request_webpage(url_or_request, video_id, note, errnote, fatal, data=data, headers=headers, query=query, expected_status=expected_status)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 617, in _request_webpage
raise ExtractorError(errmsg, sys.exc_info()[2], cause=err)
youtube_dl.utils.ExtractorError: Unable to download JSON metadata: HTTP Error 403: Forbidden (caused by <HTTPError 403: 'Forbidden'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\YoutubeDL.py", line 792, in extract_info
ie_result = ie.extract(url)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 507, in extract
ie_result = self._real_extract(url)
File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\discovery.py", line 98, in _real_extract
' is not currently supported. You may want to use --cookies.', expected=True)
youtube_dl.utils.ExtractorError: This video is only available via cable service provider subscription that is not currently supported. You may want to use --cookies.`

Aniruddh-J · 2018-10-24T04:44:02Z

Did you try it with the lifetime link I posted earlier?

DavidZ912 · 2018-10-24T04:58:32Z

Odd that lifetime link does indeed work the couple i tried on science channel and investigation discovery do not. Tho it does not let me enter the code i was sent to my email.

[debug] System config: [] [debug] User config: [] [debug] Custom config: [] [debug] Command-line args: ['https://www.mylifetime.com/shows/you/season-1/episode-7', '-v', '--ap-mso=Philo', '--ap-username=PRIVATE', '--ap-password=PRIVATE'] [debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252 [debug] youtube-dl version 2018.10.05 [debug] Python version 3.6.7 (CPython) - Windows-10-10.0.18262-SP0 [debug] exe versions: none [debug] Proxy map: {} [aenetworks] you/season-1/episode-7: Downloading webpage [aenetworks] 1342118979648: Downloading JSON metadata [aenetworks] 1342118979648: Downloading Provider Redirect Page [aenetworks] 1342118979648: Requesting auth code Type auth code you have received [Return]: [aenetworks] 1342118979648: Submitting token [aenetworks] 1342118979648: Confirming Philo Login ERROR: Unable to extract post url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output. Traceback (most recent call last): File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\YoutubeDL.py", line 792, in extract_info ie_result = ie.extract(url) File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 507, in extract ie_result = self._real_extract(url) File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\aenetworks.py", line 144, in _real_extract url, video_id, requestor_id, resource) File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\adobepass.py", line 1478, in _extract_mvpd_auth post_form(mvpd_confirm_page_res, 'Confirming Login') File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\adobepass.py", line 1365, in post_form post_url = self._html_search_regex(r'<form[^>]+action=(["\'])(?P<url>.+?)\1', form_page, 'post url', group='url') File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 986, in _html_search_regex res = self._search_regex(pattern, string, name, default, fatal, flags, group) File "C:\Users\thena\Downloads\youtube-dl-philo\youtube_dl\extractor\common.py", line 977, in _search_regex raise RegexNotFoundError('Unable to extract %s' % _name) youtube_dl.utils.RegexNotFoundError: Unable to extract post url; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

DavidZ912 · 2018-10-24T05:11:54Z

Ok so it does actually accept what i input just doesn't show it to me as i am typing sorry about that. It seems to work ok on lifetime and aetv but not on the channels that seem to all use the discovery setup science channel/investigation discovery etc.

jlick · 2018-10-24T06:51:32Z

but not on the channels that seem to all use the discovery setup science channel/investigation discovery etc.

Discovery sites already worked through cookies.txt. Don't need MSO for them.

DavidZ912 · 2018-10-24T07:08:53Z

but not on the channels that seem to all use the discovery setup science channel/investigation discovery etc.

Discovery sites already worked through cookies.txt. Don't need MSO for them.

Yep thanks i just found that out doing some searching around.

Aniruddh-J · 2018-10-24T11:29:42Z

It seems to work ok on lifetime and aetv but not on the channels that seem to all use the discovery setup science channel/investigation discovery etc.

So that means DiscoveryIE needs to be modified. I'll see if I can submit a pull request for that, as well.

Aniruddh-J · 2019-01-03T01:21:10Z

@dstftw Do you need anything from me for this pull request?

dstftw · 2019-01-03T11:09:03Z

Complete reproducible environment for testing these changes.

mshiels · 2019-02-03T01:59:54Z

ok, been trying to get this working with Philo and MSO - and even with just cookies, and so far can't get anything to let me grab

https://www.discovery.com/tv-shows/gold-rush/full-episodes/broken-bones?

I have gotten cookies working for other sites, but somehow even though I output the cookies from a browser that was viewing fine - they don't seem to work in youtube_dl at all.

jlick · 2019-02-03T05:17:21Z

https://www.discovery.com/tv-shows/gold-rush/full-episodes/broken-bones

There's some other issue with Discovery sites that prevents Philo MSO (maybe MSO in general?) from working. I've used the Philo MSO patch with aetv just fine, but Discovery sites don't work with it.

This is the method that works for Discovery sites with Philo:

On your browser, authenticate/log-in/activate to the point that you can load and watch the video you want.
Save ALL cookies, not just site cookies to cookies.txt
IMMEDIATELY run your youtube-dl command with the --cookies cookies.txt option.

Probably 2 or 3 is tripping you up. The Discovery code doesn't renew the temporary token automatically like your web browser does (another bug?) so you have about 15 minutes between saving cookies and running youtube-dl. It probably needs all cookies because there's some other site besides the one you are downloading from involved in authentication.

Using the above method works with the URL you provided.

mshiels · 2019-02-03T17:00:43Z

thanks the timeout was surprising, kinda hard to automate long term with that kinda limit. I'll see if I can figure out how to auto renew possibly. I have done some login code for cbc I think it was, not checked in yet, since I don't have time to do all the proofing needing, but it works for me.

jlick · 2019-02-04T07:07:02Z

I'll see if I can figure out how to auto renew possibly.

That'd be great if you can figure it out. Last time I looked I figured out it was based on the eosAd and eosAf cookies but hadn't figured out how they get set/renewed.

varunsridharan · 2019-11-24T01:11:27Z

@Aniruddh-J

When i am trying to run i get the below error

D:\hotstarlivestreamer\philo-do>python -m youtube_dl https://www.philo.com/player/player/recording/UmVjb3JkaW5nOjYwODU0ODg5OTg5MTEwOTgwMQ --ap-mso=Philo --ap-username=****** --ap-password=None -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://www.philo.com/player/player/recording/UmVjb3JkaW5nOjYwODU0ODg5OTg5MTEwOTgwMQ', '--ap-mso=Philo', '--ap-username=PRIVATE', '--ap-password=PRIVATE', '-v']
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dl version 2018.10.05
[debug] Git HEAD: 8d32816bf
[debug] Python version 3.6.4 (CPython) - Windows-10-10.0.17763-SP0
[debug] exe versions: ffmpeg git-2019-10-11-71d9ae1, ffprobe git-2019-10-11-71d9ae1
[debug] Proxy map: {}
[generic] UmVjb3JkaW5nOjYwODU0ODg5OTg5MTEwOTgwMQ: Requesting header
WARNING: Falling back on generic information extractor.
[generic] UmVjb3JkaW5nOjYwODU0ODg5OTg5MTEwOTgwMQ: Downloading webpage
[generic] UmVjb3JkaW5nOjYwODU0ODg5OTg5MTEwOTgwMQ: Extracting information
ERROR: Unsupported URL: https://www.philo.com/player/player/recording/UmVjb3JkaW5nOjYwODU0ODg5OTg5MTEwOTgwMQ
Traceback (most recent call last):
  File "D:\hotstarlivestreamer\philo-do\youtube_dl\YoutubeDL.py", line 792, in extract_info
    ie_result = ie.extract(url)
  File "D:\hotstarlivestreamer\philo-do\youtube_dl\extractor\common.py", line 507, in extract
    ie_result = self._real_extract(url)
  File "D:\hotstarlivestreamer\philo-do\youtube_dl\extractor\generic.py", line 3298, in _real_extract
    raise UnsupportedError(url)
youtube_dl.utils.UnsupportedError: Unsupported URL: https://www.philo.com/player/player/recording/UmVjb3JkaW5nOjYwODU0ODg5OTg5MTEwOTgwMQ

jlick · 2019-11-24T07:23:37Z

@varunsridharan This is not for authenticating or capturing streams from Philo itself. Instead, it is a method to authenticate on third-party sites that allow accessing their content with your Philo credentials. For example, aetv.com allows you to login to their site using you Philo credentials and play videos on aetv.com. With this patch you could also use youtibe-dl to download aetv.com videos using your Philo account to authenticate.

varunsridharan · 2019-11-24T07:35:22Z

Wow great I just want to download from aetv isnit possible to download live PD ? Varun +91 9042248903

…

On Sun, Nov 24, 2019, 12:53 PM James Lick ***@***.***> wrote: @varunsridharan <https://github.com/varunsridharan> This is not for authenticating or capturing streams from Philo itself. Instead, it is a method to authenticate on third-party sites that allow accessing their content with your Philo credentials. For example, aetv.com allows you to login to their site using you Philo credentials and play videos on aetv.com. With this patch you could also use youtibe-dl to download aetv.com videos using your Philo account to authenticate. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#17821?email_source=notifications&email_token=AAOMA76T3ZMONRAWHAJK3S3QVITXVA5CNFSM4FZOPX2KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEFAFL6A#issuecomment-557864440>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAOMA7YAF6M3WS4FQZAWG4TQVITXVANCNFSM4FZOPX2A> .

varunsridharan · 2019-11-24T09:59:42Z

@jlick i am still getting the same error with the AETV link


D:\hotstarlivestreamer\philo-do>python -m youtube_dl https://play.aetv.com/shows/live-pd/season-4/episode-13/trailer-park-treasures?playlist_slug=live-pd-season-4-highlights  --ap-mso=Philo --ap-username=*******@gmail.com --ap-password=None -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://play.aetv.com/shows/live-pd/season-4/episode-13/trailer-park-treasures?playlist_slug=live-pd-season-4-highlights', '--ap-mso=Philo', '--ap-username=PRIVATE', '--ap-password=PRIVATE', '-v']
[debug] Encodings: locale cp1252, fs utf-8, out utf-8, pref cp1252
[debug] youtube-dl version 2018.10.05
[debug] Git HEAD: 8d32816bf
[debug] Python version 3.6.4 (CPython) - Windows-10-10.0.17763-SP0
[debug] exe versions: ffmpeg git-2019-10-11-71d9ae1, ffprobe git-2019-10-11-71d9ae1
[debug] Proxy map: {}
[generic] trailer-park-treasures?playlist_slug=live-pd-season-4-highlights: Requesting header
WARNING: Falling back on generic information extractor.
[generic] trailer-park-treasures?playlist_slug=live-pd-season-4-highlights: Downloading webpage
[generic] trailer-park-treasures?playlist_slug=live-pd-season-4-highlights: Extracting information
ERROR: Unsupported URL: https://play.aetv.com/shows/live-pd/season-4/episode-13/trailer-park-treasures?playlist_slug=live-pd-season-4-highlights
Traceback (most recent call last):
  File "D:\hotstarlivestreamer\philo-do\youtube_dl\YoutubeDL.py", line 792, in extract_info
    ie_result = ie.extract(url)
  File "D:\hotstarlivestreamer\philo-do\youtube_dl\extractor\common.py", line 507, in extract
    ie_result = self._real_extract(url)
  File "D:\hotstarlivestreamer\philo-do\youtube_dl\extractor\generic.py", line 3298, in _real_extract
    raise UnsupportedError(url)
youtube_dl.utils.UnsupportedError: Unsupported URL: https://play.aetv.com/shows/live-pd/season-4/episode-13/trailer-park-treasures?playlist_slug=live-pd-season-4-highlights

Aniruddh-J · 2019-11-25T08:02:21Z

Try to remove play. subdomain from URL.

jlick · 2019-12-13T09:12:58Z

A&E seems to have just moved to a new video streaming system. You used to be able to remove "play." from the URL to get the old player but that no longer works. See #23363 to follow this issue.

raface · 2020-06-04T19:17:50Z

@jlick @Aniruddh-J did you have any luck with the renew of the cookies?
I have youtube-dl on my headless server and I have to keep refreshing my browser copying the new cookies, ssh and copy the new cookies to the server.
I even try a curl command to keep refreshing the cookie but I can't figure it out what to change on eosAf.

I am trying to download food network and cooking channel.

Aniruddh-J · 2020-07-20T05:02:44Z

@raface Sorry for the late response. Unfortunately, can't handle cookie renewal. This has to be done manually, you can probably use PhantomJS to automate this.

@dstftw It is not possible for me to provide a complete reproducible environment for this because even if I provide you with my account you will not be able to test it. One of the collaborators will need to register a trial account and test it as this MSO sends an OTP to your email/phone.

pukkandan · 2021-01-10T21:06:34Z

Does this patch still work?

Aniruddh-J · 2021-01-11T00:19:18Z

Does this patch still work?

It should. Let me know if it doesn't.

jlick · 2021-01-11T08:22:46Z

The patch for Philo still works great. The fork is very old and doesn't work for many sites due to outdated extractors that have been separately fixed, though, so you have to clone a current release and then manually pull in or apply the patch. If you do that it works fine. This is what I do on Linux to make a custom build with the current release with this patch added:

git clone https://github.com/rg3/youtube-dl/
cd youtube-dl
git pull --no-edit origin pull/17821/head
make

Hopefully this makes it in to a release someday as it is very useful.

Authored-by: Aniruddh Joshi <aniruddh@ebincoweb.com>

Sipherdrakon · 2021-01-19T08:00:38Z

I can't get philo to send me the auth code to use this. Bummer, I was really hopeful. :(

jlick · 2021-01-19T08:56:12Z

If it was working before AND you use cookies, sometimes it will request a new token but Philo doesn't send you any text message. If you've waited a while and still no text, just press enter and usually it'll work just fine.

If it is your first time, make sure you are using the correct arguments, e.g.:

--cookies cookies.txt --ap-mso=Philo --ap-username=AAAPPPNNNN --ap-password=None

Specific tips:
It helps if you start with a cookies.txt file from a browser Philo is already logged into and has already authenticated with the site you are downloading from (i.e. get what you want to download playing in your web browser, then export cookies).
Username should be your 10 digit Philo account phone number starting with the area code, DO NOT start with '1'.
Check again that everything is spelled correctly and the download URL can be pasted into a new browser window and play.

Sipherdrakon · 2021-01-22T17:43:34Z

Nice, did as suggested and used cookies and although it still didn't send an auth code, hitting enter did allow it to start downloading. Thank you so much. :-)

RedPenguin2 · 2021-09-27T02:00:41Z

For some reason for A&E, nothing would work at all at first even A&E cookies.

The only thing that ended up working as to use the -ap-mso, ap-username, ap-password=None all together with the cookies.txt that I grabbed from Philo's website with the Chrome "Get Cookies.txt" addon.

I just hit enter on put in token as nothing could get Philo to email me a token.

Aniruddh-J · 2021-09-27T08:51:50Z

Philio must have changed the way they authenticate users. I developed this MSO 3 years ago, there is a high chance that it will break now.

Since the developers of youtube-dl are refusing to add this to the repo, it will be a total waste to work on this any further, unfortunately.

jlick · 2021-09-27T20:56:01Z

Since the developers of youtube-dl are refusing to add this to the repo, it will be a total waste to work on this any further, unfortunately.

It is in integrated in some of the popular youtube-dl forks and still working great for me, so definitely not a waste in my opinion!

Aniruddh-J · 2021-09-28T05:37:45Z

Oh, Okay, I was unaware of this.

You mentioned that it is still working, so no work is required at the moment, right?

Philo MSO

8d32816

Added new Philo MSO.

dstftw added the tv-provider-account-needed label Oct 7, 2018

dstftw force-pushed the master branch from d99bab0 to e118a87 Compare January 23, 2019 18:41

dstftw force-pushed the master branch 2 times, most recently from 7b956a1 to 5e26784 Compare September 13, 2020 13:51

jlick mentioned this pull request Oct 8, 2020

AETV.com Unable to extract video url #23363

Closed

pukkandan mentioned this pull request Jan 11, 2021

Philo MSO yt-dlp/yt-dlp#13

Merged

pukkandan added a commit to yt-dlp/yt-dlp that referenced this pull request Jan 11, 2021

#13 [adobepass] Added Philo MSO (ytdl-org/youtube-dl#17821)

5cc6ceb

Authored-by: Aniruddh Joshi <aniruddh@ebincoweb.com>

dirkf force-pushed the master branch from 01bf89e to 4c6fba3 Compare August 26, 2022 07:51

dirkf closed this Aug 1, 2023

dirkf added the defunct PR source branch is not accessible label Oct 2, 2023

Philo MSO #17821

Philo MSO #17821

Conversation

Aniruddh-J commented Oct 7, 2018 • edited Loading

Please follow the guide below

Before submitting a pull request make sure you have:

In order to be accepted and merged into youtube-dl each piece of code must be in public domain or released under Unlicense. Check one of the following options:

What is the purpose of your pull request?

Description of your pull request and other information

Aniruddh-J commented Oct 7, 2018

ppritcha commented Oct 7, 2018

DavidZ912 commented Oct 21, 2018

Aniruddh-J commented Oct 21, 2018

DavidZ912 commented Oct 21, 2018

DavidZ912 commented Oct 21, 2018

DavidZ912 commented Oct 21, 2018

DavidZ912 commented Oct 21, 2018

Aniruddh-J commented Oct 22, 2018

DavidZ912 commented Oct 22, 2018

Aniruddh-J commented Oct 23, 2018

DavidZ912 commented Oct 23, 2018

DavidZ912 commented Oct 23, 2018

Aniruddh-J commented Oct 23, 2018 • edited Loading

DavidZ912 commented Oct 23, 2018

Aniruddh-J commented Oct 24, 2018

DavidZ912 commented Oct 24, 2018

DavidZ912 commented Oct 24, 2018

jlick commented Oct 24, 2018

DavidZ912 commented Oct 24, 2018

Aniruddh-J commented Oct 24, 2018

Aniruddh-J commented Jan 3, 2019

dstftw commented Jan 3, 2019

mshiels commented Feb 3, 2019

jlick commented Feb 3, 2019 • edited Loading

mshiels commented Feb 3, 2019

jlick commented Feb 4, 2019

varunsridharan commented Nov 24, 2019

jlick commented Nov 24, 2019

varunsridharan commented Nov 24, 2019 via email

varunsridharan commented Nov 24, 2019

Aniruddh-J commented Nov 25, 2019

jlick commented Dec 13, 2019

raface commented Jun 4, 2020

Aniruddh-J commented Jul 20, 2020 • edited Loading

pukkandan commented Jan 10, 2021

Aniruddh-J commented Jan 11, 2021

jlick commented Jan 11, 2021 • edited Loading

Sipherdrakon commented Jan 19, 2021

jlick commented Jan 19, 2021

Sipherdrakon commented Jan 22, 2021

RedPenguin2 commented Sep 27, 2021

Aniruddh-J commented Sep 27, 2021

jlick commented Sep 27, 2021

Aniruddh-J commented Sep 28, 2021

Aniruddh-J commented Oct 7, 2018 •

edited

Loading

Aniruddh-J commented Oct 23, 2018 •

edited

Loading

jlick commented Feb 3, 2019 •

edited

Loading

Aniruddh-J commented Jul 20, 2020 •

edited

Loading

jlick commented Jan 11, 2021 •

edited

Loading