nitter support

[Soundtoxin]

Checklist

• I'm reporting a new site support request
• I've verified that I'm running youtube-dl version 2020.12.14
• I've checked that all provided URLs are alive and playable in a browser
• I've checked that none of provided URLs violate any copyrights
• I've searched the bugtracker for similar site support requests including closed ones

Example URLs

• Single video: https://nitter.net/DanielFore/status/1340023143990054913#m
• Single video: https://nitter.net/nathandyer_/status/1340111249359646727
• Single video: https://nitter.snopyta.org/ArtemisVtuber/status/1340029333763575808

Description

Sometimes a video will open, but it won't be the full length, or it will be a random video in the thread and not the one in the exact linked post

https://github.com/zedeus/nitter/wiki/Instances list of instances to support here

[fossdd]

It isn't very nice that there is to implement multiple instances like here:

youtube-dl/youtube_dl/extractor/peertube.py

Lines 20 to 417 in bbe8cc6

	_INSTANCES_RE = r'''(?:
	# Taken from https://instances.joinpeertube.org/instances
	peertube\.rainbowswingers\.net|
	tube\.stanisic\.nl|
	peer\.suiri\.us|
	medias\.libox\.fr|
	videomensoif\.ynh\.fr|
	peertube\.travelpandas\.eu|
	peertube\.rachetjay\.fr|
	peertube\.montecsys\.fr|
	tube\.eskuero\.me|
	peer\.tube|
	peertube\.umeahackerspace\.se|
	tube\.nx-pod\.de|
	video\.monsieurbidouille\.fr|
	tube\.openalgeria\.org|
	vid\.lelux\.fi|
	video\.anormallostpod\.ovh|
	tube\.crapaud-fou\.org|
	peertube\.stemy\.me|
	lostpod\.space|
	exode\.me|
	peertube\.snargol\.com|
	vis\.ion\.ovh|
	videosdulib\.re|
	v\.mbius\.io|
	videos\.judrey\.eu|
	peertube\.osureplayviewer\.xyz|
	peertube\.mathieufamily\.ovh|
	www\.videos-libr\.es|
	fightforinfo\.com|
	peertube\.fediverse\.ru|
	peertube\.oiseauroch\.fr|
	video\.nesven\.eu|
	v\.bearvideo\.win|
	video\.qoto\.org|
	justporn\.cc|
	video\.vny\.fr|
	peervideo\.club|
	tube\.taker\.fr|
	peertube\.chantierlibre\.org|
	tube\.ipfixe\.info|
	tube\.kicou\.info|
	tube\.dodsorf\.as|
	videobit\.cc|
	video\.yukari\.moe|
	videos\.elbinario\.net|
	hkvideo\.live|
	pt\.tux\.tf|
	www\.hkvideo\.live|
	FIGHTFORINFO\.com|
	pt\.765racing\.com|
	peertube\.gnumeria\.eu\.org|
	nordenmedia\.com|
	peertube\.co\.uk|
	tube\.darfweb\.eu|
	tube\.kalah-france\.org|
	0ch\.in|
	vod\.mochi\.academy|
	film\.node9\.org|
	peertube\.hatthieves\.es|
	video\.fitchfamily\.org|
	peertube\.ddns\.net|
	video\.ifuncle\.kr|
	video\.fdlibre\.eu|
	tube\.22decembre\.eu|
	peertube\.harmoniescreatives\.com|
	tube\.fabrigli\.fr|
	video\.thedwyers\.co|
	video\.bruitbruit\.com|
	peertube\.foxfam\.club|
	peer\.philoxweb\.be|
	videos\.bugs\.social|
	peertube\.malbert\.xyz|
	peertube\.bilange\.ca|
	libretube\.net|
	diytelevision\.com|
	peertube\.fedilab\.app|
	libre\.video|
	video\.mstddntfdn\.online|
	us\.tv|
	peertube\.sl-network\.fr|
	peertube\.dynlinux\.io|
	peertube\.david\.durieux\.family|
	peertube\.linuxrocks\.online|
	peerwatch\.xyz|
	v\.kretschmann\.social|
	tube\.otter\.sh|
	yt\.is\.nota\.live|
	tube\.dragonpsi\.xyz|
	peertube\.boneheadmedia\.com|
	videos\.funkwhale\.audio|
	watch\.44con\.com|
	peertube\.gcaillaut\.fr|
	peertube\.icu|
	pony\.tube|
	spacepub\.space|
	tube\.stbr\.io|
	v\.mom-gay\.faith|
	tube\.port0\.xyz|
	peertube\.simounet\.net|
	play\.jergefelt\.se|
	peertube\.zeteo\.me|
	tube\.danq\.me|
	peertube\.kerenon\.com|
	tube\.fab-l3\.org|
	tube\.calculate\.social|
	peertube\.mckillop\.org|
	tube\.netzspielplatz\.de|
	vod\.ksite\.de|
	peertube\.laas\.fr|
	tube\.govital\.net|
	peertube\.stephenson\.cc|
	bistule\.nohost\.me|
	peertube\.kajalinifi\.de|
	video\.ploud\.jp|
	video\.omniatv\.com|
	peertube\.ffs2play\.fr|
	peertube\.leboulaire\.ovh|
	peertube\.tronic-studio\.com|
	peertube\.public\.cat|
	peertube\.metalbanana\.net|
	video\.1000i100\.fr|
	peertube\.alter-nativ-voll\.de|
	tube\.pasa\.tf|
	tube\.worldofhauru\.xyz|
	pt\.kamp\.site|
	peertube\.teleassist\.fr|
	videos\.mleduc\.xyz|
	conf\.tube|
	media\.privacyinternational\.org|
	pt\.forty-two\.nl|
	video\.halle-leaks\.de|
	video\.grosskopfgames\.de|
	peertube\.schaeferit\.de|
	peertube\.jackbot\.fr|
	tube\.extinctionrebellion\.fr|
	peertube\.f-si\.org|
	video\.subak\.ovh|
	videos\.koweb\.fr|
	peertube\.zergy\.net|
	peertube\.roflcopter\.fr|
	peertube\.floss-marketing-school\.com|
	vloggers\.social|
	peertube\.iriseden\.eu|
	videos\.ubuntu-paris\.org|
	peertube\.mastodon\.host|
	armstube\.com|
	peertube\.s2s\.video|
	peertube\.lol|
	tube\.open-plug\.eu|
	open\.tube|
	peertube\.ch|
	peertube\.normandie-libre\.fr|
	peertube\.slat\.org|
	video\.lacaveatonton\.ovh|
	peertube\.uno|
	peertube\.servebeer\.com|
	peertube\.fedi\.quebec|
	tube\.h3z\.jp|
	tube\.plus200\.com|
	peertube\.eric\.ovh|
	tube\.metadocs\.cc|
	tube\.unmondemeilleur\.eu|
	gouttedeau\.space|
	video\.antirep\.net|
	nrop\.cant\.at|
	tube\.ksl-bmx\.de|
	tube\.plaf\.fr|
	tube\.tchncs\.de|
	video\.devinberg\.com|
	hitchtube\.fr|
	peertube\.kosebamse\.com|
	yunopeertube\.myddns\.me|
	peertube\.varney\.fr|
	peertube\.anon-kenkai\.com|
	tube\.maiti\.info|
	tubee\.fr|
	videos\.dinofly\.com|
	toobnix\.org|
	videotape\.me|
	voca\.tube|
	video\.heromuster\.com|
	video\.lemediatv\.fr|
	video\.up\.edu\.ph|
	balafon\.video|
	video\.ivel\.fr|
	thickrips\.cloud|
	pt\.laurentkruger\.fr|
	video\.monarch-pass\.net|
	peertube\.artica\.center|
	video\.alternanet\.fr|
	indymotion\.fr|
	fanvid\.stopthatimp\.net|
	video\.farci\.org|
	v\.lesterpig\.com|
	video\.okaris\.de|
	tube\.pawelko\.net|
	peertube\.mablr\.org|
	tube\.fede\.re|
	pytu\.be|
	evertron\.tv|
	devtube\.dev-wiki\.de|
	raptube\.antipub\.org|
	video\.selea\.se|
	peertube\.mygaia\.org|
	video\.oh14\.de|
	peertube\.livingutopia\.org|
	peertube\.the-penguin\.de|
	tube\.thechangebook\.org|
	tube\.anjara\.eu|
	pt\.pube\.tk|
	video\.samedi\.pm|
	mplayer\.demouliere\.eu|
	widemus\.de|
	peertube\.me|
	peertube\.zapashcanon\.fr|
	video\.latavernedejohnjohn\.fr|
	peertube\.pcservice46\.fr|
	peertube\.mazzonetto\.eu|
	video\.irem\.univ-paris-diderot\.fr|
	video\.livecchi\.cloud|
	alttube\.fr|
	video\.coop\.tools|
	video\.cabane-libre\.org|
	peertube\.openstreetmap\.fr|
	videos\.alolise\.org|
	irrsinn\.video|
	video\.antopie\.org|
	scitech\.video|
	tube2\.nemsia\.org|
	video\.amic37\.fr|
	peertube\.freeforge\.eu|
	video\.arbitrarion\.com|
	video\.datsemultimedia\.com|
	stoptrackingus\.tv|
	peertube\.ricostrongxxx\.com|
	docker\.videos\.lecygnenoir\.info|
	peertube\.togart\.de|
	tube\.postblue\.info|
	videos\.domainepublic\.net|
	peertube\.cyber-tribal\.com|
	video\.gresille\.org|
	peertube\.dsmouse\.net|
	cinema\.yunohost\.support|
	tube\.theocevaer\.fr|
	repro\.video|
	tube\.4aem\.com|
	quaziinc\.com|
	peertube\.metawurst\.space|
	videos\.wakapo\.com|
	video\.ploud\.fr|
	video\.freeradical\.zone|
	tube\.valinor\.fr|
	refuznik\.video|
	pt\.kircheneuenburg\.de|
	peertube\.asrun\.eu|
	peertube\.lagob\.fr|
	videos\.side-ways\.net|
	91video\.online|
	video\.valme\.io|
	video\.taboulisme\.com|
	videos-libr\.es|
	tv\.mooh\.fr|
	nuage\.acostey\.fr|
	video\.monsieur-a\.fr|
	peertube\.librelois\.fr|
	videos\.pair2jeux\.tube|
	videos\.pueseso\.club|
	peer\.mathdacloud\.ovh|
	media\.assassinate-you\.net|
	vidcommons\.org|
	ptube\.rousset\.nom\.fr|
	tube\.cyano\.at|
	videos\.squat\.net|
	video\.iphodase\.fr|
	peertube\.makotoworkshop\.org|
	peertube\.serveur\.slv-valbonne\.fr|
	vault\.mle\.party|
	hostyour\.tv|
	videos\.hack2g2\.fr|
	libre\.tube|
	pire\.artisanlogiciel\.net|
	videos\.numerique-en-commun\.fr|
	video\.netsyms\.com|
	video\.die-partei\.social|
	video\.writeas\.org|
	peertube\.swarm\.solvingmaz\.es|
	tube\.pericoloso\.ovh|
	watching\.cypherpunk\.observer|
	videos\.adhocmusic\.com|
	tube\.rfc1149\.net|
	peertube\.librelabucm\.org|
	videos\.numericoop\.fr|
	peertube\.koehn\.com|
	peertube\.anarchmusicall\.net|
	tube\.kampftoast\.de|
	vid\.y-y\.li|
	peertube\.xtenz\.xyz|
	diode\.zone|
	tube\.egf\.mn|
	peertube\.nomagic\.uk|
	visionon\.tv|
	videos\.koumoul\.com|
	video\.rastapuls\.com|
	video\.mantlepro\.com|
	video\.deadsuperhero\.com|
	peertube\.musicstudio\.pro|
	peertube\.we-keys\.fr|
	artitube\.artifaille\.fr|
	peertube\.ethernia\.net|
	tube\.midov\.pl|
	peertube\.fr|
	watch\.snoot\.tube|
	peertube\.donnadieu\.fr|
	argos\.aquilenet\.fr|
	tube\.nemsia\.org|
	tube\.bruniau\.net|
	videos\.darckoune\.moe|
	tube\.traydent\.info|
	dev\.videos\.lecygnenoir\.info|
	peertube\.nayya\.org|
	peertube\.live|
	peertube\.mofgao\.space|
	video\.lequerrec\.eu|
	peertube\.amicale\.net|
	aperi\.tube|
	tube\.ac-lyon\.fr|
	video\.lw1\.at|
	www\.yiny\.org|
	videos\.pofilo\.fr|
	tube\.lou\.lt|
	choob\.h\.etbus\.ch|
	tube\.hoga\.fr|
	peertube\.heberge\.fr|
	video\.obermui\.de|
	videos\.cloudfrancois\.fr|
	betamax\.video|
	video\.typica\.us|
	tube\.piweb\.be|
	video\.blender\.org|
	peertube\.cat|
	tube\.kdy\.ch|
	pe\.ertu\.be|
	peertube\.social|
	videos\.lescommuns\.org|
	tv\.datamol\.org|
	videonaute\.fr|
	dialup\.express|
	peertube\.nogafa\.org|
	megatube\.lilomoino\.fr|
	peertube\.tamanoir\.foucry\.net|
	peertube\.devosi\.org|
	peertube\.1312\.media|
	tube\.bootlicker\.party|
	skeptikon\.fr|
	video\.blueline\.mg|
	tube\.homecomputing\.fr|
	tube\.ouahpiti\.info|
	video\.tedomum\.net|
	video\.g3l\.org|
	fontube\.fr|
	peertube\.gaialabs\.ch|
	tube\.kher\.nl|
	peertube\.qtg\.fr|
	video\.migennes\.net|
	tube\.p2p\.legal|
	troll\.tv|
	videos\.iut-orsay\.fr|
	peertube\.solidev\.net|
	videos\.cemea\.org|
	video\.passageenseine\.fr|
	videos\.festivalparminous\.org|
	peertube\.touhoppai\.moe|
	sikke\.fi|
	peer\.hostux\.social|
	share\.tube|
	peertube\.walkingmountains\.fr|
	videos\.benpro\.fr|
	peertube\.parleur\.net|
	peertube\.heraut\.eu|
	tube\.aquilenet\.fr|
	peertube\.gegeweb\.eu|
	framatube\.org|
	thinkerview\.video|
	tube\.conferences-gesticulees\.net|
	peertube\.datagueule\.tv|
	video\.lqdn\.fr|
	tube\.mochi\.academy|
	media\.zat\.im|
	video\.colibris-outilslibres\.org|
	tube\.svnet\.fr|
	peertube\.video|
	peertube3\.cpy\.re|
	peertube2\.cpy\.re|
	videos\.tcit\.fr|
	peertube\.cpy\.re
	)'''

[EdenOvrutskiy]

I tried doing this, and for some reason I get two different versions of the page's source.
https://www.diffchecker.com/U1Di2koN
chrome version on the left, yt-dl's version on the right.
The m3u8 file on the site is generated by the form on the yt-dl source with a request somehow...

Never encountered a situation where "view-source" has unique information based on where I view it from.
And, I see no javascript to send that hidden form anywhere..

Any tips on how to get the m3u8's link on the module?

[selfisekai]

#26990

[B0pol]

@SpiderRider067 some instances enable by default hls playback, nitter.net and the default config file do not. You have to add a cookie "hlsPlayback" to get video url link everytime, no matter the instance used.
But I already worked on an extractor #26990 , I will rebase, update instance list soon and I hope it will get merged.

[Mennaruuk]

I know Nitter has been suffering from a rate-limiting problem. Is there a way to have youtube-dl retry if instance is rate-limited and the .m3u8 can't be extracted? Generally, a couple of refreshes solves the rate-limiting problem.