SLR scraper filenames

[vt-idiot]

The SLR scraper currently sets filenames for every resolution possible, and every fisheye projection possible when the video is fisheye. It adds both MONO and TB for 360. All of this can be determined via their API...

I'm not sure if it adds up to much, or how the DB compression works, but compare 5,847 bytes of "filenames" when every single name possible is used for a fisheye projection video with 580 bytes when only the actually possible ones are used. There are 40,000 some odd scenes on SLR if you scrape everything from every studio...

Gigantic wall of text

["SLR_SLR Originals_Notes of Affection_6400p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_6400p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_6400p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_6400p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_6400p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_4096p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_4096p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_4096p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_4096p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_4096p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_4000p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_4000p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_4000p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_4000p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_4000p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_3840p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_3840p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_3840p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_3840p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_3840p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_3360p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_3360p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_3360p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_3360p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_3360p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_3160p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_3160p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_3160p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_3160p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_3160p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_3072p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_3072p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_3072p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_3072p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_3072p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_3000p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_3000p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_3000p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_3000p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_3000p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_2900p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_2900p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_2900p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_2900p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_2900p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_2880p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_2880p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_2880p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_2880p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_2880p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_2700p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_2700p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_2700p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_2700p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_2700p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_2650p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_2650p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_2650p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_2650p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_2650p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_2160p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_2160p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_2160p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_2160p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_2160p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_1920p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_1920p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_1920p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_1920p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_1920p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_1440p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_1440p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_1440p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_1440p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_1440p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_1080p_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_1080p_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_1080p_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_1080p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_1080p_37756_VRCA220_alpha.mp4","SLR_SLR Originals_Notes of Affection_original_37756_MKX200_alpha.mp4","SLR_SLR Originals_Notes of Affection_original_37756_MKX220_alpha.mp4","SLR_SLR Originals_Notes of Affection_original_37756_RF52_alpha.mp4","SLR_SLR Originals_Notes of Affection_original_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_original_37756_VRCA220_alpha.mp4"]

vs.

["SLR_SLR Originals_Notes of Affection_original_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_4000p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_3840p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_3360p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_2880p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_2160p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_1920p_37756_FISHEYE190_alpha.mp4","SLR_SLR Originals_Notes of Affection_1440p_37756_FISHEYE190_alpha.mp4"]

Before:

After:

It can now also determine the correct projection

For 360 video as well as other fisheye projections

The entire scraper might need a looksie (by someone more knowledgeable!!!) to see where the API can be used instead; we're already grabbing that JSON anyways, but then using colly for almost everything.