Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add crawler for KIT websites like IPD #20

Open
probstlukas opened this issue Oct 28, 2021 · 2 comments
Open

Add crawler for KIT websites like IPD #20

probstlukas opened this issue Oct 28, 2021 · 2 comments
Labels
enhancement New feature or request

Comments

@probstlukas
Copy link
Contributor

Many KIT lectures do not use ILIAS to make the files available to students. Instead, they use the websites of their institutes. A prominent example is "Programmierparadigmen" with https://pp.ipd.kit.edu/lehre/WS202122/paradigmen/ and https://pp.ipd.kit.edu/lehre/WS202122/paradigmen/uebung/ (for the current semester). It would be practical to be able to set this up in a config file and obtain all files via the KIT-ILIAS downloader.

@funnym0nk3y
Copy link
Contributor

In addition a crawler for the lecture recording platform of the KIT library would be nice.

@FliegendeWurst FliegendeWurst added the enhancement New feature or request label Oct 30, 2021
@funnym0nk3y
Copy link
Contributor

@thelukasprobst From "normal" websites that don't hide the download link behind some PHP or JS I can recommend browser extensions like DownThemAll or DownloadStar. This does not sync the files constantly but is useful for archiving the files.
Also: Have a look at PFERD, which has this capability already.

The download of videos from KIT library (DIVA) works with youtube-dl via RSS ingestion. Usually lecture series are grouped and a RSS feed can be downloaded via

grafik

Shove that xml file into youtube-dl and voilà.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants