Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Where is the 20231214 update? #13

Open
Firestar-Reimu opened this issue Dec 26, 2023 · 9 comments
Open

Where is the 20231214 update? #13

Firestar-Reimu opened this issue Dec 26, 2023 · 9 comments
Assignees
Labels
bug Something isn't working pkg-moegirl zh.moegirl.org.cn packaging related

Comments

@Firestar-Reimu
Copy link

I own an AUR repo https://aur.archlinux.org/packages/fcitx5-moegirl

and I am thinking of updating it once a month

but December update has not released yet.

@Firestar-Reimu
Copy link
Author

https://github.com/outloudvi/mw2fcitx/actions/runs/7214341037

[build-and-publish](https://github.com/outloudvi/mw2fcitx/actions/runs/7214341037/job/19656214732#step:3:535)
Process completed with exit code 1.

[build-and-publish](https://github.com/outloudvi/mw2fcitx/actions/runs/7214341037/job/19656214732)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

@outloudvi outloudvi added the bug Something isn't working label Dec 26, 2023
@outloudvi outloudvi self-assigned this Dec 26, 2023
@outloudvi
Copy link
Owner

Seems that some 404 occurred. Probably a breaking API change on MediaWiki versions. I'll look into it some time later.

Thanks for reporting!

@outloudvi outloudvi added the pkg-moegirl zh.moegirl.org.cn packaging related label Dec 26, 2023
@outloudvi
Copy link
Owner

Seems that Moegirlpedia disabled an API we need to list page names.

https://zh.moegirl.org.cn/api.php?action=query&list=allpages

{
    "error": {
        "code": "action-notallowed",
        "info": "\u29fcapierror-action-notallowed\u29fd",
        "*": "See https://zh.moegirl.org.cn/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce> for notice of API deprecations and breaking changes."
    }
}

@Firestar-Reimu
Copy link
Author

So this pinyin dictionary will never be updated ever since?

@outloudvi
Copy link
Owner

It depends. I'll try to contact Moegirlpedia on the API change, but I think the change is by design and thus they are unlikely to revert the API restriction. Despite that, there are still alternative solutions like using one of the (somehow) mirrors of MGP.

@outloudvi
Copy link
Owner

I got a reply from Moegirlpedia admin that they are doing some server side changes. In the future, they will set up another endpoint dedicated for bots, which may hopefully be helpful to this project. Before that, the repo might not publish updates of *-pinyin-moegirl.

@outloudvi outloudvi pinned this issue Jan 3, 2024
@tumuyan
Copy link

tumuyan commented Feb 28, 2024

I think we can get a list of recently updated items from https://zh.moegirl.org.cn/Special:%E6%9C%80%E8%BF%91%E6%9B%B4%E6%94%B9 by specified number of items or a time duration, then merge the old dict and the new items to get the full list.

@outloudvi
Copy link
Owner

@tumuyan Yep. We can get through Special:NewPages to have a list of new titles, and the list's also possible with the MediaWiki API. However, it's still not solving this very issue, since Moegirlpedia doesn't open access to this API.
The list of new titles might not be too long (I think, <2000 to make up for 2 months), but I don't think the situation is so tense that the project has to bypass the API and do the selenium trick.

@outloudvi
Copy link
Owner

A new version is published by looking at Special:NewPages. We believe that several requests to Special:NewPages should not generate too much load, and thus decided to do it. Thanks, @tumuyan!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working pkg-moegirl zh.moegirl.org.cn packaging related
Projects
None yet
Development

No branches or pull requests

3 participants