Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Trash active though "Deleted Files" AddOn is disabled #464

Closed
Madic- opened this issue May 31, 2019 · 44 comments
Closed

Trash active though "Deleted Files" AddOn is disabled #464

Madic- opened this issue May 31, 2019 · 44 comments
Labels
0. Needs triage Issues that need to be triaged bug feature: trashbin Items related to the trashbin feature workaround

Comments

@Madic-
Copy link

Madic- commented May 31, 2019

When deleting files from a group folder they are assigned to a trash bin, even though the AddOn "Deleted Files" is not enabled.
We have disabled this addon because files should be directly deleted.
The size of the folder __groupfolders/trash/* increases with every deleted file.

When "Deleted Files" is disabled, I would expect that a deleted file in a group folder also gets directly deleted.

Nextcloud Version: 15.0.7
Group Folders Version: 3.0.2

@Beeez

This comment has been minimized.

@hriekehof
Copy link

Hi,
i know there are always plenty of other important things to do, but the trashbin issues are adding up #455, #345, #314, #301 for example.
I it would be so great if something would be done here. @icewind1991 can you tell us something about the issues ? Most of the time the trashbin issues are not commented. Would be so nice to get some info on this topic

@Beeez
Copy link

Beeez commented Jul 1, 2019

Yeah the trash handling is atrocious. Users rarely manage their own trash already and we rely on trash retention on their personal files. With many group folders available things just keep piling up until we find out that storage is full because of tons of deleted items.

@landryb

This comment has been minimized.

@Beeez

This comment has been minimized.

@patricksebastien

This comment has been minimized.

@cyBea

This comment has been minimized.

@expert-geeks

This comment has been minimized.

@feutl
Copy link

feutl commented Jan 22, 2020

Would it also be a feasible solution to delete the files on the filesystem and run a occ files:scan --all or sudo -u www-data php occ files:scan --path=/user/files/my_groupfolder_path like mentioned here #46 ?
Honestly I just hate to touch a database with so many valuable data by adding it manually and work around how NC is handling this.

What you think, until somebody gets the trashbin_retention_obligation also working for groupfolders.

I also played around with the find command and options like mtime, atime and ctime and all of the options do not show me the result I wanted. None of them knows when the files were deleted, based on the date shown in the WebUI trashbin. There are some files deleted on a certain date some 350 days ago, but I cannot filter them via the filesystem timestamps. This means, I end up deleting files which could have been deleted just some days ago, because of some older timestamps (creation, changed or accessed - last one is not trustworthy anyhow).

The script is great, but actually we would need the information from the DB and the deletion time, afterwards delete the file and update the DB.

Also I am not sure how consistent, based on the above command, the process of deleting in DB and filesystem is. I must assume this runs out of sync earlier than later.

@Beeez

This comment has been minimized.

@expert-geeks
Copy link

expert-geeks commented Jan 27, 2020

Would it also be a feasible solution to delete the files on the filesystem and run a occ files:scan --all or sudo -u www-data php occ files:scan --path=/user/files/my_groupfolder_path like mentioned here #46 ?

Not really, the trashbin is ignored when scanning afaik. The entries still exist in the database and will cause conflicts when you try to delete the file as the system thinks it's already been deleted.

Honestly I just hate to touch a database with so many valuable data by adding it manually and work around how NC is handling this.

I agree, it's a huge oversight.

What you think, until somebody gets the trashbin_retention_obligation also working for groupfolders.

I also played around with the find command and options like mtime, atime and ctime and all of the options do not show me the result I wanted. None of them knows when the files were deleted, based on the date shown in the WebUI trashbin. There are some files deleted on a certain date some 350 days ago, but I cannot filter them via the filesystem timestamps. This means, I end up deleting files which could have been deleted just some days ago, because of some older timestamps (creation, changed or accessed - last one is not trustworthy anyhow).

The script is great, but actually we would need the information from the DB and the deletion time, afterwards delete the file and update the DB.

That would be ideal.

Also I am not sure how consistent, based on the above command, the process of deleting in DB and filesystem is. I must assume this runs out of sync earlier than later.

Well so far it appears to be a reasonable compromise and is working OK. If you want to purge the trash folders and database then amend the script to remove the date constraints and run it once a week/month on a Sunday morning. That would ensure things don't get out of sync.

@feutl
Copy link

feutl commented Jan 27, 2020

Well so far it appears to be a reasonable compromise and is working OK. If you want to purge the trash folders and database then amend the script to remove the date constraints and run it once a week/month on a Sunday morning. That would ensure things don't get out of sync.

Based on my findings and testings, I rather assume it runs out of sync quite easily. Especially if lots of files do get deleted from multiple users during the time period and if they are on the system for quite some time. I would not trust the filesystem timestamps to delete something from the DB and it would also be quite hard to find, I assume.

But thanks anyhow for the effort.

@mesiah1970-haydar

This comment has been minimized.

@mesiah1970-haydar
Copy link

Hello and Good morning,

yes I agree, the group folders trashbin should expire. Maybe we can achieve this with a extra option in the group folder app, or create a new group folder occ command. It could be something simple, which could help people to get out of the trashbin mess. Please help us!

Rgds

Haydar

@Beeez
Copy link

Beeez commented Feb 18, 2020

Hello and Good morning,

yes I agree, the group folders trashbin should expire. Maybe we can achieve this with a extra option in the group folder app, or create a new group folder occ command. It could be something simple, which could help people to get out of the trashbin mess. Please help us!

Rgds

Haydar

Group Folders shouldnt need a separate setting for this. It should just obey whatever trash retention policy is already in place for normal files in users trash.

@mesiah1970-haydar

This comment has been minimized.

@feutl

This comment has been minimized.

@Greek64

This comment has been minimized.

@feutl

This comment has been minimized.

@mesiah1970-haydar
Copy link

@rullzer @nickvergessen

will be there an update regarding this trashbin issue. So when a file gets into the trashbin from the group folder, it should be deleted accoring to the config.php settings. At the moment this is not possible

@mesiah1970-haydar

This comment has been minimized.

@nickvergessen
Copy link
Member

Im far from being an expert or maintainer of this app so I will unsubscribe again, as I'm currently very busy with other topics (Nextcloud Talk)

@mesiah1970-haydar

This comment has been minimized.

@feutl
Copy link

feutl commented Apr 21, 2020

@mesiah1970-haydar
In my case, and because of the trash thing not being resolved, I was able to move away from the group folders and using a shared folder instead.

But I am going to stick around, because this should be resolved.
Seems it gets more common with "nextcloud" apps under the "nextcloud" hood that they do lack communication. Even if they would just say, not now, but later in the future ;)

@mesiah1970-haydar
Copy link

mesiah1970-haydar commented Apr 21, 2020

@feutl

This is the problem on my N instance, I was a little late to test the GF, so it was published already to the public and I cannot take it back anymore. So my opinion is , stick always to the nextcloud itself, never to the apps;-)

@feutl
Copy link

feutl commented Apr 21, 2020

@mesiah1970-haydar
this is true
and therefor I removed it, even though it took some work.
after the last 1,5 years, even with updates I ran into multiple issues with group folders, the trash bin thing, I realized quite late, was just the tip of the iceberg.

@mesiah1970-haydar
Copy link

Ok, maybe I should go the same way, you did;-) So for me Group folders are a mess, And I cannot suggest to anyone and anybody. Maybe I can find some way to move the files from the GF to the shared folders

@feutl
Copy link

feutl commented Apr 21, 2020

Off Topic

What I did, was creating the same folders I was using with groupfolders (but not sharing them). Some people even suggested to create a groupfolder user which is owner of alle group foldes and later shares them to the persons.
Anyhow, create the same structure but with a different name. Copy over all files, disable the group folder, rename the shared folder to match the group folder and share them.
For me this was seamless, and the end users haven't even noticed it (or did not tell me ;) )

@mesiah1970-haydar
Copy link

Off Topic

What I did, was creating the same folders I was using with groupfolders (but not sharing them). Some people even suggested to create a groupfolder user which is owner of alle group foldes and later shares them to the persons.
Anyhow, create the same structure but with a different name. Copy over all files, disable the group folder, rename the shared folder to match the group folder and share them.
For me this was seamless, and the end users haven't even noticed it (or did not tell me ;) )

Yeah, but I've created a groupfolder for each projects and added a group to it with one user. This group and user is the owner. So far so good. This should work, but the folder owners share their group folders with externals outside in the public and password protected. I guess, this would be the greatest problem. Since every owner has to re-share again and renew the password.

Haydar

@mesiah1970-haydar
Copy link

The worst thing is, that you cannot address the issues here at github or nextcloud without being kicked. I would express my comments about the issues in the Nextcloud public not to use it

@feutl
Copy link

feutl commented Apr 21, 2020

The worst thing is, that you cannot address the issues here at github or nextcloud without being kicked. I would express my comments about the issues in the Nextcloud public not to use it

I would not say "nextcloud" is going to kick someone, because some projects under the nextcloud umbrella are quite well handled and do have a good communication and issue culture. Wheres others are not that great in both things ;)

@mesiah1970-haydar

This comment has been minimized.

@mesiah1970-haydar

This comment has been minimized.

@rullzer
Copy link
Member

rullzer commented Apr 24, 2020

@mesiah1970-haydar please watch your tone. I'd like to remind you of our code of conduct.

Mentioning us all the time is a not going to have us look at the issue any faster. It might even have the opposite effect.

Since this seems to be such an important issue to you I assume you have a support contract. In that case please do reach out. We have limited time and as a result of this we usually first have to spend our time and resources on the things our customers run into.

Of course another solution is to submit a pull request to get it fixed.
As I already have a todo list that is way longer than I'd like I'm going to unsubscribe here again.

@mesiah1970-haydar

This comment has been minimized.

@Ra72xx
Copy link

Ra72xx commented May 14, 2020

If the handling of such an important issue is like that, wouldn't it be fair to remove "Group folders" from the list of "official" nextcloud apps? I came here because I ran out of space on my server without any clue why this happened. I trusted in using official nextcloud apps and using the settings you can do from the web interface. I had no idea that group folders simply accumulate their trash without any chance of getting rid of it without messing around with the database.

So my urgent appeal: Don't sell something like that as "official" app!

@mesiah1970-haydar
Copy link

Hello Larx,

I totally agree with you, I had similar posting regarding this issue. But my contribution to this topic was marked as disruptive content. I agree people should be warned before using this App.

Haydar

@expert-geeks
Copy link

expert-geeks commented Oct 17, 2020

Function to clear group folders trash has recently been added by rullzer & juliushaertl (thanks guys!)

sudo -u www-data php /var/www/nextcloud/occ groupfolders:trashbin:cleanup

@biva
Copy link

biva commented Nov 10, 2020

Hello, we're wondering to use groupfolders in production, and I'm afraid of this issue: is this bug still present? Any update? I appreciate the function to clear the trash mentioned by @expert-geeks but I guess it's not a sustainable way on the long term, is it?
Thanks!

@expert-geeks
Copy link

expert-geeks commented Nov 10, 2020

Hello, we're wondering to use groupfolders in production, and I'm afraid of this issue: is this bug still present? Any update? I appreciate the function to clear the trash mentioned by @expert-geeks but I guess it's not a sustainable way on the long term, is it?
Thanks!

Currently the trash in the group folders doesn't respect the 'trashbin_retention_obligation' setting, but I understand that's being worked on.. Fingers crossed it get addressed soon.

@pierreozoux pierreozoux added 0. Needs triage Issues that need to be triaged workaround feature: trashbin Items related to the trashbin feature bug labels Mar 14, 2021
@fschrempf
Copy link
Contributor

@mesiah1970-haydar As you didn't get any proper response (except for the one from rullzer) to your complaints (and rants) above, here is a reply from my point of view (I'm not a NC developer, only a volunteer helping out here and there).

First, you are completely right that getting no response on issues like this is frustrating and I know this frustration myself. Complaining about this fact is alright. Ideally there should be some response from a developer in any case in an acceptable amount of time, even if it's just "we can't do anything at the moment". Though the world (and this project) is far from ideality. Please see the issue #1215 for more details and discussions about this general topic, which is completely unrelated to this issue. If you have suggestions or feedback, feel free to join the discussion.

Second, what is totally unacceptable is part of the attitude you have expressed above. NC is in the first place a community project. Nobody owes you anything. What makes you think anyone has a responsibility in fixing the issues you want to see fixed?
On the other hand, the good thing about a community project is, that you can join and fix the problem yourself or pay someone to do it as rullzer already suggested.

But my contribution to this topic was marked as disruptive content.

For a reason. This issue is a technical issue and the discussion should stay on that topic. Blaming people because you think they should act to your liking is considered disruptive.

The worst thing is, that you cannot address the issues here at github or nextcloud without being kicked. I would express my comments about the issues in the Nextcloud public not to use it

This is not true. You can voice your opinion whenever you want, but you have to stick to some rules and think about if your own expectations and attitude are appropriate.

@fschrempf
Copy link
Contributor

If the handling of such an important issue is like that, wouldn't it be fair to remove "Group folders" from the list of "official" nextcloud apps?

Yes, this is indeed a problem. Considering the app as stable and have it "featured" as official app is (or was, some things got better and were fixed) questionable to say the least. Please see #1215 for more information about this topic. Feel free to join the discussion.

@fschrempf
Copy link
Contributor

The main point of this issue seems to be the trashbin expiration for groupfolders. A solution for this has been implemented in #1759 which will probably be released with v12 of the groupfolders app and NC 24. It's currently not clear if this will also be backported to other stable releases.

Please give this approach a try and provide feedback via new issues if required. Thanks!

@fschrempf
Copy link
Contributor

Quoting 1759#979245063: The solution in #1759 has been backported to NC23 and will be part of the next point release (next week).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0. Needs triage Issues that need to be triaged bug feature: trashbin Items related to the trashbin feature workaround
Projects
None yet
Development

No branches or pull requests