[Bug]: Integrity constraint violation: 1062 Duplicate entry for key user_ldap_membership_unique #43496
Comments
rpelissi
added
0. Needs triage
|
Can you double check you do not have a duplicated LDAP configuration? |
|
Here is the output of the command: |
|
Hi, |
|
Hi, So far so good. |
|
Yes there is a mapping and ldap groups appear as Nextcloud groups. |
|
@rpelissi Is that still a problem? If yes can you try 28.0.3? |
|
fwiw i just ran into this with 28.0.3, it seems. |
|
Ok, so, i just spend some time debugging this. The issue is that the regular job with id 52 ( Maybe a timeout or sth. when retrieving groups being overly strict, hence falling back to the login group from the user object only? Specifically, Could this be related to #42576, specifically #42576 (comment) ? |
|
Are you sure your user<->group relation ship is correctly configured for Nextcloud to pick up? Recently I’ve seen a lot of instances where group were detected through memberof but the other way was misconfigured. We should add a check for that at some point. |
|
Moin, This actually makes sense, i.e., if upon login group membership is established via 'memberOf', but the regular job iterates over the group entries. Checking now, I indeed see that the config seems to have defaulted to use Changing between So, i think that this explains the occurrence of this. However, what it does not explain is why this did not happen with NC27? Was there a change there? |
|
Yes the way group membership is cached in database was changed. |
|
See #39446 |
|
Thanks; I cannot speak for the original reporter, but from my reading of this issue, that should be the explanation. |
Bug description
So I have upgrade to latest 28.02 versin using occ upgrade. Everything is working fine but received some popup from time to time saying that an administrator remove my user from an ldap group.
Now checking in the logs
DbalException An exception occurred while executing a query: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'interne-romain.pelissier' for key 'user_ldap_membership_unique'I am using groups and users from an openldap server and the ldap connection is/was working fine so far.
The issue happen after the update to 28.02
I see some references to this issue here #42576 and #42482 but not sure it really apply and cannot found a fix for this.
Steps to reproduce
Expected behavior
We should not have this duplicate entry issue
Installation method
Community Manual installation with Archive
Nextcloud Server version
28
Operating system
RHEL/CentOS
PHP engine version
PHP 8.2
Web server
Apache (supported)
Database engine version
MariaDB
Is this bug present after an update or on a fresh install?
Upgraded to a MAJOR version (ex. 22 to 23)
Are you using the Nextcloud Server Encryption module?
Encryption is Disabled
What user-backends are you using?
Configuration report
{ "system": { "instanceid": "***REMOVED SENSITIVE VALUE***", "passwordsalt": "***REMOVED SENSITIVE VALUE***", "secret": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ "192.168.6.8", "cloud.digitalrat.org" ], "trusted_proxies": "***REMOVED SENSITIVE VALUE***", "overwritehost": "cloud.digitalrat.org", "overwriteprotocol": "https", "overwrite.cli.url": "https:\/\/cloud.digitalrat.org\/", "htaccess.RewriteBase": "\/", "datadirectory": "***REMOVED SENSITIVE VALUE***", "dbtype": "mysql", "version": "28.0.2.5", "dbname": "***REMOVED SENSITIVE VALUE***", "dbhost": "***REMOVED SENSITIVE VALUE***", "dbport": "", "dbtableprefix": "oc_", "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "installed": true, "mail_smtpmode": "smtp", "mail_smtphost": "***REMOVED SENSITIVE VALUE***", "mail_smtpport": "25", "mail_from_address": "***REMOVED SENSITIVE VALUE***", "mail_domain": "***REMOVED SENSITIVE VALUE***", "ldapIgnoreNamingRules": false, "ldapProviderFactory": "\\OCA\\User_LDAP\\LDAPProviderFactory", "maintenance": false, "theme": "", "loglevel": 2, "filelocking.enabled": true, "updater.release.channel": "stable", "mysql.utf8mb4": true, "mail_sendmailmode": "smtp", "app_install_overwrite": [ "twofactor_email" ], "twofactor_enforced": "true", "twofactor_enforced_groups": [ "Utilisateurs" ], "twofactor_enforced_excluded_groups": [], "encryption.legacy_format_support": false, "encryption.key_storage_migrated": false, "default_phone_region": "CA", "memcache.locking": "\\OC\\Memcache\\Redis", "memcache.local": "\\OC\\Memcache\\Redis", "memcache.distributed": "\\OC\\Memcache\\Redis", "redis": { "host": "***REMOVED SENSITIVE VALUE***", "port": 0, "dbindex": 0, "timeout": 1.5 }, "maintenance_window_start": 1 } }List of activated Apps
Nextcloud Signing status
Nextcloud Logs
{"reqId":"ZcQo7LNEtNtamhQm@rvEpAAAAFM","level":3,"time":"2024-02-08T01:05:49+00:00","remoteAddr":"192.168.7.30","user":"romain.pelissier","app":"no app in context","method":"PUT","url":"/ocs/v2.php/apps/user_status/api/v1/heartbeat?format=json","message":"Exception thrown: OC\\DB\\Exceptions\\DbalException","userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:121.0) Gecko/20100101 Firefox/121.0","version":"28.0.2.5","exception":{"Exception":"OC\\DB\\Exceptions\\DbalException","Message":"An exception occurred while executing a query: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'interne-romain.pelissier' for key 'user_ldap_membership_unique'","Code":1062,"Trace":[{"file":"/www/html/prod/nextcloud/lib/private/DB/QueryBuilder/QueryBuilder.php","line":328,"function":"wrap","class":"OC\\DB\\Exceptions\\DbalException","type":"::"},{"file":"/www/html/prod/nextcloud/lib/public/AppFramework/Db/QBMapper.php","line":137,"function":"executeStatement","class":"OC\\DB\\QueryBuilder\\QueryBuilder","type":"->"},{"file":"/www/html/prod/nextcloud/apps/user_ldap/lib/LoginListener.php","line":95,"function":"insert","class":"OCP\\AppFramework\\Db\\QBMapper","type":"->"},{"file":"/www/html/prod/nextcloud/apps/user_ldap/lib/LoginListener.php","line":67,"function":"updateGroups","class":"OCA\\User_LDAP\\LoginListener","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/www/html/prod/nextcloud/apps/user_ldap/lib/LoginListener.php","line":55,"function":"onPostLogin","class":"OCA\\User_LDAP\\LoginListener","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/EventDispatcher/ServiceEventListener.php","line":86,"function":"handle","class":"OCA\\User_LDAP\\LoginListener","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php","line":230,"function":"__invoke","class":"OC\\EventDispatcher\\ServiceEventListener","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php","line":59,"function":"callListeners","class":"Symfony\\Component\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/EventDispatcher/EventDispatcher.php","line":94,"function":"dispatch","class":"Symfony\\Component\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/EventDispatcher/EventDispatcher.php","line":106,"function":"dispatch","class":"OC\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/User/Session.php","line":392,"function":"dispatchTyped","class":"OC\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/User/Session.php","line":667,"function":"completeLogin","class":"OC\\User\\Session","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/www/html/prod/nextcloud/lib/private/User/Session.php","line":868,"function":"loginWithToken","class":"OC\\User\\Session","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/www/html/prod/nextcloud/lib/base.php","line":1145,"function":"tryTokenLogin","class":"OC\\User\\Session","type":"->"},{"file":"/www/html/prod/nextcloud/ocs/v1.php","line":62,"function":"handleLogin","class":"OC","type":"::"},{"file":"/www/html/prod/nextcloud/ocs/v2.php","line":23,"args":["/www/html/prod/nextcloud/ocs/v1.php"],"function":"require_once"}],"File":"/www/html/prod/nextcloud/lib/private/DB/Exceptions/DbalException.php","Line":71,"Previous":{"Exception":"Doctrine\\DBAL\\Exception\\UniqueConstraintViolationException","Message":"An exception occurred while executing a query: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'interne-romain.pelissier' for key 'user_ldap_membership_unique'","Code":1062,"Trace":[{"file":"/www/html/prod/nextcloud/3rdparty/doctrine/dbal/src/Connection.php","line":1938,"function":"convert","class":"Doctrine\\DBAL\\Driver\\API\\MySQL\\ExceptionConverter","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/doctrine/dbal/src/Connection.php","line":1880,"function":"handleDriverException","class":"Doctrine\\DBAL\\Connection","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/doctrine/dbal/src/Connection.php","line":1208,"function":"convertExceptionDuringQuery","class":"Doctrine\\DBAL\\Connection","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/DB/Connection.php","line":294,"function":"executeStatement","class":"Doctrine\\DBAL\\Connection","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/doctrine/dbal/src/Query/QueryBuilder.php","line":386,"function":"executeStatement","class":"OC\\DB\\Connection","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/DB/QueryBuilder/QueryBuilder.php","line":280,"function":"execute","class":"Doctrine\\DBAL\\Query\\QueryBuilder","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/DB/QueryBuilder/QueryBuilder.php","line":326,"function":"execute","class":"OC\\DB\\QueryBuilder\\QueryBuilder","type":"->"},{"file":"/www/html/prod/nextcloud/lib/public/AppFramework/Db/QBMapper.php","line":137,"function":"executeStatement","class":"OC\\DB\\QueryBuilder\\QueryBuilder","type":"->"},{"file":"/www/html/prod/nextcloud/apps/user_ldap/lib/LoginListener.php","line":95,"function":"insert","class":"OCP\\AppFramework\\Db\\QBMapper","type":"->"},{"file":"/www/html/prod/nextcloud/apps/user_ldap/lib/LoginListener.php","line":67,"function":"updateGroups","class":"OCA\\User_LDAP\\LoginListener","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/www/html/prod/nextcloud/apps/user_ldap/lib/LoginListener.php","line":55,"function":"onPostLogin","class":"OCA\\User_LDAP\\LoginListener","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/EventDispatcher/ServiceEventListener.php","line":86,"function":"handle","class":"OCA\\User_LDAP\\LoginListener","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php","line":230,"function":"__invoke","class":"OC\\EventDispatcher\\ServiceEventListener","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php","line":59,"function":"callListeners","class":"Symfony\\Component\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/EventDispatcher/EventDispatcher.php","line":94,"function":"dispatch","class":"Symfony\\Component\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/EventDispatcher/EventDispatcher.php","line":106,"function":"dispatch","class":"OC\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/User/Session.php","line":392,"function":"dispatchTyped","class":"OC\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/User/Session.php","line":667,"function":"completeLogin","class":"OC\\User\\Session","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/www/html/prod/nextcloud/lib/private/User/Session.php","line":868,"function":"loginWithToken","class":"OC\\User\\Session","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/www/html/prod/nextcloud/lib/base.php","line":1145,"function":"tryTokenLogin","class":"OC\\User\\Session","type":"->"},{"file":"/www/html/prod/nextcloud/ocs/v1.php","line":62,"function":"handleLogin","class":"OC","type":"::"},{"file":"/www/html/prod/nextcloud/ocs/v2.php","line":23,"args":["/www/html/prod/nextcloud/ocs/v1.php"],"function":"require_once"}],"File":"/www/html/prod/nextcloud/3rdparty/doctrine/dbal/src/Driver/API/MySQL/ExceptionConverter.php","Line":62,"Previous":{"Exception":"Doctrine\\DBAL\\Driver\\PDO\\Exception","Message":"SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'interne-romain.pelissier' for key 'user_ldap_membership_unique'","Code":1062,"Trace":[{"file":"/www/html/prod/nextcloud/3rdparty/doctrine/dbal/src/Driver/PDO/Statement.php","line":132,"function":"new","class":"Doctrine\\DBAL\\Driver\\PDO\\Exception","type":"::"},{"file":"/www/html/prod/nextcloud/3rdparty/doctrine/dbal/src/Connection.php","line":1202,"function":"execute","class":"Doctrine\\DBAL\\Driver\\PDO\\Statement","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/DB/Connection.php","line":294,"function":"executeStatement","class":"Doctrine\\DBAL\\Connection","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/doctrine/dbal/src/Query/QueryBuilder.php","line":386,"function":"executeStatement","class":"OC\\DB\\Connection","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/DB/QueryBuilder/QueryBuilder.php","line":280,"function":"execute","class":"Doctrine\\DBAL\\Query\\QueryBuilder","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/DB/QueryBuilder/QueryBuilder.php","line":326,"function":"execute","class":"OC\\DB\\QueryBuilder\\QueryBuilder","type":"->"},{"file":"/www/html/prod/nextcloud/lib/public/AppFramework/Db/QBMapper.php","line":137,"function":"executeStatement","class":"OC\\DB\\QueryBuilder\\QueryBuilder","type":"->"},{"file":"/www/html/prod/nextcloud/apps/user_ldap/lib/LoginListener.php","line":95,"function":"insert","class":"OCP\\AppFramework\\Db\\QBMapper","type":"->"},{"file":"/www/html/prod/nextcloud/apps/user_ldap/lib/LoginListener.php","line":67,"function":"updateGroups","class":"OCA\\User_LDAP\\LoginListener","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/www/html/prod/nextcloud/apps/user_ldap/lib/LoginListener.php","line":55,"function":"onPostLogin","class":"OCA\\User_LDAP\\LoginListener","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/EventDispatcher/ServiceEventListener.php","line":86,"function":"handle","class":"OCA\\User_LDAP\\LoginListener","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php","line":230,"function":"__invoke","class":"OC\\EventDispatcher\\ServiceEventListener","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php","line":59,"function":"callListeners","class":"Symfony\\Component\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/EventDispatcher/EventDispatcher.php","line":94,"function":"dispatch","class":"Symfony\\Component\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/EventDispatcher/EventDispatcher.php","line":106,"function":"dispatch","class":"OC\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/User/Session.php","line":392,"function":"dispatchTyped","class":"OC\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/User/Session.php","line":667,"function":"completeLogin","class":"OC\\User\\Session","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/www/html/prod/nextcloud/lib/private/User/Session.php","line":868,"function":"loginWithToken","class":"OC\\User\\Session","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/www/html/prod/nextcloud/lib/base.php","line":1145,"function":"tryTokenLogin","class":"OC\\User\\Session","type":"->"},{"file":"/www/html/prod/nextcloud/ocs/v1.php","line":62,"function":"handleLogin","class":"OC","type":"::"},{"file":"/www/html/prod/nextcloud/ocs/v2.php","line":23,"args":["/www/html/prod/nextcloud/ocs/v1.php"],"function":"require_once"}],"File":"/www/html/prod/nextcloud/3rdparty/doctrine/dbal/src/Driver/PDO/Exception.php","Line":28,"Previous":{"Exception":"PDOException","Message":"SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'interne-romain.pelissier' for key 'user_ldap_membership_unique'","Code":"23000","Trace":[{"file":"/www/html/prod/nextcloud/3rdparty/doctrine/dbal/src/Driver/PDO/Statement.php","line":130,"function":"execute","class":"PDOStatement","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/doctrine/dbal/src/Connection.php","line":1202,"function":"execute","class":"Doctrine\\DBAL\\Driver\\PDO\\Statement","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/DB/Connection.php","line":294,"function":"executeStatement","class":"Doctrine\\DBAL\\Connection","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/doctrine/dbal/src/Query/QueryBuilder.php","line":386,"function":"executeStatement","class":"OC\\DB\\Connection","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/DB/QueryBuilder/QueryBuilder.php","line":280,"function":"execute","class":"Doctrine\\DBAL\\Query\\QueryBuilder","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/DB/QueryBuilder/QueryBuilder.php","line":326,"function":"execute","class":"OC\\DB\\QueryBuilder\\QueryBuilder","type":"->"},{"file":"/www/html/prod/nextcloud/lib/public/AppFramework/Db/QBMapper.php","line":137,"function":"executeStatement","class":"OC\\DB\\QueryBuilder\\QueryBuilder","type":"->"},{"file":"/www/html/prod/nextcloud/apps/user_ldap/lib/LoginListener.php","line":95,"function":"insert","class":"OCP\\AppFramework\\Db\\QBMapper","type":"->"},{"file":"/www/html/prod/nextcloud/apps/user_ldap/lib/LoginListener.php","line":67,"function":"updateGroups","class":"OCA\\User_LDAP\\LoginListener","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/www/html/prod/nextcloud/apps/user_ldap/lib/LoginListener.php","line":55,"function":"onPostLogin","class":"OCA\\User_LDAP\\LoginListener","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/EventDispatcher/ServiceEventListener.php","line":86,"function":"handle","class":"OCA\\User_LDAP\\LoginListener","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php","line":230,"function":"__invoke","class":"OC\\EventDispatcher\\ServiceEventListener","type":"->"},{"file":"/www/html/prod/nextcloud/3rdparty/symfony/event-dispatcher/EventDispatcher.php","line":59,"function":"callListeners","class":"Symfony\\Component\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/EventDispatcher/EventDispatcher.php","line":94,"function":"dispatch","class":"Symfony\\Component\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/EventDispatcher/EventDispatcher.php","line":106,"function":"dispatch","class":"OC\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/User/Session.php","line":392,"function":"dispatchTyped","class":"OC\\EventDispatcher\\EventDispatcher","type":"->"},{"file":"/www/html/prod/nextcloud/lib/private/User/Session.php","line":667,"function":"completeLogin","class":"OC\\User\\Session","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/www/html/prod/nextcloud/lib/private/User/Session.php","line":868,"function":"loginWithToken","class":"OC\\User\\Session","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/www/html/prod/nextcloud/lib/base.php","line":1145,"function":"tryTokenLogin","class":"OC\\User\\Session","type":"->"},{"file":"/www/html/prod/nextcloud/ocs/v1.php","line":62,"function":"handleLogin","class":"OC","type":"::"},{"file":"/www/html/prod/nextcloud/ocs/v2.php","line":23,"args":["/www/html/prod/nextcloud/ocs/v1.php"],"function":"require_once"}],"File":"/www/html/prod/nextcloud/3rdparty/doctrine/dbal/src/Driver/PDO/Statement.php","Line":130}}},"CustomMessage":"Exception thrown: OC\\DB\\Exceptions\\DbalException"},"id":"65c6a70fa6143"}Additional info
No response
The text was updated successfully, but these errors were encountered: