Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

COLLATION_CHARACTER_SET_APPLICABILITY.COLLATION_NAME vs MariaDB FULL_COLLATION_NAME #6361

Closed
rotdrop opened this issue Apr 17, 2024 · 4 comments · Fixed by #6425
Closed

COLLATION_CHARACTER_SET_APPLICABILITY.COLLATION_NAME vs MariaDB FULL_COLLATION_NAME #6361

rotdrop opened this issue Apr 17, 2024 · 4 comments · Fixed by #6425

Comments

@rotdrop
Copy link

rotdrop commented Apr 17, 2024

In recent MariaDB version the following will not succeed (resp. always yields an empty result set):

$sql = <<<'SQL'
SELECT t.TABLE_NAME,
t.ENGINE,
t.AUTO_INCREMENT,
t.TABLE_COMMENT,
t.CREATE_OPTIONS,
t.TABLE_COLLATION,
ccsa.CHARACTER_SET_NAME
FROM information_schema.TABLES t
INNER JOIN information_schema.COLLATION_CHARACTER_SET_APPLICABILITY ccsa
ON ccsa.COLLATION_NAME = t.TABLE_COLLATION
SQL;

The reason is, that CCSA.collation_name in recent MariaDB versions (tested version: 10.11.7) only contains the short collation name without prepended character set, while TABLES.table_collation contains the long table name. For example, in the case of the newly introduced utf8mb4_uca1400_ai_ci the corresponding row from COLLATION_CHARACTER_SET_APPLICABILITY is (CSV export):

"COLLATION_NAME","CHARACTER_SET_NAME","FULL_COLLATION_NAME","ID","IS_DEFAULT"
"uca1400_ai_ci","utf8mb4","utf8mb4_uca1400_ai_ci","2304",

while the TABLES.TABLE_COLLATION holds the full collation name utf8mb4_uca1400_ai_ci.

It also seems that this is a recent change in MariaDB; one Ubuntu "Jammy" system I am using runs MariaDB 10.6.16 which only has the COLLATION_NAME and CHARACTER_SET_NAME in that table, and the collation name is the full name with the character set prepended.

@derrabus
Copy link
Member

Is this a bug report? If yes, please start with answering the usual questions:

  • What did you try to do?
  • What did you expect to happen?
  • What happened instead?

@rotdrop
Copy link
Author

rotdrop commented Apr 17, 2024

This is a bug report related to the most recent versions of MariaDB

What did you try to do?

Running Doctrine/Orm migrations after upgrading to DBAL >= 3 and ORM >=2.20

What did you expect to happen?

That -- after applying the suggested migrations -- the schema validation tools would no longer complain

What happened instead?

Endless loop, applying the suggested migrations did not help.

One comment from my side: yes, you receive frequent bug reports, but please read and understand my explanations from the first post, IMHO they are clear and concise. Thank you.

@greg0ire
Copy link
Member

but please read and understand my explanations from the first post, IMHO they are clear and concise

Another comment from my side: @derrabus 's questions are completely on point, it's not far fetched to ask you in what context you stumbled upon this, and it has nothing to do with the clarity or conciseness of your original message. I don't know why you assume your message hasn't been read.

derrabus pushed a commit that referenced this issue Jun 7, 2024
<!-- Fill in the relevant information below to help triage your pull
request. -->

|      Q       |   A
|------------- | -----------
| Type         | bug
| Fixed issues | #6361

#### Summary

From MariaDB-10.10.1, where uca1400 was added, the
information_schema.COLLATION_CHARACTER_SET_APPLICABILITY was extended to
have FULL_COLLATION_NAME which corresponds to the
information_schema.TABLES.TABLE_COLLATION value.

Executable comment syntax is used to limited to the applicable versions.

To preserve compatibility with older MariaDB versions, and MySQL
versions where the previous COLLATION_NAME was the match is left as a
JOIN criteria. In new MariaDB versions this won't result in an extra row
match.

Closes: #6361


The lack of this fix did case the CI test to fail with a MariaDB-11.0+
container:


```
1) Doctrine\DBAL\Tests\Functional\Schema\MySQLSchemaManagerTest::testEnsureTableWithoutOptionsAreReflectedInMetadata
Undefined array key "engine"

/home/runner/work/dbal/dbal/src/Schema/Table.php:927
/home/runner/work/dbal/dbal/tests/Functional/Schema/MySQLSchemaManagerTest.php:550
```


With this fix all version of MySQL and MariaDB (even those new ones soon
to be in a different PR) will pass like:
https://github.com/grooverdan/dbal/actions/runs/9412110648/job/25926481038
derrabus added a commit that referenced this issue Jun 7, 2024
* 3.8.x:
  Fix MariaDB fetching of default table character-set (#6361) (#6425)
  Fix the portability documentation (#6429)
  Update tests/Platforms/AbstractPlatformTestCase.php
  Update tests/Platforms/AbstractPlatformTestCase.php
  add test
  Fix: Skip type comparison if disableTypeComments is true
@greg0ire greg0ire modified the milestone: 3.8.5 Jun 12, 2024
derrabus added a commit that referenced this issue Jun 14, 2024
* 4.0.x:
  CI: Update MariaDB versions (#6426)
  CI MariaDB: add 11.4, remove 11.0 (#6432)
  Display warnings when running PHPUnit in CI (#6431)
  Fix typo in the portability documentation (#6430)
  Fix MariaDB fetching of default table character-set (#6361) (#6425)
  Fix the portability documentation (#6429)
  Update tests/Platforms/AbstractPlatformTestCase.php
  Update tests/Platforms/AbstractPlatformTestCase.php
  add test
  Fix: Skip type comparison if disableTypeComments is true
derrabus added a commit to derrabus/dbal that referenced this issue Jun 19, 2024
* 4.1.x: (25 commits)
  Simplify signature of fetchTableOptionsByTable
  Add MariaDb1010Platform for fetchTableOptionsByTable
  PHPUnit 10.5.21 (doctrine#6447)
  Move schema split for SQLite CREATE INDEX only (doctrine#6352)
  PHPStan 1.11.5 (doctrine#6446)
  Default to distinct union queries (doctrine#6439)
  Revert "Merge pull request doctrine#6413 from achterin/bugfix/foreign_key_name_change_detection"
  Add `QueryBuilder` support for `UNION` clause (doctrine#6369)
  CI: Update MariaDB versions (doctrine#6426)
  CI MariaDB: add 11.4, remove 11.0 (doctrine#6432)
  Display warnings when running PHPUnit in CI (doctrine#6431)
  Fix typo in the portability documentation (doctrine#6430)
  Fix MariaDB fetching of default table character-set (doctrine#6361) (doctrine#6425)
  Fix the portability documentation (doctrine#6429)
  Update tests/Platforms/AbstractPlatformTestCase.php
  Update tests/Platforms/AbstractPlatformTestCase.php
  add test
  Fix: Skip type comparison if disableTypeComments is true
  Remove redundant variable (doctrine#6326)
  Fix test names to reflect their actual purpose
  ...
Copy link

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Jul 13, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants