"KaTeX parse error: Expected 'EOF', got '<bla>' at position 1" when input pure Chinese character(s)

[brlin-tw]

control case:

Bug Reproducing Instructions

1. Browse KaTeX – The fastest math typesetting library for the web
2. Input any C(JK) characters, this attempt uses "測試"

Expected Behavior

"測試" printed in "See how it renders with KaTeX: " field, presumably to be in italic just as any regular text

Current Behavior

The "See how it renders with KaTeX: " field spews out the following error:

KaTeX parse error: Expected 'EOF', got '測' at position 1: 測̲試

[kevinbarabash]

@Lin-Buo-Ren awesome bug report. You can use CJK characters within \text. I'm curious about the use cases of natural language strings outside of \text?

[brlin-tw]

@kevinbarabash

I'm curious about the use cases of natural language strings outside of \text?

I'm not sure as I'm not really acquainted with LaTeX and simply using it to write math equations in Markdown documents on GitBook, never used \text before ;)

[07pepa]

I know it is utf8 characters related... looked into sources of katex on font and there are only printable english chars maybe it is related to multy-byte-ness of non ascii chars

PS. czech chars like "ěščřžýáíéťňůú" and theri capitalizated version"ĚŠČŘŽÝÁÍÉŤŇŮÚ" do not work also and utf-8 emoji also not work 😭.....only sotlution is ( if input box is utf-8) do utf 8 filter if it thinking it is procesing ascii)

it can look like this ( is not corect im writing in hurry) //will return nuber of bytes that needs to be discarded)
function utf8(char input) var locarvar=0; { if (input>128){ shr input; // shift right input for (var i=0;i<7;i++) { if (odd(input)){ localvar++; } shr input; } return localwar; }else return 0; }

[edemaine]

To be clear, \text{測試} works fine already in LaTeX (with any CJK character); it's just 測試 in math mode that doesn't work. I don't see any particular reason to forbid CJK characters in math mode, so we should look at adding support for that.

[edemaine]

FYI, PR #992 adds support for CJK characters in math mode. We're still resolving some accent-related issues there. If they don't get resolved soon (or the PR gets rejected), I could split off the CJK-in-math-mode part into a separate PR.

[rwbarton]

It looks like #992 was merged, but without the math mode CJK support; what's the status of this?

[brlin-tw]

The issue can still be reproduced via the instructions atop, I guess #992 isn't enables it ATM

[edemaine]

The status is issue #1046, which needs discussion before change. I'd appreciate your input on that -- is there a way to get this to work in LaTeX?

[rwbarton]

I actually haven't used xelatex myself unfortunately--I came across the Zulip issue while investigating something related (which was fixed already in another Unicode-related KaTeX PR).

[kevinbarabash]

I'm going to close this as a duplicate of #1046.

[tanjhysj0]

I have same problem,how to solve?change text content?no I don't want to do that

[edemaine]

@tanjhysj0 On the master branch, you can set the unicodeTextInMathMode to true, and this should work.