Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tokenizer #64

Open
wants to merge 31 commits into
base: master
Choose a base branch
from
Open

Conversation

tomiy-0x62
Copy link

MikanOSのターミナルはコマンドの解釈をかなり簡略化されて実装されており、バックスラッシュやクウォートによるエスケープ処理や複数行入力に対応していません。
そこで、高機能なトークナイザを実装して組み込むことでバックスラッシュやクウォートによるエスケープ処理や複数行入力に対応できるようになりました。
また、これによりcatコマンドでファイルの結合が可能になりました。

Copy link
Owner

@uchan-nos uchan-nos left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ざっくり見ました。
細かいところは見切れていませんので、レビューに対応してもらった後でまた読もうと思います。

kernel/terminal.cpp Show resolved Hide resolved
kernel/terminal.cpp Outdated Show resolved Hide resolved
kernel/tokenizer.cpp Outdated Show resolved Hide resolved
kernel/tests/main.cpp Show resolved Hide resolved
kernel/tokenizer.cpp Outdated Show resolved Hide resolved
kernel/tests/tokenizer_test.cpp Outdated Show resolved Hide resolved
kernel/tests/tokenizer_test.hpp Show resolved Hide resolved
kernel/tokenizer.hpp Outdated Show resolved Hide resolved
kernel/tokenizer.hpp Outdated Show resolved Hide resolved
kernel/tokenizer.hpp Outdated Show resolved Hide resolved
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants