Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tokenizer #64

Open
wants to merge 31 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 3 commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
76913c7
高機能なトークナイザをターミナルに組み込み
Aug 20, 2022
8a7e48d
トークナイザのテストを追加
Aug 20, 2022
e00d4f5
関数名の変更
Aug 24, 2022
74a2b91
関数名変更の適応し忘れを修正
Aug 24, 2022
730baa0
fix memory leak
tomiy-0x62 Mar 5, 2023
97ad03f
不要な変数を削除
tomiy-0x62 Mar 5, 2023
c196367
strcmpを==に置換
tomiy-0x62 Mar 5, 2023
11e14a4
無駄な行を1行にまとめるように修正
tomiy-0x62 Mar 9, 2023
55b952d
無駄なif文を削除
tomiy-0x62 Mar 9, 2023
4e2adf6
stringの長さの取得方法を修正
tomiy-0x62 Mar 9, 2023
fee03ea
引数を改行した箇所の先頭位置を修正
tomiy-0x62 Mar 9, 2023
41056cf
列挙子の意味をコメントに追加
tomiy-0x62 Mar 9, 2023
998e053
メンバ変数の仕様をコメントに追加
tomiy-0x62 Mar 9, 2023
a756392
fix typo
tomiy-0x62 Mar 9, 2023
bd6bf0f
関数名に含まれるTokenizerInnerStateの略称TisをTISに変更
tomiy-0x62 Aug 22, 2023
06b5d3e
using c++17
tomiy-0x62 Aug 22, 2023
31c05bf
TokenizerInnerStateにコンストラクタとunipue_prtのエイリアスを追加
tomiy-0x62 Aug 22, 2023
66d2556
構造体のポンタをuniqueポインタに変更
tomiy-0x62 Aug 22, 2023
701d772
use dep file
tomiy-0x62 Aug 22, 2023
41f7811
TestTokenizeの戻り値をboolに変更
tomiy-0x62 Aug 22, 2023
e3de427
テストの成功割合を表示
tomiy-0x62 Aug 22, 2023
2f279f6
引数のインデントレベルを修正
tomiy-0x62 Aug 22, 2023
3a4d3cd
tmp_tokenがstringのコンストラクタを追加
tomiy-0x62 Aug 22, 2023
7522e04
引数を変更しない実装に変更し、その引数にconstを追加
tomiy-0x62 Aug 22, 2023
630092b
verboseを追加
tomiy-0x62 Aug 22, 2023
cf37d70
関数ドキュメントを追加
tomiy-0x62 Aug 22, 2023
3a45705
関数ドキュメントを追加
tomiy-0x62 Aug 22, 2023
41e852b
変更しない引数をconst参照に変更
tomiy-0x62 Aug 22, 2023
5917e7d
削除された領域を指すポインタを生成する問題を修正
tomiy-0x62 Aug 22, 2023
b9164c0
strchrを削除
tomiy-0x62 Aug 22, 2023
ab09297
cat の複数のファイル対応を削除
tomiy-0x62 Aug 22, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion kernel/Makefile
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
TARGET = kernel.elf
OBJS = main.o graphics.o mouse.o font.o hankaku.o newlib_support.o console.o \
pci.o asmfunc.o libcxx_support.o logger.o interrupt.o segment.o paging.o memory_manager.o \
window.o layer.o timer.o frame_buffer.o acpi.o keyboard.o task.o terminal.o \
window.o layer.o timer.o frame_buffer.o acpi.o keyboard.o task.o terminal.o tokenizer.o \
fat.o syscall.o file.o \
usb/memory.o usb/device.o usb/xhci/ring.o usb/xhci/trb.o usb/xhci/xhci.o \
usb/xhci/port.o usb/xhci/device.o usb/xhci/devmgr.o usb/xhci/registers.o \
Expand Down
Loading