Skip to content

Commit 0a68544

Browse files
authored
fix typo, intermediate_source/dynamic_quantization_bert_tutorial.rst (#837)
1 parent 80824ea commit 0a68544

1 file changed

Lines changed: 4 additions & 4 deletions

File tree

โ€Žintermediate_source/dynamic_quantization_bert_tutorial.rstโ€Ž

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -166,7 +166,7 @@ BERT ์˜ ์‚ฌ์ƒ์€ ์–ธ์–ด ํ‘œํ˜„์„ ์‚ฌ์ „ํ•™์Šตํ•˜๊ณ , ๋ฌธ์ œ์— ํŠนํ™”๋œ ๋งค
166166
๊ฐ€๋Šฅํ•œ ์ ๊ฒŒ ์‚ฌ์šฉํ•˜๋ฉด์„œ๋„, ์‚ฌ์ „ํ•™์Šต๋œ ์–‘๋ฐฉํ–ฅ ํ‘œํ˜„์„ ๋งŽ์€ ๋ฌธ์ œ๋“ค์— ๋งž๊ฒŒ
167167
๋ฏธ์„ธ์กฐ์ •ํ•˜์—ฌ ์ตœ๊ณ ์˜ ์„ฑ๋Šฅ์„ ์–ป๋Š” ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ด ํŠœํ† ๋ฆฌ์–ผ์—์„œ๋Š” ์‚ฌ์ „ํ•™์Šต๋œ
168168
BERT ๋ชจ๋ธ์„ MRPC ๋ฌธ์ œ์— ๋งž๊ฒŒ ๋ฏธ์„ธ์กฐ์ •ํ•˜์—ฌ ์˜๋ฏธ์ ์œผ๋กœ ๋™์ผํ•œ ๋ฌธ์žฅ์„
169-
๋ถ„๋ฅ˜ํ•ด๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค.
169+
๋ถ„๋ฅ˜ํ•ด ๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค.
170170

171171
์‚ฌ์ „ํ•™์Šต๋œ BERT ๋ชจ๋ธ(HuggingFace transformer๋“ค ์ค‘ ``bert-base-uncased`` ๋ชจ๋ธ)์„
172172
MRPC ๋ฌธ์ œ์— ๋งž๊ฒŒ ๋ฏธ์„ธ์กฐ์ •ํ•˜๊ธฐ ์œ„ํ•ด `์˜ˆ์‹œ๋“ค <https://github.com/huggingface/transformers/tree/master/examples#mrpc>`_
@@ -433,7 +433,7 @@ HuggingFace BERT ๋ชจ๋ธ์— ๋™์  ์–‘์žํ™”๋ฅผ ์ ์šฉํ•˜๊ธฐ ์œ„ํ•ด
433433
3.1 ๋ชจ๋ธ ํฌ๊ธฐ ํ™•์ธํ•˜๊ธฐ
434434
^^^^^^^^^^^^^^^^^^^^^^^^
435435

436-
๋จผ์ € ๋ชจ๋ธ ํฌ๊ธฐ๋ฅผ ํ™•์ธํ•ด๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค. ๋ณด๋ฉด, ๋ชจ๋ธ ํฌ๊ธฐ๊ฐ€ ์ƒ๋‹นํžˆ ์ค„์–ด๋“  ๊ฒƒ์„
436+
๋จผ์ € ๋ชจ๋ธ ํฌ๊ธฐ๋ฅผ ํ™•์ธํ•ด ๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค. ๋ณด๋ฉด, ๋ชจ๋ธ ํฌ๊ธฐ๊ฐ€ ์ƒ๋‹นํžˆ ์ค„์–ด๋“  ๊ฒƒ์„
437437
์•Œ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค(FP32 ํ˜•์‹์˜ ๋ชจ๋ธ ํฌ๊ธฐ : 438MB; INT8 ํ˜•์‹์˜ ๋ชจ๋ธ ํฌ๊ธฐ : 181MB):
438438

439439
.. code:: python
@@ -458,7 +458,7 @@ HuggingFace BERT ๋ชจ๋ธ์— ๋™์  ์–‘์žํ™”๋ฅผ ์ ์šฉํ•˜๊ธฐ ์œ„ํ•ด
458458
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
459459

460460
๋‹ค์Œ์œผ๋กœ, ๊ธฐ์กด์˜ FP32 ๋ชจ๋ธ๊ณผ ๋™์  ์–‘์žํ™”๋ฅผ ์ ์šฉํ•œ INT8 ๋ชจ๋ธ๋“ค์˜
461-
์ถ”๋ก  ์†๋„์™€ ์ •ํ™•๋„๋ฅผ ๋น„๊ตํ•ด๋ณด๊ฒŸ์Šต๋‹ˆ๋‹ค.
461+
์ถ”๋ก  ์†๋„์™€ ์ •ํ™•๋„๋ฅผ ๋น„๊ตํ•ด ๋ณด๊ฒ ์Šต๋‹ˆ๋‹ค.
462462

463463
.. code:: python
464464
@@ -492,7 +492,7 @@ HuggingFace BERT ๋ชจ๋ธ์— ๋™์  ์–‘์žํ™”๋ฅผ ์ ์šฉํ•˜๊ธฐ ์œ„ํ•ด
492492
MRPC ๋ฌธ์ œ์— ๋งž๊ฒŒ ๋ฏธ์„ธ์กฐ์ •ํ•œ BERT ๋ชจ๋ธ์— ํ•™์Šต ํ›„ ๋™์  ์–‘์žํ™”๋ฅผ ์ ์šฉํ•œ
493493
๊ฒฐ๊ณผ, 0.6% ๋‚ฎ์€ F1 ์ ์ˆ˜๊ฐ€ ๋‚˜์™”์Šต๋‹ˆ๋‹ค. ์ฐธ๊ณ ๋กœ, `์ตœ๊ทผ ๋…ผ๋ฌธ <https://arxiv.org/pdf/1910.06188.pdf>`_
494494
(ํ‘œ 1)์—์„œ๋Š” ํ•™์Šต ํ›„ ๋™์  ์–‘์žํ™”๋ฅผ ์ ์šฉํ–ˆ์„ ๋•Œ, F1 ์ ์ˆ˜ 0.8788์ด ๋‚˜์™”๊ณ ,
495-
์–‘์žํ™” ์˜์‹ ํ•™์Šต์„ ์ ์šฉํ–ˆ์„ ๋•Œ๋Š” 0.8956์ด ๋‚˜์™”์Šต๋‹ˆ๋‹ค. ์šฐ๋ฆฌ๋Š” Pytorch์˜ ๋น„๋Œ€์นญ
495+
์–‘์žํ™” ์˜์‹ ํ•™์Šต์„ ์ ์šฉํ–ˆ์„ ๋•Œ๋Š” 0.8956์ด ๋‚˜์™”์Šต๋‹ˆ๋‹ค. ์šฐ๋ฆฌ๋Š” PyTorch์˜ ๋น„๋Œ€์นญ
496496
์–‘์žํ™”๋ฅผ ์‚ฌ์šฉํ–ˆ์ง€๋งŒ, ์ฐธ๊ณ ํ•œ ๋…ผ๋ฌธ์—์„œ๋Š” ๋Œ€์นญ์  ์–‘์žํ™”๋งŒ์„ ์‚ฌ์šฉํ–ˆ๋‹ค๋Š” ์ ์ด ์ฃผ์š”ํ•œ
497497
์ฐจ์ด์ž…๋‹ˆ๋‹ค.
498498

0 commit comments

Comments
ย (0)