Total runs:
508
Run Growth:
405
Growth Rate:
79.72%
Sponsored by
APIMart
tinycompany / ShawtyIsBad-bgem3
Model's Last Updated: März 08 2025
text-generation
Introduction of ShawtyIsBad-bgem3
Model Details of ShawtyIsBad-bgem3
Test Log 08 March 2025
First Test:
Mean Perplexity : tested on
wikitext-2-raw-v1
, ~2k English samples was
1391.7575478298118
Second Test
Evaluated the tokenizer's performance on:
- Unicode coverage.
- Token distribution.
- Tokenization complexity across different scripts.
- Encoding and decoding capabilities &
- Edge cases e.g., special characters, numbers, etc.
- 1k samples: 500 Hindi, 500 English
1. Edge Case Handling
| Language | Test Type | Token Count | Unique Tokens |
|---|---|---|---|
| Hindi | Script Test | 14 | 13 |
| Unicode Test | 21 | 21 | |
| Special Characters | 19 | 19 | |
| English | Script Test | 16 | 15 |
| Unicode Test | 14 | 14 | |
| Special Characters | 18 | 18 |
2. Unicode Coverage
| Language | Coverage Ratio | Token Count | Unique Tokens |
|---|---|---|---|
| Hindi | 100% | 21 | 21 |
| English | 100% | 14 | 14 |
3. Complexity
| Language | Original Length | Token Count | Avg Token Length | Token Diversity |
|---|---|---|---|---|
| Hindi | 49 | 14 | 9.07 | 0.928 |
| English | 65 | 16 | 4.06 | 0.937 |
4. Encoding-Decoding Capabilities
Hindi Analysis:
Original Text: नमस्ते, मैं भारत से हूँ। दिल्ली बहुत बड़ा शहर है।
Token IDs Count: 14
Token Strings: ['नम', 'सà¥įतà¥ĩ', ',', 'Ġमà¥Īà¤Ĥ', 'Ġà¤Ńारत', 'Ġसà¥ĩ', 'Ġहà¥Ĥà¤ģ', '।', 'Ġदिलà¥įलà¥Ģ', 'Ġबहà¥ģत', 'Ġबड़ा', 'Ġशहर', 'Ġहà¥Ī', '।']
Decoded Text: नमस्ते, मैं भारत से हूँ। दिल्ली बहुत बड़ा शहर है।
Text Reconstruction: True
Hindi Analysis:
Original Text: हिंदी भाषा बहुत सुंदर है।
Token IDs Count: 7
Token Strings: ['ह', 'िà¤Ĥदà¥Ģ', 'Ġà¤Ńाषा', 'Ġबहà¥ģत', 'Ġसà¥ģà¤Ĥदर', 'Ġहà¥Ī', '।']
Decoded Text: हिंदी भाषा बहुत सुंदर है।
Text Reconstruction: True
Hindi Analysis:
Original Text: मुझे किताबें पढ़ना पसंद है।
Token IDs Count: 7
Token Strings: ['म', 'à¥ģà¤Ŀà¥ĩ', 'Ġà¤ķिताबà¥ĩà¤Ĥ', 'Ġपढ़ना', 'Ġपसà¤Ĥद', 'Ġहà¥Ī', '।']
Decoded Text: मुझे किताबें पढ़ना पसंद है।
Text Reconstruction: True
Hindi Analysis:
Original Text: यह एक उदाहरण वाक्य है।
Token IDs Count: 6
Token Strings: ['यह', 'Ġà¤ıà¤ķ', 'Ġà¤īदाहरण', 'Ġवाà¤ķà¥įय', 'Ġहà¥Ī', '।']
Decoded Text: यह एक उदाहरण वाक्य है।
Text Reconstruction: True
English Analysis:
Original Text: Hello, I am from India. Delhi is a big city.
Token IDs Count: 13
Token Strings: ['Hello', ',', 'ĠI', 'Ġam', 'Ġfrom', 'ĠIndia', '.', 'ĠDelhi', 'Ġis', 'Ġa', 'Ġbig', 'Ġcity', '.']
Decoded Text: Hello, I am from India. Delhi is a big city.
Text Reconstruction: True
English Analysis:
Original Text: The English language is widely spoken.
Token IDs Count: 7
Token Strings: ['The', 'ĠEnglish', 'Ġlanguage', 'Ġis', 'Ġwidely', 'Ġspoken', '.']
Decoded Text: The English language is widely spoken.
Text Reconstruction: True
English Analysis:
Original Text: I enjoy reading books.
Token IDs Count: 5
Token Strings: ['I', 'Ġenjoy', 'Ġreading', 'Ġbooks', '.']
Decoded Text: I enjoy reading books.
Text Reconstruction: True
English Analysis:
Original Text: This is an example sentence.
Token IDs Count: 6
Token Strings: ['This', 'Ġis', 'Ġan', 'Ġexample', 'Ġsentence', '.']
Decoded Text: This is an example sentence.
Text Reconstruction: True
Runs of tinycompany ShawtyIsBad-bgem3 on huggingface.co
17
Total runs
-1
24-hour runs
-1
3-day runs
-6
7-day runs
0
30-day runs
More Information About ShawtyIsBad-bgem3 huggingface.co Model
Url of ShawtyIsBad-bgem3
ShawtyIsBad-bgem3 huggingface.co Url
Provider of ShawtyIsBad-bgem3 huggingface.co
Other API from tinycompany
Updated:März 23 2025
Total runs:
413
Run Growth:
385
Growth Rate:
93.22%
Total runs:
369
Run Growth:
357
Growth Rate:
96.75%
Total runs:
366
Run Growth:
358
Growth Rate:
97.81%
Total runs:
252
Run Growth:
243
Growth Rate:
96.43%
Total runs:
44
Run Growth:
12
Growth Rate:
27.27%
Total runs:
28
Run Growth:
19
Growth Rate:
67.86%
Total runs:
27
Run Growth:
15
Growth Rate:
55.56%
Total runs:
22
Run Growth:
0
Growth Rate:
0.00%
Total runs:
17
Run Growth:
11
Growth Rate:
64.71%
Total runs:
15
Run Growth:
7
Growth Rate:
46.67%
Total runs:
14
Run Growth:
9
Growth Rate:
64.29%
Total runs:
13
Run Growth:
0
Growth Rate:
0.00%
Total runs:
12
Run Growth:
6
Growth Rate:
50.00%
Total runs:
11
Run Growth:
3
Growth Rate:
30.00%
Total runs:
11
Run Growth:
3
Growth Rate:
27.27%
Total runs:
11
Run Growth:
3
Growth Rate:
30.00%
Total runs:
11
Run Growth:
6
Growth Rate:
54.55%
Total runs:
11
Run Growth:
4
Growth Rate:
40.00%
Total runs:
10
Run Growth:
6
Growth Rate:
60.00%
Total runs:
10
Run Growth:
5
Growth Rate:
50.00%
Total runs:
9
Run Growth:
3
Growth Rate:
33.33%
Total runs:
9
Run Growth:
4
Growth Rate:
44.44%
Total runs:
9
Run Growth:
4
Growth Rate:
44.44%
Total runs:
9
Run Growth:
1
Growth Rate:
11.11%
Total runs:
9
Run Growth:
3
Growth Rate:
33.33%
Total runs:
9
Run Growth:
4
Growth Rate:
44.44%
Total runs:
8
Run Growth:
-2
Growth Rate:
-25.00%
Total runs:
8
Run Growth:
2
Growth Rate:
25.00%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
8
Run Growth:
1
Growth Rate:
12.50%
Total runs:
8
Run Growth:
3
Growth Rate:
37.50%
Total runs:
8
Run Growth:
5
Growth Rate:
62.50%
Total runs:
8
Run Growth:
0
Growth Rate:
0.00%
Total runs:
8
Run Growth:
4
Growth Rate:
50.00%
Total runs:
7
Run Growth:
2
Growth Rate:
28.57%
Total runs:
4
Run Growth:
-4
Growth Rate:
-100.00%
Total runs:
4
Run Growth:
-4
Growth Rate:
-100.00%
Total runs:
3
Run Growth:
0
Growth Rate:
0.00%
Total runs:
3
Run Growth:
-4
Growth Rate:
-133.33%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
2
Run Growth:
2
Growth Rate:
100.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
2
Run Growth:
1
Growth Rate:
50.00%
Total runs:
2
Run Growth:
-1
Growth Rate:
-50.00%
Total runs:
2
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
-1
Growth Rate:
-100.00%
Total runs:
1
Run Growth:
-2
Growth Rate:
-200.00%
Total runs:
1
Run Growth:
1
Growth Rate:
100.00%
Total runs:
1
Run Growth:
-5
Growth Rate:
-500.00%
Total runs:
1
Run Growth:
-1
Growth Rate:
-100.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%
Total runs:
1
Run Growth:
0
Growth Rate:
0.00%