This document is a exhibition that shows those so-called "bad" data from diverse datasets during we use our Data-Juicer
to process them. The motivations of this exhibition include:
- It can help users to better understand how each OP in Data-juicer finds these "bad" data
to improve the "quality" of datasets.
- There might be non-negligible differences between diverse datasets. So
some OPs work well on some datasets but might be useless on others.
- No matter how high-quality people consider a dataset to be
(e.g. Wikipedia, Books, ...), there are always some "bad" data hidden in it.
OP |
Datasets |
alphanumeric_filter |
LCS-558K, Wikipedia, Books |
average_line_length_filter |
Github Code |
character_repetition_filter |
LCS-558K, Wikipedia, Books, Stack Exchange |
flagged_words_filter |
LCS-558K |
image_aspect_ratio_filter |
LCS-558K, MMC4 |
image_deduplicator |
LCS-558K |
image_shape_filter |
LCS-558K |
image_size_filter |
LCS-558K, MMC4 |
image_text_matching_filter |
LCS-558K, MMC4 |
language_id_score_filter |
Books |
perplexity_filter |
LCS-558K, Books, ArXiv |
special_characters_filter |
Wikipedia, Books |
text_length_filter |
Wikipedia, ArXiv, Github Code |
words_num_filter |
Stack Exchange |
word_repetition_filter |
MMC4, Wikipedia |
- Everyone from community is welcome to continue to add examples to this table.
The pretraining dataset of LLaVA-1.5
LCS-558K
item |
value |
from OP |
image_aspect_ratio_filter |
id |
004436823 |
aspect_ratio |
36.2857142857 |
caption |
the timber in honey amber |
image |
image |
comments |
Unaligned image and caption contents |
item |
value |
from OP |
image_shape_filter |
id |
005568917 |
image_height |
5177 |
caption |
the us coast guard's top five most popular aircrafts infographic |
image |
image |
comments |
The image with large height/width will lose too much information after being processed as model input |
item |
value |
from OP |
image_shape_filter |
id |
003301613 |
image_width |
3469 |
caption |
color the circle by number pages for children to learn colors |
image |
image |
comments |
The image with large height/width will lose too much information after being processed as model input |
item |
value |
from OP |
image_size_filter |
id |
002642925 |
image_size |
2,391 bytes |
caption |
pink gold opal and diamond ring |
image |
image |
comments |
Images with too small size might be invalid placeholders without meaningful contents |
item |
value |
from OP |
image_text_matching_filter |
id |
001365521 |
image_text_matching_score |
0.0008432278991676867 |
caption |
a black bmw m140i sports hatch from a dealer's garage |
image |
image |
comments |
Images with too small image-text matching score might be invalid placeholders without meaningful contents |
item |
value |
from OP |
alphanumeric_filter |
id |
001135426 |
alnum_ratio |
0.429825 |
caption |
dakin - laptopruck » » » » » » » » » » » » » » » » |
image |
image |
comments |
Texts with too small alnum ratio might contain unexpected extra meaningless tokens |
item |
value |
from OP |
character_repetition_filter |
id |
004292597 |
char_rep_ratio |
0.720207 |
caption |
harden harden harden harden harden harden harden harden harden harden harden harden harden harden harden harden harden harden harden harden harden |
image |
image |
comments |
Texts with too large character repetition ratio might contain repeat contents (captions of LCS-558K are generated by BLIP model) |
item |
value |
from OP |
flagged_words_filter |
id |
001013268 |
flagged_words_ratio |
0.263158 |
caption |
porn photo video porn cartoon porn porn pictures online for adult porn |
image |
Won't display this image |
comments |
Texts with non-zero flagged words ratio might contain NSFW contents |
item |
value |
from OP |
perplexity_filter |
id |
002606088 |
perplexity |
19789.9 |
caption |
real white pearl stud earrings sterling 925 925 9250 9210 9240 9210 9280 stud |
image |
image |
comments |
Texts with too large perplexity might contain meaningless contents |
item |
value |
from OP |
image_deduplicator |
ids |
004559803, 003716167, 005659131 |
image |
image |
comments |
There are some duplicate images with different names |
MMC4
item |
value |
from OP |
image_aspect_ratio_filter |
aspect_ratios |
[1.6, 10.4651162791] |
corresponding text |
"We found that kahweol acetate and cafestol inhibited growth of cancer cells in mice, but the combination seemed to work synergistically, leading to a significantly slower tumour growth than in untreated mice," said lead author Hiroaki Iwamoto. |
image |
image |
comments |
Unaligned image and caption contents. Images with too large aspect ratio might lose too much information after being processed as model input |
item |
value |
from OP |
image_size_filter |
image_sizes |
[453, 198343] |
corresponding text |
If you're in InfoSec, you are well aware of how this flies in the face of security team demographics. |
image |
image |
comments |
Unaligned image and caption contents. Images with too small size might contains meaningless simple contents |
item |
value |
from OP |
image_size_filter |
image_sizes |
[481, 517, 532, 482] |
corresponding text |
["Level Up Coin (LUC) is a cryptocurrency token and operates on the Ethereum platform.", "Level Up Coin has a current supply of 1,298,120,000 LUC with 996,923,370 LUC in circulation.", "The last known price of Level Up Coin is 0.000257 USD and is up 23.24% over the last 24 hours.", "More information can be found at https://play2live.io."] |
image |
image |
comments |
Images with too small size might be QR codes that contain sensitive contents |
item |
value |
from OP |
image_text_matching_filter |
image_text_matching_score |
[0.0012427607] |
corresponding text |
Many a times, we face problems connecting to the internet in spite of the Android smartphone being connected to the Wi-Fi. |
image |
image |
comments |
Unaligned image and caption contents. Some ad images might be mistakenly regarded as part of the sample. |
item |
value |
from OP |
word_repetition_filter |
word_rep_ratio |
0.917219 |
text |
text Congratulations on your great designs ladies! Please feel free to grab out “Top 3” blog badge from the right side bar and display it proudly. For even more great designs, jump on back and check out all of the great entries to Sketch #169 here. We love Wednesdays because we get to share with you our Design Team Creations! Here is what our fantastic design team came up with for Sketch #170. Congratulations on your great designs ladies! Please feel free to grab out “Top 3” blog badge from the right side bar and display it proudly. For even more great designs, jump on back and check out all of the great entries to Sketch #168 here. We love Wednesdays because we get to share with you our Design Team Creations! Here is what our fantastic design team came up with for Sketch #169. Congratulations on your great designs ladies! Please feel free to grab out “Top 3” blog badge from the right side bar and display it proudly. For even more great designs, jump on back and check out all of the great entries to Sketch #167 here. We love Wednesdays because we get to share with you our Design Team Creations! Here is what our fantastic design team came up with for Sketch #168. Top 3 for Sketch 166 and Design Team projects for Sketch 167. Congratulations on your great designs ladies! Please feel free to grab out “Top 3” blog badge from the right side bar and display it proudly. For even more great designs, jump on back and check out all of the great entries to Sketch #166 here. We love Wednesdays because we get to share with you our Design Team Creations! Here is what our fantastic design team came up with for Sketch #167. |
comments |
Texts with too large word repetition ratio might be a list of similar, repeated, but not the same contents |
Wikipedia
item |
value |
from OP |
alphanumeric_filter |
wiki page |
link |
alnum_ratio |
0.262965 |
text |
text Хаос | Уран + Гея Тартар,Ерос,Ереб,Нюкта | | Тифон, Питон, Ехидна, Хемера,Ефир циклопи, хекатонхейри еринии, Понт, Хипнос, хеспериди,
Мом, Немезида, Ирида, Танатос, Морфей | | | | ... |Нерей Форкис Кето | | || |Нереиди | | /горгони, греи / |т и т а н и | | | | | | | | | | | | | Кронос+Рея Диона Океан +Тетия Япет Мнемозина Криос Хиперион + Тея Койос + Феба Темида || + || + + | || |_| + | | /океаниди/ | | | | | | | | | | | | Метида Климена | | Палант Астрей Еос Селена Хелиос Астерия Лето | | | | || | | ||_ | + | | | | | | | | Нике | | | Хеката | | | | | Епиметей | Борей Зефир Нот | | | | | Прометей | | | | | | Менетей | | | | | | Атлас | | | | | | | | | | | | | | | Мая | | Артемида Аполон | | | | | | | | | | | | | | | | Асклепий | | | | | музи | | |_ | | | | |__ | | | | | | | | | | | | | Хигия Панацея Подалирий | | | | Хермес | | | | | | | | | | | | | | | | | | | Пан | | | | мойри ори харити Астрея | | | | | | | | | | | | | | | | | Атина | | | | | | | | | | | | | | | | | | | | | Афродита | | | | | | | + | | | | | | | | |||||| | | богове |||||| ||+ | | | | | | | Посейдон | Хера Зевс Деметра Хадес Хестия | | ||+|| | | Хефест | | | | | | | Хеба Арес Илифия | Персефона | |_| | + | | | | | || Фобос Деймос Хармония | | | Семела | || | Дионис
Древногръцки богове Родословни дървета |
comments |
Texts with too small alnum ratio might only contain structural content, which might be hard to learn |
item |
value |
from OP |
character_repetition_filter |
wiki page |
link |
char_rep_ratio |
0.818624 |
text |
text {| class="wikitable" style="font-size: 95%; float:center" |- ! Predajnik ! RTS 1 ! RTS 2 ! Radio Beograd 1 ! Radio Beograd 2 ! Radio Beograd 3 (202) ! RTV 1 ! RTV 2 ! RNS 1 ! RNS 2 ! RNS 3 ! Pink TV ! ! ! ! ! ! |- | Avala | align="center" | 6 | align="center" | 22 | align="center" | 95.3 | align="center" | 97.6 | align="center" | 104.0 | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | 45 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Deli Jovan | align="center" | 43 | align="center" | 23 | align="center" | 87.7 | align="center" | 94.9 | align="center" | 98.9 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Kopaonik, Gobelja | align="center" | 3 | align="center" | 41 | align="center" | 90.9 | align="center" | 93.7 | align="center" | 102.1 | align="center" | | align="center" | 58 | align="center" | 39 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Jastrebac | align="center" | 5 | align="center" | 27 | align="center" | 96.9 | align="center" | 89.3 | align="center" | 103.5 | align="center" | | align="center" | 21 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Crni Vrh, Jagodina | align="center" | 11 | align="center" | 35 | align="center" | 89.7 | align="center" | 99.3 | align="center" | 101.0 | align="center" | | align="center" | | align="center" | 55 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Vršac, Breg | align="center" | 11 | align="center" | 39 | align="center" | 95.7 | align="center" | 98.1 | align="center" | 103.0 | align="center" | | align="center" | | align="center" | 52 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Ovčar | align="center" | 8 | align="center" | 42 | align="center" | 88.1 | align="center" | 90.1 | align="center" | 101.6 | align="center" | 51 | align="center" | 67 | align="center" | 25 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Subotica | align="center" | 5 | align="center" | 61 | align="center" | 88.9 | align="center" | 101.1 | align="center" | 98.5 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Tupižnica | align="center" | 10 | align="center" | 25 | align="center" | 92.5 | align="center" | 96.1 | align="center" | 100.4 | align="center" | | align="center" | 44 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Hotel Venac | align="center" | 10 | align="center" | - | align="center" | - | align="center" | 96.5 | align="center" | 101.8 | align="center" | | align="center" | | align="center" | 12 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Iriški Venac | align="center" | - | align="center" | 24 | align="center" | 94.5 | align="center" | - | align="center" | - | align="center" | 41 | align="center" | 48 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Novi Beograd, Geneks | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | 59 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Beograd, Kanarevo Brdo | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | 35 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Beograd, Stojčino brdo | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | 52 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Kosmaj | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | / | align="center" | 62 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Avala | align="center" | | align="center" | 98.5 | align="center" | 101.4 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Tupižnica | align="center" | | align="center" | 94.1 | align="center" | | align="center" | 105.3 | align="center" | | align="center" | | align="center" | | align="center" | 34 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Šutenovačko Brdo | align="center" | | align="center" | 101.2 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 43 | align="center" | 21 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Kladovo | align="center" | | align="center" | 96.5 | align="center" | 102.0 | align="center" | 94.5 | align="center" | | align="center" | | align="center" | 53 | align="center" | 35 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Venac | align="center" | | align="center" | 97.2 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Jadovnik | align="center" | | align="center" | 104.7 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Crni Vrh, Jagodina | align="center" | | align="center" | 106.8 | align="center" | 91.1 | align="center" | 102.9 | align="center" | | align="center" | | align="center" | 38 | align="center" | 58 | align="center" | 61 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Vlaina | align="center" | | align="center" | | align="center" | 106.5 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Vršac | align="center" | | align="center" | | align="center" | 93.0 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Zrenjanin | align="center" | | align="center" | | align="center" | 88.7 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Maljen | align="center" | | align="center" | | align="center" | 107.2 | align="center" | | align="center" | | align="center" | | align="center" | 32 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Ada | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 46 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Bešenovački Prnjavor | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 61 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Šid | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 60 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Kula, Silos | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 68 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Zrenjanin, Titelski breg | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 61 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Cer | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 52 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Besna Kobila | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 59 | align="center" | 47 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Tornik | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 59 | align="center" | | align="center" | 63 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Beograd, Kanarevo brdo | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 32 | align="center" | 61 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Užice, Zabučje | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 26 | align="center" | 36 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Raška, Gradac | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 38 | align="center" | 65 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Beograd, Stojčino brdo | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 25 | align="center" | 8 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Priboj, Bić | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 43 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Prijepolje, Gradina | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 42 | align="center" | 51 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Nova Varoš | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 34 | align="center" | 69 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Valjevo, Pećina | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 58 | align="center" | 21 | align="center" | 49 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |- | Bajina Bašta | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | 39 | align="center" | 30 | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | | align="center" | |
comments |
Texts with too large character repetition ratio might contain the same style code in a table for the cells |
item |
value |
from OP |
special_characters_filter |
wiki page |
link |
special_char_ratio |
0.861592 |
text |
text This page indexes the individual year in politics pages.
20th century
1960s: 1960 - 1961 - 1962 - 1963 - 1964 - 1965 - 1966 - 1967 - 1968 - 1969 1970s: 1970 - 1971 - 1972 - 1973 - 1974 - 1975 - 1976 - 1977 - 1978 - 1979 1980s: 1980 - 1981 - 1982 - 1983 - 1984 - 1985 - 1986 - 1987 - 1988 - 1989 1990s: 1990 - 1991 - 1992 - 1993 - 1994 - 1995 - 1996 - 1997 - 1998 - 1999
21st century 2000s: 2000 - 2001 - 2002 - 2003 - 2004 - 2005 - 2006 - 2007 - 2008 - 2009 2010s: 2010 - 2011 - 2012 - 2013 - 2014 - 2015 - 2016 - 2017 - 2018 - 2019 2020s: 2020 - 2021 - 2022 - 2023
Politics |
comments |
Texts with too many special characters might be a list of some other pages |
item |
value |
from OP |
text_length_filter |
wiki page |
link |
text_len |
9 |
text |
text Canon law |
comments |
Texts with too short content might be an empty page |
item |
value |
from OP |
word_repetition_filter |
wiki page |
link |
word_rep_ratio |
0.965517 |
text |
text
Seasons 1862–63 Barnes F.C. season 1863–64 Barnes F.C. season 1864–65 Barnes F.C. season 1865–66 Barnes F.C. season 1866–67 Barnes F.C. season 1867–68 Barnes F.C. season 1868–69 Barnes F.C. season 1869–70 Barnes F.C. season 1870–71 Barnes F.C. season 1871–72 Barnes F.C. season 1872–73 Barnes F.C. season 1873–74 Barnes F.C. season
Barnes |
comments |
Texts with too large word repetition ratio might be a list of relevant, repeated, but not the same contents |
Books
item |
value |
from OP |
alphanumeric_filter |
alnum_ratio |
0 |
text |
text # #
# #
# #
# #
#
|
comments |
Texts with too small alnum ratio might only contain meaningless tokens |
item |
value |
from OP |
character_repetition_filter |
char_rep_ratio |
0.86 |
text |
text | | | | | | | | | | | | | | | | | | | | | | | |
| | | | | | | |
| | | | | | | | | | | | | | | | | | | |
| | | | | | |
| | |
www.stmartins.com
[email protected]
mollysuberthorpe.com
@mollysuberthorpe | | |
| | | | |
Preface
CHAPTER ONE
Methods for Effective Practice
Principles of Modern Calligraphy Styles
Letter & Grid Construction
A Guide to Supplies
Help Desk
CHAPTER TWO
Warm-up Exercises & Drills
Pencil Warm-ups
Stroke Drills
CHAPTER THREE
Modern Calligraphy, Letter by Letter
The Building Blocks
Arrow Key
A Modern Basic Alphabet
Modern Variations: Letters, Numbers & Symbols
Modern Ligatures
CHAPTER FOUR
From Letters to Words
One Change at a Time
Word Explorations
CHAPTER FIVE
Five Complete Alphabets
Quip
Nautica
Cream Soda
Dalliance
Blackboard Monoline
CHAPTER SIX
Majuscules & Monograms
Borealis
Chubby Bunny
Vice Versa
CHAPTER SEVEN
Small Layouts
Layout Practice
Writing on Curves & Slants
Envelope Addressing
All-caps Styles
CHAPTER EIGHT
Flourishes & Borders
Flourish Drills
Decorative Flourishes
Illustrative Flourishes
Wreaths & Laurels
APPENDIX I
Grids & Guides
APPENDIX II
Glossary
APPENDIX III
Additional Resources
About the Author
Acknowledgments
| | | | | | | | | | | | | | |
| | | | | | | | | | | | | | |
| | | | | | | | | | | | | | |
| | | | | | | | | | | | | |
| | | | | | | | | | | | | | | | |
| | | | | | | | | | | | | |
...... |
comments |
Texts with too large character repetition ratio might contain lots of repeated contents |
item |
value |
from OP |
perplexity_filter |
perplexity |
380817.4 |
text |
text
ISBN 978-1448-18265-7
|
comments |
Texts with too large perplexity might contain hard-to-understand contents (e.g. ISBN) |
item |
value |
from OP |
language_id_score_filter |
lang_score |
0.057 |
lang |
en |
text |
text ...... vUtyh ¼vatkWl½] eq>s fo'okl gh ugha gksrk fd esjh igyh lUrku] og uUgh cPph ftlds fy, geus mlds tUe ls eghuksa igys brus mRlkg ls I;kjk lk dejk ltk;k Fkk] vkt nqfu;k Hkj esa ?kwe pqdh gS vkSj Q+fuZpj fMt+kbu djus esa viuh txg cuk pqdh gSA geas irk py tkuk pkfg, Fkk fd rqe bl {ks= esa dke djksxh D;ksafd tc rqe cPph gh Fkh rc Hkh LVkbfy'k diM+ksa ds izfr rqEgkjk izse] ckjhd fooj.kksa dks Hkkaius okyh rqEgkjh fuxkg vkSj bl ckr ij tksj nsuk fd rqEgkjs vkl&ikl dh phtsa ,dne oSlh gh gksa tSlh rqe pkgrh gks] gesa nax dj nsrk FkkA bl ds lkFk gh rqe viuh xSj ljdkjh laLFkk ds izfr viuh opuc)rk dks Hkh iwjh rjg fuHkkrh gksA rqEgkjs fnu dk ,d&,d iy O;Lr gksrk gSA dHkh&dHkh eSa rqEgsa Fkdk gqvk ns[krh gwa ysfdu fQj lksprh gwa fd ;g rqEgkjk esgur djus dk le; gSA ;g rks rqEgkjh 'kq:vkr gSA
vkjrh ¼vkVZl~½] esjh nwljh cPph] rqEgsa irk ugha gS fd eSa bl ckr dk fdruk bUrt+kj dj jgh gwa fd rqe tku yks fd dkuwu gh rqEgkjs fy, lgh jkg gSA eSa mEehn djrh gwa fd dkuwu dh fMxzh dh i<+kbZ ds fy, U;w;kWdZ esa fcrk, tkus okys rhu lky rqEgsa ;g le>kus esa l{ke gksaxs fd rqEgkjh eka tks dj jgh gS ml dke esa Hkh vPNkbZ gSA dHkh&dHkh eSa izkFkZuk djrh gwa fd rqe esjs lkFk dke djks ysfdu ;fn rqe dksbZ vkSj dke [kkstks tks rqEgsa dkuwu ls Hkh T+;knk ilUn vk,] rks Hkh eSa rqEgkjs fy, [+kq'k gksÅaxhA
vfnrh ¼vnwcsu½] esjh lcls NksVh cPph] rqEgkjs firk dks ;d+hu gS fd rqe gekjh lcls T+;knk izfrHkk'kkyh csVh gks] ftls ,d ckj ;g irk py tk, fd mldk fny D;k pkgrk gS] rks og viuh cguksa ls cgqr T+;knk vkxs tk,xhA rks rqEgsa gekjh lcls Åaph mEehnkas ij [kjk mrjuk gS! ...... |
comments |
Texts with too low language score might contain unreadable texts |
item |
value |
from OP |
special_characters_filter |
special_char_ratio |
0.999 |
text |
text
## PageList
1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. 14. 15. 16. 17. 18. 19. 20. 21. 22. 23. 24. 25. 26. 27. 28. 29. 30. 31. 32. 33. 34. 35. 36. 37. 38. 39. 40. 41. 42. 43. 44. 45. 46. 47. 48. 49. 50. 51. 52. 53. 54. 55. 56. 57. 58. 59. 60. 61. 62. 63. 64. 65. 66. 67. 68. 69. 70. 71. 72. 73. 74. 75. 76. 77. 78. 79. 80. 81. 82. 83. 84. 85. 86. 87. 88. 89. 90. 91. 92. 93. 94. 95. 96. 97. 98. 99. 100. 101. 102. 103. 104. 105. 106. 107. 108. 109. 110. 111. 112. 113. 114. 115. 116. 117. 118. 119. 120. 121. 122. 123. 124. 125. 126. 127. 128. 129. 130. 131. 132. 133. 134. 135. 136. 137. 138. 139. 140. 141. 142. 143. 144. 145. 146. 147. 148. 149. 150. 151. 152. 153. 154. 155. 156. 157. 158. 159. 160. 161. 162. 163. 164. 165. 166. 167. 168. 169. 170. 171. 172. 173. 174. 175. 176. 177. 178. 179. 180. 181. 182. 183. 184. 185. 186. 187. 188. 189. 190. 191. 192. 193. 194. 195. 196. 197. 198. 199. 200. 201. 202. 203. 204. 205. 206. 207. 208. 209. 210. 211. 212. 213. 214. 215. 216. 217. 218. 219. 220. 221. 222. 223. 224. 225. 226. 227. 228. 229. 230. 231. 232. 233. 234. 235. 236. 237. 238. 239. 240. 241. 242. 243. 244. 245. 246. 247. 248. 249. 250. 251. 252. 253. 254. 255. 256. 257. 258. 259. 260. 261. 262. 263. 264. 265. 266. 267. 268. 269. 270. 271. 272. 273. 274. 275. 276. 277. 278. 279. 280. 281. 282. 283. 284. 285. 286. 287. 288. 289. 290. 291. 292. 293. 294. 295. 296. 297. 298. 299. 300. 301. 302. 303. 304. 305. 306. 307. 308. 309. 310. 311. 312. 313. 314. 315. 316. 317. 318. 319. 320. 321. 322. 323. 324. 325. 326. 327. 328. 329. 330. 331. 332. 333. 334. 335. 336. 337. 338. 339. 340. 341. 342. 343. 344. 345. 346. 347. 348. 349. 350. 351. 352. 353. 354. 355. 356. 357. 358. 359. 360. 361. 362. 363. 364. 365. 366. 367. 368. 369. 370. 371. 372. 373. 374. 375. 376. 377. 378. 379. 380. 381. 382. 383. 384. 385. 386. 387. 388. 389. 390. 391. 392. 393. 394. 395. 396. 397. 398. 399. 400. 401. 402. 403. 404. 405. 406. 407. 408. 409. 410. 411. 412. 413. 414. 415. 416. 417. 418. 419. 420. 421. 422. 423. 424. 425. 426. 427. 428. 429. 430. 431. 432. 433. 434. 435. 436. 437. 438. 439. 440. 441. 442. 443. 444. 445. 446. 447. 448. 449. 450. 451. 452. 453. 454. 455. 456. 457. 458. 459. 460. 461. 462. 463. 464. 465. 466. 467. 468. 469. 470. 471. 472. 473. 474. 475. 476. 477. 478. 479. 480. 481. 482. 483. 484. 485. 486. 487. 488. 489. 490. 491. 492. 493. 494. 495. 496. 497. 498. 499. 500. 501. 502. 503. 504. 505. 506. 507. 508. 509. 510. 511. 512. 513. 514. 515. 516. 517. 518. 519. 520. 521. 522. 523. 524. 525. 526. 527. 528. 529. 530. 531. 532. 533. 534. 535. 536. 537. 538. 539. 540. 541. 542. 543. 544. 545. 546. 547. 548. 549. 550. 551. 552. 553. 554. 555. 556. 557. 558. 559. 560. 561. 562. 563. 564. 565. 566. 567. 568. 569. 570. 571. 572. 573. 574. 575. 576. 577. 578. 579. 580. 581. 582. 583. 584. 585. 586. 587. 588. 589. 590. 591. 592. 593. 594. 595. 596. 597. 598. 599. 600. 601. 602. 603. 604. 605. 606. 607. 608. 609. 610. 611. 612. 613. 614. 615. 616. 617. 618. 619. 620. 621. 622. 623. 624. 625. 626. 627. 628. 629. 630. 631. 632. 633. 634. 635. 636. 637. 638. 639. 640. 641. 642. 643. 644. 645. 646. 647. 648. 649. 650. 651. 652. 653. 654. 655. 656. 657. 658. 659. 660. 661. 662. 663. 664. 665. 666. 667. 668. 669. 670. 671. 672. 673. 674. 675. 676. 677. 678. 679. 680. 681. 682. 683. 684. 685. 686. 687. 688. 689. 690. 691. 692. 693. 694. 695. 696. 697. 698. 699. 700. 701. 702. 703. 704. 705. 706. 707. 708. 709. 710. 711. 712. 713. 714. 715. 716. 717. 718. 719. 720. 721. 722. 723. 724. 725. 726. 727. 728. 729. 730. 731. 732. 733. 734. 735. 736. 737. 738. 739. 740. 741. 742.
|
comments |
Texts with too large special character ratio might contain meaningless contents |
Stack Exchange
item |
value |
from OP |
character_repetition_filter |
char_rep_ratio |
0.969099481 |
text |
text Q: Silent sound data uri? Does anyone know of a way to set a data uri to a valid silent sound? I'd be really curious to see if anything exists like that! Thank you. A: A 0-second WAVE file: data:audio/wav;base64,UklGRjIAAABXQVZFZm10IBIAAAABAAEAQB8AAEAfAAABAAgAAABmYWN0BAAAAAAAAABkYXRhAAAAAA== A: i love data uri s so i did this: http://doiop.com/silent[DOT]mp3 which points to http://tinyurl[DOT]com/silentmp3 which points to data:audio/x-wav; base64,UklGRooWAABXQVZFZm10IBAAAAABAAEAIlYAAESsAAACABAAZGF0YWYWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA |
comments |
Texts with too large character repetition ratio might contain the base64 code of an image |
item |
value |
from OP |
words_num_filter |
num_words |
2 |
text |
text Q: Append |
comments |
Texts with too few words might be missing content |
ArXiv
item |
value |
from OP |
text_length_filter |
text_len |
7 |
text |
text \part*{ |
comments |
Texts with too short content might be missing content |
item |
value |
from OP |
perplexity_filter |
perplexity |
244697 |
text |
text \section{Information about various village networks} \begingroup \squeezetable \begin{table*} \caption{Summary details of the contact network properties for the villages considered in this study.} \begin{ruledtabular} \begin{tabular}{c c c c c c c c c c}
SlNo&Nodes&LCC&$$&Modules&Q&$\mu_{sz}$&$\sigma_{sz}$&LMS&r\ \hline 1&843&825&8.2&24&0.6782&34.375&19.6783&72&0.02\ 2&877&810&7.2123&23&0.7396&35.2174&22.446&91&0.0149\ 3&1380&1318&7.9841&25&0.7312&52.72&38.6539&189&0.0161\ 4&1025&957&7.2403&25&0.7315&38.28&25.6117&99&0.0155\ 5&650&641&7.869&25&0.7477&25.64&20.268&70&0.0154\ 6&451&434&6.9954&24&0.7036&18.0833&15.4809&63&0.0193\ 7&732&719&9.0668&23&0.7078&31.2609&25.1555&83&0.0195\ 8&444&440&8.2818&22&0.7051&20.0&20.3693&75&0.0222\ 9&928&914&8.4497&22&0.703&41.5455&33.3517&141&0.0212\ 10&354&346&8.8353&19&0.6614&18.2105&15.2784&48&0.0294\ 11&605&589&7.8727&23&0.6986&25.6087&23.814&92&0.023\ 12&794&760&7.7132&23&0.7225&33.0435&20.0531&74&0.0167\ 13&-&-&-&-&-&-&-&-&-\ 14&675&645&8.1054&23&0.7453&28.0435&21.1115&91&0.0155\ 15&853&852&8.9648&23&0.6954&37.0435&24.5985&90&0.0204\ 16&712&693&9.3059&22&0.7152&31.5&24.7694&99&0.0201\ 17&879&850&8.6494&25&0.7284&34.0&28.1539&123&0.0177\ 18&1146&1140&9.157&24&0.7522&47.5&34.87&127&0.0149\ 19&1134&1118&9.2844&24&0.7484&46.5833&31.0979&131&0.014\ 20&714&633&8.6477&23&0.744&27.5217&18.5117&66&0.0139\ 21&1046&1011&8.6311&25&0.7347&40.44&32.0063&116&0.0164\ 22&-&-&-&-&-&-&-&-&-\ 23&1252&1186&8.6636&24&0.7572&49.4167&37.5732&125&0.0144\ 24&835&820&9.3098&25&0.7222&32.8&22.735&79&0.0165\ 25&1313&1286&9.4619&25&0.7751&51.44&32.2404&124&0.0116\ 26&674&666&9.0405&21&0.7576&31.7143&28.3198&127&0.0152\ 27&708&682&7.4091&25&0.7408&27.28&18.3794&67&0.0144\ 28&1612&1570&9.5822&25&0.7812&62.8&39.8628&163&0.0112\ 29&1337&1270&7.8276&25&0.7651&50.8&26.9741&115&0.0113\ 30&689&675&8.8607&23&0.7489&29.3478&25.1441&91&0.0165\ 31&851&819&9.0317&25&0.7893&32.76&22.0023&97&0.0106\ 32&1181&1136&9.6514&25&0.7296&45.44&30.0281&102&0.0157\ 33&843&824&7.7415&25&0.7279&32.96&29.0799&101&0.0174\ 34&692&628&7.1385&24&0.7702&26.1667&26.1465&115&0.0128\ 35&806&756&7.2302&25&0.758&30.24&27.388&106&0.0133\ 36&1214&1168&8.8733&24&0.7147&48.6667&53.5698&197&0.0214\ 37&500&482&7.7759&16&0.6593&30.125&24.2922&91&0.0324\ 38&736&726&8.1267&24&0.7723&30.25&21.9037&82&0.0124\ 39&1339&1294&9.1376&25&0.7666&51.76&31.9466&134&0.012\ 40&1097&1064&8.0442&25&0.7713&42.56&42.0562&168&0.0135\ 41&724&703&7.8862&20&0.7163&35.15&26.3615&76&0.0203\ 42&853&805&8.0807&25&0.7587&32.2&32.3394&117&0.0153\ 43&875&861&8.295&24&0.7331&35.875&30.5195&121&0.016\ 44&978&965&8.8518&25&0.7212&38.6&40.4366&136&0.0202\ 45&1073&1044&8.2356&25&0.7782&41.76&29.4405&113&0.0116\ 46&1257&1216&7.8544&24&0.7683&50.6667&34.6671&155&0.0125\ 47&680&660&8.5848&24&0.719&27.5&20.4185&70&0.0174\ 48&808&794&8.9232&24&0.6998&33.0833&31.5686&116&0.0225\ 49&766&689&8.7083&22&0.6439&31.3182&35.6987&140&0.0362\ 50&999&937&8.9883&25&0.6994&37.48&43.5175&145&0.0235\ 51&1061&1015&10.6591&21&0.6734&48.3333&55.2943&187&0.0308\ 52&1525&1497&10.4369&25&0.7339&59.88&69.595&276&0.0192\ 53&642&630&9.0683&23&0.6573&27.3913&32.5746&110&0.0322\ 54&467&458&10.1528&20&0.6636&22.9&28.0141&111&0.0326\ 55&1180&1151&7.9644&24&0.8192&47.9583&33.5478&127&0.0087\ 56&573&553&7.8807&23&0.7223&24.0435&20.6955&76&0.0189\ 57&948&919&8.2459&25&0.7222&36.76&29.2278&130&0.0174\ 58&914&905&8.8541&25&0.744&36.2&27.0289&110&0.0153\ 59&1599&1552&8.5393&24&0.7936&64.6667&46.4091&182&0.0108\ 60&1775&1729&8.7953&25&0.789&69.16&42.0692&215&0.0105\ 61&591&572&9.3776&20&0.7299&28.6&25.4213&104&0.0191\ 62&994&980&9.1816&24&0.7676&40.8333&30.4872&131&0.013\ 63&786&774&8.0284&23&0.7833&33.6522&23.392&91&0.0119\ 64&1286&1265&8.7763&25&0.7926&50.6&32.3988&115&0.0103\ 65&1331&1301&9.3766&24&0.7101&54.2083&42.7444&149&0.0194\ 66&814&790&7.8848&23&0.7353&34.3478&29.078&102&0.0173\ 67&893&885&8.5401&22&0.7311&40.2273&36.4778&128&0.0192\ 68&663&655&8.1389&22&0.7014&29.7727&26.6218&90&0.0225\ 69&875&866&10.4688&23&0.6739&37.6522&42.5457&148&0.0281\ 70&899&891&9.3547&20&0.6634&44.55&37.4639&129&0.028\ 71&1387&1345&8.3836&24&0.7556&56.0417&44.8046&151&0.0144\ 72&999&977&8.6192&25&0.6973&39.08&33.5511&147&0.0217\ 73&870&858&9.4767&22&0.7207&39.0&31.7905&101&0.0199\ 74&743&724&8.2735&23&0.7707&31.4783&22.9307&89&0.0131\ 75&831&815&10.0454&24&0.7199&33.9583&43.6305&170&0.0236\ 76&1154&1126&8.3064&25&0.7878&45.04&34.5861&128&0.0114\ 77&707&671&8.2355&22&0.7551&30.5&24.5352&82&0.015\ \end{tabular} \end{ruledtabular} \label{table1} \end{table*} \endgroup
{ |
comments |
Texts with too large perplexity might be the table area in LaTeX code |
Github Code
item |
value |
from OP |
text_length_filter |
text_len |
10 |
text |
text new Date<A |
comments |
Code with too short content might be missing/meaningless content |
item |
value |
from OP |
average_line_length_filter |
avg_line_length |
4.8571428571 |
text |
text This should result in an error |
comments |
Code with too short average line length might be "bad" code |