David Snelling
26c7d61185
Current state: - Unified augmentation system to BrainyAugmentation interface - Changed methods to specific noun/verb naming (addNoun, getNoun, etc) - Made old methods private - Combined getNouns into single unified method - Neural API exists and is complete - Triple Intelligence uses correct Brainy operators (not MongoDB) Issues identified: - Documentation incorrectly shows MongoDB operators (code is correct) - Need to ensure all features are properly exposed - Need to verify nothing was lost in simplification This commit serves as a rollback point before applying fixes.
15 lines
366 B
JSON
15 lines
366 B
JSON
{
|
|
"clean_up_tokenization_spaces": true,
|
|
"cls_token": "[CLS]",
|
|
"do_basic_tokenize": true,
|
|
"do_lower_case": true,
|
|
"mask_token": "[MASK]",
|
|
"model_max_length": 512,
|
|
"never_split": null,
|
|
"pad_token": "[PAD]",
|
|
"sep_token": "[SEP]",
|
|
"strip_accents": null,
|
|
"tokenize_chinese_chars": true,
|
|
"tokenizer_class": "BertTokenizer",
|
|
"unk_token": "[UNK]"
|
|
}
|