Sponsored by APIMart
Toolify Toolify logo
AI Models
LaBSE-ja-uk

bicolino34 / LaBSE-ja-uk

Run on huggingface.co
huggingface.co
Total runs: 105
24-hour runs: -15
7-day runs: 2
30-day runs: 32
Model's Last Updated: December 28 2024
sentence-similarity

Introduction of LaBSE-ja-uk

Model Details of LaBSE-ja-uk

SentenceTransformer based on sentence-transformers/LaBSE

This is a sentence-transformers model finetuned from sentence-transformers/LaBSE on the csv dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details
Model Description
  • Model Type: Sentence Transformer
  • Base model: sentence-transformers/LaBSE
  • Maximum Sequence Length: 256 tokens
  • Output Dimensionality: 768 dimensions
  • Similarity Function: Cosine Similarity
  • Training Dataset:
    • csv
Model Sources
Full Model Architecture 
SentenceTransformer(
  (0): Transformer({'max_seq_length': 256, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Dense({'in_features': 768, 'out_features': 768, 'bias': True, 'activation_function': 'torch.nn.modules.activation.Tanh'})
  (3): Normalize()
)
Usage
Direct Usage (Sentence Transformers)

First install the Sentence Transformers library: 

pip install -U sentence-transformers

Then you can load this model and run inference. 

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("bicolino34/LaBSE-ja-uk")
# Run inference
sentences = [
    '微かな、しかし打ち消しがたい違和感がそこにはある。',
    'Якась легка, але незаперечна відмінність.',
    'Кожна людина вільна обирати, як їй жити.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
Training Details
Training Dataset
csv
  • Dataset: csv
  • Size: 13,304 training samples
  • Columns: Source and Target
  • Approximate statistics based on the first 1000 samples:
    Source Target
    type string string
    details
    • min: 4 tokens
    • mean: 22.68 tokens
    • max: 118 tokens
    • min: 3 tokens
    • mean: 19.39 tokens
    • max: 93 tokens
  • Samples:
    Source Target
    あたりはまだ暗い。 Навколо все ще було темно.
    しかし受話器をとるものはいない。 Однак ніхто не підніме слухавки.
    前にも言ったように、深田は宗教的な傾向など露ほども持ちあわせない人物だ。 Як я казав раніше, Фукада не мав найменшої схильності до релігії.
  • Loss: MultipleNegativesRankingLoss with these parameters: 
    {
    "scale": 20.0,
    "similarity_fct": "cos_sim"
}
Evaluation Dataset
csv
  • Dataset: csv
  • Size: 13,304 evaluation samples
  • Columns: Source and Target
  • Approximate statistics based on the first 1000 samples:
    Source Target
    type string string
    details
    • min: 4 tokens
    • mean: 21.78 tokens
    • max: 96 tokens
    • min: 3 tokens
    • mean: 19.04 tokens
    • max: 72 tokens
  • Samples:
    Source Target
    そうすれば彼女は天吾をほめてくれた。 За це вона його хвалила.
    「警察官一家」 — Поліцейська родина.
    ある、とバーテンダーは言った。 Бармен відповів, що є.
  • Loss: MultipleNegativesRankingLoss with these parameters: 
    {
    "scale": 20.0,
    "similarity_fct": "cos_sim"
}
Training Hyperparameters
Non-Default Hyperparameters
  • eval_strategy : steps
  • per_device_train_batch_size : 16
  • per_device_eval_batch_size : 16
  • num_train_epochs : 4
  • warmup_ratio : 0.1
  • fp16 : True
  • batch_sampler : no_duplicates
All Hyperparameters
Click to expand
  • overwrite_output_dir : False
  • do_predict : False
  • eval_strategy : steps
  • prediction_loss_only : True
  • per_device_train_batch_size : 16
  • per_device_eval_batch_size : 16
  • per_gpu_train_batch_size : None
  • per_gpu_eval_batch_size : None
  • gradient_accumulation_steps : 1
  • eval_accumulation_steps : None
  • torch_empty_cache_steps : None
  • learning_rate : 5e-05
  • weight_decay : 0.0
  • adam_beta1 : 0.9
  • adam_beta2 : 0.999
  • adam_epsilon : 1e-08
  • max_grad_norm : 1.0
  • num_train_epochs : 4
  • max_steps : -1
  • lr_scheduler_type : linear
  • lr_scheduler_kwargs : {}
  • warmup_ratio : 0.1
  • warmup_steps : 0
  • log_level : passive
  • log_level_replica : warning
  • log_on_each_node : True
  • logging_nan_inf_filter : True
  • save_safetensors : True
  • save_on_each_node : False
  • save_only_model : False
  • restore_callback_states_from_checkpoint : False
  • no_cuda : False
  • use_cpu : False
  • use_mps_device : False
  • seed : 42
  • data_seed : None
  • jit_mode_eval : False
  • use_ipex : False
  • bf16 : False
  • fp16 : True
  • fp16_opt_level : O1
  • half_precision_backend : auto
  • bf16_full_eval : False
  • fp16_full_eval : False
  • tf32 : None
  • local_rank : 0
  • ddp_backend : None
  • tpu_num_cores : None
  • tpu_metrics_debug : False
  • debug : []
  • dataloader_drop_last : False
  • dataloader_num_workers : 0
  • dataloader_prefetch_factor : None
  • past_index : -1
  • disable_tqdm : False
  • remove_unused_columns : True
  • label_names : None
  • load_best_model_at_end : False
  • ignore_data_skip : False
  • fsdp : []
  • fsdp_min_num_params : 0
  • fsdp_config : {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
  • fsdp_transformer_layer_cls_to_wrap : None
  • accelerator_config : {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
  • deepspeed : None
  • label_smoothing_factor : 0.0
  • optim : adamw_torch
  • optim_args : None
  • adafactor : False
  • group_by_length : False
  • length_column_name : length
  • ddp_find_unused_parameters : None
  • ddp_bucket_cap_mb : None
  • ddp_broadcast_buffers : False
  • dataloader_pin_memory : True
  • dataloader_persistent_workers : False
  • skip_memory_metrics : True
  • use_legacy_prediction_loop : False
  • push_to_hub : False
  • resume_from_checkpoint : None
  • hub_model_id : None
  • hub_strategy : every_save
  • hub_private_repo : None
  • hub_always_push : False
  • gradient_checkpointing : False
  • gradient_checkpointing_kwargs : None
  • include_inputs_for_metrics : False
  • include_for_metrics : []
  • eval_do_concat_batches : True
  • fp16_backend : auto
  • push_to_hub_model_id : None
  • push_to_hub_organization : None
  • mp_parameters :
  • auto_find_batch_size : False
  • full_determinism : False
  • torchdynamo : None
  • ray_scope : last
  • ddp_timeout : 1800
  • torch_compile : False
  • torch_compile_backend : None
  • torch_compile_mode : None
  • dispatch_batches : None
  • split_batches : None
  • include_tokens_per_second : False
  • include_num_input_tokens_seen : False
  • neftune_noise_alpha : None
  • optim_target_modules : None
  • batch_eval_metrics : False
  • eval_on_start : False
  • use_liger_kernel : False
  • eval_use_gather_object : False
  • average_tokens_across_devices : False
  • prompts : None
  • batch_sampler : no_duplicates
  • multi_dataset_batch_sampler : proportional
Training Logs
Epoch Step Training Loss Validation Loss
0.1502 100 0.0884 0.0619
0.3003 200 0.0677 0.0591
0.4505 300 0.091 0.0778
0.6006 400 0.0612 0.0630
0.7508 500 0.0993 0.0740
0.9009 600 0.082 0.0757
1.0511 700 0.0898 0.0722
1.2012 800 0.0342 0.0605
1.3514 900 0.0168 0.0595
1.5015 1000 0.0158 0.0599
1.6517 1100 0.0096 0.0613
1.8018 1200 0.0107 0.0614
1.9520 1300 0.0113 0.0639
2.1021 1400 0.0112 0.0572
2.2523 1500 0.0074 0.0534
2.4024 1600 0.0039 0.0553
2.5526 1700 0.0019 0.0532
2.7027 1800 0.0019 0.0555
2.8529 1900 0.0026 0.0527
3.0030 2000 0.0013 0.0525
3.1532 2100 0.0008 0.0520
3.3033 2200 0.001 0.0516
3.4535 2300 0.0006 0.0519
3.6036 2400 0.0006 0.0515
3.7538 2500 0.0005 0.0514
3.9039 2600 0.0005 0.0516
Framework Versions
  • Python: 3.10.12
  • Sentence Transformers: 3.3.1
  • Transformers: 4.47.1
  • PyTorch: 2.5.1+cu121
  • Accelerate: 1.2.1
  • Datasets: 3.2.0
  • Tokenizers: 0.21.0
Citation
BibTeX
Sentence Transformers 
@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}
MultipleNegativesRankingLoss 
@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}

Runs of bicolino34 LaBSE-ja-uk on huggingface.co

105
Total runs
-15
24-hour runs
-3
3-day runs
2
7-day runs
32
30-day runs

More Information About LaBSE-ja-uk huggingface.co Model

LaBSE-ja-uk huggingface.co

LaBSE-ja-uk huggingface.co is an AI model on huggingface.co that provides LaBSE-ja-uk's model effect (), which can be used instantly with this bicolino34 LaBSE-ja-uk model. huggingface.co supports a free trial of the LaBSE-ja-uk model, and also provides paid use of the LaBSE-ja-uk. Support call LaBSE-ja-uk model through api, including Node.js, Python, http.

LaBSE-ja-uk huggingface.co Url

https://huggingface.co/bicolino34/LaBSE-ja-uk

bicolino34 LaBSE-ja-uk online free

LaBSE-ja-uk huggingface.co is an online trial and call api platform, which integrates LaBSE-ja-uk's modeling effects, including api services, and provides a free online trial of LaBSE-ja-uk, you can try LaBSE-ja-uk online for free by clicking the link below.

bicolino34 LaBSE-ja-uk online free url in huggingface.co:

https://huggingface.co/bicolino34/LaBSE-ja-uk

LaBSE-ja-uk install

LaBSE-ja-uk is an open source model from GitHub that offers a free installation service, and any user can find LaBSE-ja-uk on GitHub to install. At the same time, huggingface.co provides the effect of LaBSE-ja-uk install, users can directly use LaBSE-ja-uk installed effect in huggingface.co for debugging and trial. It also supports api for free installation.

LaBSE-ja-uk install url in huggingface.co:

https://huggingface.co/bicolino34/LaBSE-ja-uk

Url of LaBSE-ja-uk

Provider of LaBSE-ja-uk huggingface.co

bicolino34
ORGANIZATIONS
huggingface.co

Other API from bicolino34