BigSalmon / ParaphraseParentheses

This can be used to paraphrase. I recommend using the code I have attached below. You can generate it without using LogProbs, but you are likely to be best served by manually examining the most likely outputs.

If this interests you, check out https://huggingface.co/BigSalmon/MrLincoln12 or my other MrLincoln repos.

from transformers import AutoTokenizer, AutoModelWithLMHead
tokenizer = AutoTokenizer.from_pretrained("gpt2")
model = AutoModelWithLMHead.from_pretrained("BigSalmon/Parentheses")

Example Prompt:

***
The Milwaukee Bucks are for sure in title contention.
The Milwaukee Bucks are ( virtually assured / all but certain to / on the cusp of / well positioned for ) title contention.
***
Discord is an up-and-coming platform, attracting people from all walks of life.
Discord is ( an / a ) ( up-and-coming platform / platform in the ascendant / medium on the rise ), ( drawing in / wooing / winning over ) ( people / individuals / consumers / audiences ) from all ( walks of life / corners of the universe / horizons )...
***
HuggingFace is an amazing company.
HuggingFace is an (

import torch
prompt = "Insert Your Prompt Here. It is Best To Have a Few Examples Before Like The Example Prompt Shows."
text = tokenizer.encode(prompt)
myinput, past_key_values = torch.tensor([text]), None
myinput = myinput
myinput= myinput.to(device)
logits, past_key_values = model(myinput, past_key_values = past_key_values, return_dict=False)
logits = logits[0,-1]
probabilities = torch.nn.functional.softmax(logits)
best_logits, best_indices = logits.topk(500)
best_words = [tokenizer.decode([idx.item()]) for idx in best_indices]
text.append(best_indices[0].item())
best_probabilities = probabilities[best_indices].tolist()
words = []
for i in range(500):
    m = ([best_words[i]])
    m = str(m)
    m = m.replace("[' ", "").replace("']", "")
    print(m)