meta/llama-2-7b-chat

Random seed. Leave blank to randomize the seed

provide debugging output in logs

When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens

When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens

Prompt to send to the model.

Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.

Maximum number of tokens to generate. A word is generally 2-3 tokens

Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.

A comma-separated list of sequences to stop generation at. For example, '<end>,<stop>' will stop generation at the first instance of 'end' or '<stop>'.

Path to fine-tuned weights produced by a Replicate fine-tune job.

A parameter that controls how repetitive text can be. Lower means more repetitive, while higher means less repetitive. Set to 1.0 to disable.