Book a Demo!
CoCalc Logo Icon
StoreFeaturesDocsShareSupportNewsAboutPoliciesSign UpSign In
labmlai
GitHub Repository: labmlai/annotated_deep_learning_paper_implementations
Path: blob/master/translate_cache/sampling/temperature.zh.json
4925 views
1
{
2
"<h1>Sampling from Language Models with Temperature</h1>\n<p>Here we sample from the following probability distribution where <span translate=no>_^_0_^_</span> is the vocabulary, <span translate=no>_^_1_^_</span> are the logits of the distribution and T is the temperature:</p>\n<p><span translate=no>_^_2_^_</span></p>\n<p><span translate=no>_^_3_^_</span> is normal random sampling.</p>\n<p>Here&#x27;s an <a href=\"experiment.html\">experiment</a> that uses these sampling techniques.</p>\n": "<h1>\u4ece\u5e26\u6e29\u5ea6\u7684\u8bed\u8a00\u6a21\u578b\u4e2d\u91c7\u6837</h1>\n<p>\u5728\u8fd9\u91cc\uff0c\u6211\u4eec\u4ece\u4ee5\u4e0b\u6982\u7387\u5206\u5e03\u4e2d\u62bd\u6837\uff0c\u5176\u4e2d<span translate=no>_^_0_^_</span>\u662f\u8bcd\u6c47\uff0c<span translate=no>_^_1_^_</span>\u662f\u5206\u5e03\u7684\u5bf9\u6570\uff0cT \u662f\u6e29\u5ea6\uff1a</p>\n<p><span translate=no>_^_2_^_</span></p>\n<p><span translate=no>_^_3_^_</span>\u662f\u6b63\u5e38\u7684\u968f\u673a\u62bd\u6837\u3002</p>\n<p>\u8fd9\u662f\u4e00\u4e2a\u4f7f\u7528\u8fd9\u4e9b\u91c7\u6837\u6280\u672f\u7684<a href=\"experiment.html\">\u5b9e\u9a8c</a>\u3002</p>\n",
3
"<h2>Sampler with Temperature</h2>\n": "<h2>\u5e26\u6e29\u5ea6\u7684\u91c7\u6837\u5668</h2>\n",
4
"<p> Sample from logits</p>\n": "<p>\u6765\u81ea logits \u7684\u6837\u672c</p>\n",
5
"<p>Create a categorical distribution with temperature adjusted logits </p>\n": "<p>\u4f7f\u7528\u6e29\u5ea6\u8c03\u6574\u540e\u7684\u5bf9\u6570\u521b\u5efa\u5206\u7c7b\u5206\u5e03</p>\n",
6
"<p>Sample </p>\n": "<p>\u6837\u672c</p>\n",
7
"<ul><li><span translate=no>_^_0_^_</span> is the temperature to sample with</li></ul>\n": "<ul><li><span translate=no>_^_0_^_</span>\u662f\u8981\u91c7\u6837\u7684\u6e29\u5ea6</li></ul>\n",
8
"A PyTorch implementation of sampling from language models with temperature.": "\u4f7f\u7528\u6e29\u5ea6\u4ece\u8bed\u8a00\u6a21\u578b\u4e2d\u91c7\u6837\u7684 PyTorch \u5b9e\u73b0\u3002",
9
"Sampling from Language Models with Temperature": "\u4ece\u5e26\u6e29\u5ea6\u7684\u8bed\u8a00\u6a21\u578b\u4e2d\u91c7\u6837"
10
}
11