Book a Demo!
CoCalc Logo Icon
StoreFeaturesDocsShareSupportNewsAboutPoliciesSign UpSign In
amanchadha
GitHub Repository: amanchadha/coursera-natural-language-processing-specialization
Path: blob/master/4 - Natural Language Processing with Attention Models/Week 3/README.txt
66 views
1
Model pretrained on C4 using T5's unsupervised objective for ~500k steps, model
2
size is comparable to T5's base ~770m parameters.
3
4