Discovered: Mar 16, 2021.Eren Gölge:Notes on GPT-3 “I believe GPT-3 is not capable of “reasoning” in contrary to the common belief. GPT-3 rather constitutes an efficient storage mechanism for data it is trained with. At inference time, the model determines the output by finding the samples that are most relevant to the given task and interpolating them. “

Leave a comment on github