“You won't get a wild heroic ride to heaven on pretty little sounds.”– George Ives
Pages in this blog
▼
Wednesday, August 12, 2020
REALM, a new open-source method for language model pre-training
And that's not just a solution to "long documents." It seems, generally, like a way to integrate explicit symbolic knowledge with neural language models. Which would be, um, nice.
No comments:
Post a Comment