Tracking the World State with Recurrent Entity Networks

  • By :
  • Category : Video

We introduce a new model, the Recurrent Entity Network (EntNet). It is
equipped with a dynamic long-term memory which allows it to maintain and update
a representation of the state of the world as it receives new data. For
language understanding tasks, it can reason on-the-fly as it reads text, not
just when it is required to answer a question or respond as is the case for a
Memory Network (Sukhbaatar et al., 2015). Like a Neural Turing Machine or
Differentiable Neural Computer (Graves et al., 2014; 2016) it maintains a fixed
size memory and can learn to perform location and content-based read and write
operations. However, unlike those models it has a simple parallel architecture
in which several memory locations can be updated simultaneously. The EntNet
sets a new state-of-the-art on the bAbI tasks, and is the first method to solve
all the tasks in the 10k training examples setting. We also demonstrate that it
can solve a reasoning task which requires a large number of supporting facts,
which other methods are not able to solve, and can generalize past its training
horizon. It can also be practically used on large scale datasets such as
Children’s Book Test, where it obtains competitive performance, reading the
story in a single pass.


No Comments

Leave a Reply

Bakewell (Cherry

When I was at secondary school, I took Food Technology as one of my GCSEs. There were only 5 of us in the class (everyone obviously hated cooking hahah) but we got recruited to help make jam to sell at the school’s Christmas Bazaar. I remember having to stir up huge vats …

Brent Hoberman’s European seed fund Firstminute Capital raises £25m

With a focus on start-ups in the healthtech, robotic, fintech and AI sectors, Firstminute Capital will invest between $250,000 and $750,000 per round…In Funding news Source:

Parents are optimists.

Share and Enjoy:The post Parents are optimists. appeared first on Indexed. Source: