Eye On AI

View Original

Week Ending 11.1.2020

RESEARCH WATCH: 11.1.2020

This week was active for "Computer Science - Artificial Intelligence", with 143 new papers.

  • The paper discussed most in the news over the past week was "Its Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners" by Timo Schick et al (Sep 2020), which was referenced 9 times, including in the article GPT-3 vs PET: Not Big but Beautiful! in Towards Data Science. Anna Rogers (University of Massachusetts Lowell), who is not part of the study, said "More data & compute = SOTA". The paper got social media traction with 368 shares. The investigators show that performance similar to GPT-3 can be obtained with language models whose parameter count is several orders of magnitude smaller. A user, @timo_schick, tweeted "🎉 New paper 🎉 We show that language models are few-shot learners even if they have far less than 175B parameters. Our method performs similar to GPT-3 on SuperGLUE after training on 32 examples with just 0.1% of its parameter count: #NLProc".

  • Leading researcher Sergey Levine (University of California, Berkeley) came out with "Conservative Safety Critics for Exploration" The researchers target the problem of safe exploration in RL by learning a conservative safety estimate of environment states through a critic, and provably upper bound the likelihood of catastrophic failures at every training iteration.

  • The paper shared the most on social media this week is by a team at University of Toronto: "Scientific intuition inspired by machine learning generated hypotheses" by Pascal Friederich et al (Oct 2020) with 84 shares. The researchers shift the focus on the insights and the knowledge obtained by the machine learning models themselves. @ssiddhant_ (Siddhant Sharma) tweeted "Woah! This is something nice and looking at all the cool possibility applying the approach to computational chemistry 💻".

  • The most influential Twitter user discussing papers is K Ken Nakamura who shared "General Procedure of Gauge Fixings and Ghosts" by Nobuyoshi Ohta (Oct 2020) and said: "Gauge fixings and Ghosts: The topic I want to understand. 以前から理解したいと思っていたゴーストの話。".

This week was active for "Computer Science - Computer Vision and Pattern Recognition", with 234 new papers.

This week was active for "Computer Science - Computers and Society", with 35 new papers.

This week was active for "Computer Science - Human-Computer Interaction", with 27 new papers.

This week was extremely active for "Computer Science - Learning", with 495 new papers.

Over the past week, 16 new papers were published in "Computer Science - Multiagent Systems".

Over the past week, 31 new papers were published in "Computer Science - Neural and Evolutionary Computing".

This week was very active for "Computer Science - Robotics", with 87 new papers.


EYE ON A.I. GETS READERS UP TO DATE ON THE LATEST FUNDING NEWS AND RELATED ISSUES. SUBSCRIBE FOR THE WEEKLY NEWSLETTER.