neural networks

Meta Open-Sources 175 Billion Parameter AI Language Model OPT

Meta AI Research released Open Pre-trained Transformer (OPT-175B), a 175B parameter AI language model. The model was trained on a dataset containing 180B tokens and exhibits performance comparable with GPT-3, while only requiring 1/7th GPT-3’s training carbon footprint. The release was announced in a blog post written by Meta researchers Susan Zhang, Mona Diab, and …

Meta Open-Sources 175 Billion Parameter AI Language Model OPT Read More »

Meta Open-Sources 175 Billion Parameter AI Language Model OPT

Meta AI Research released Open Pre-trained Transformer (OPT-175B), a 175B parameter AI language model. The model was trained on a dataset containing 180B tokens and exhibits performance comparable with GPT-3, while only requiring 1/7th GPT-3’s training carbon footprint. The release was announced in a blog post written by Meta researchers Susan Zhang, Mona Diab, and …

Meta Open-Sources 175 Billion Parameter AI Language Model OPT Read More »

A one-up on motion capture | MIT News

From “Star Wars” to “Happy Feet,” many beloved films contain scenes that were made possible by motion capture technology, which records movement of objects or people through video. Further, applications for this tracking, which involve complicated interactions between physics, geometry, and perception, extend beyond Hollywood to the military, sports training, medical fields, and computer vision …

A one-up on motion capture | MIT News Read More »

Google Trains 540 Billion Parameter AI Language Model PaLM

Google Research recently announced the Pathways Language Model (PaLM), a 540-billion-parameter AI natural language processing (NLP) model that surpasses average human performance on the BIG-bench benchmark. PaLM outperforms other state-of-the-art systems on many evaluation tasks, and shows strong results on tasks such as logical inference and joke explanation. Software engineers Sharan Narang and Aakanksha Chowdhery …

Google Trains 540 Billion Parameter AI Language Model PaLM Read More »