Home Community Can Large Language Models Learn Recent Tricks? This Machine Learning Research from Google Introduces ‘CALM’: A Novel Approach for Enhancing AI Capabilities Through Composition

Can Large Language Models Learn Recent Tricks? This Machine Learning Research from Google Introduces ‘CALM’: A Novel Approach for Enhancing AI Capabilities Through Composition

0
Can Large Language Models Learn Recent Tricks? This Machine Learning Research from Google Introduces ‘CALM’: A Novel Approach for Enhancing AI Capabilities Through Composition

Large Language Models (LLMs), renowned for his or her foundational capabilities like commonsense reasoning and coherent language generation, have been fine-tuned for domain-specific tasks corresponding to code generation and mathematical problem-solving. This trend has led to specialized models excelling in specific domains, like code generation or logical reasoning. 

This prompts whether an anchor model may be combined with a domain-specific augmenting model to introduce novel capabilities, corresponding to merging a model’s code understanding prowess with one other’s language generation for code-to-text generation. Traditionally, the approach involves further pre-training or fine-tuning the anchor model on data used for training the augmenting model. Nevertheless, this might must be more practical on account of computational costs. Working with distinct models enables leveraging established capabilities without encountering issues like catastrophic forgetting seen in traditional methods. 

To tackle the obstacles related to training and data limitations outlined earlier, researchers at Google Research and Google DeepMind introduce and explore a practical scenario for model composition: (i) gaining access to one or multiple augmenting models alongside an anchor model, (ii) being restricted from altering the weights of either model and (iii) gaining access to a limited dataset representing the combined capabilities of the provided models, corresponding to code generation integrated with intricate logical reasoning.

They propose an progressive framework called Composition to Augment Language Models (CALM) to tackle the overall model composition scenario outlined earlier. Unlike superficial augmenting and anchor LMs amalgamations, CALM introduces a small set of trainable parameters inside the intermediate layer representations of each augmenting and anchor models. CALM goals to find an optimal fusion of those models, enhancing their collective performance in handling latest complex tasks more effectively than either model operating alone, all of the while retaining the distinct capabilities of every model. 

They explore significant practical applications of CALM, specializing in language inclusivity and code generation. Within the context of language inclusivity, they leverage a model trained specifically on low-resource languages. They mix this model with the LLM, granting them access to its advanced generation and reasoning abilities, leading to notably enhanced performance for translation and arithmetic reasoning tasks in low-resource languages.

Interestingly, this composed model surpasses the performance of the 2 base models and outperforms versions of the LLM that underwent further pre-training or LoRA fine-tuning tailored for low-resource languages. Within the case of code generation, they employ a model trained on diverse open-source code across multiple programming languages by integrating this model with the LLM. Hence, harnessing its underlying low-level logic and generation prowess, they achieve superior performance on tasks involving code explanation and completion in comparison with the performance of the 2 base models.


Try the Paper. All credit for this research goes to the researchers of this project. Also, don’t forget to follow us on Twitter. Join our 35k+ ML SubReddit, 41k+ Facebook Community, Discord Channel, and LinkedIn Group.

In the event you like our work, you’ll love our newsletter..


Arshad is an intern at MarktechPost. He’s currently pursuing his Int. MSc Physics from the Indian Institute of Technology Kharagpur. Understanding things to the elemental level results in latest discoveries which result in advancement in technology. He’s obsessed with understanding the character fundamentally with the assistance of tools like mathematical models, ML models and AI.


🐝 Join the Fastest Growing AI Research Newsletter Read by Researchers from Google + NVIDIA + Meta + Stanford + MIT + Microsoft and plenty of others…

LEAVE A REPLY

Please enter your comment!
Please enter your name here