Home Community Researchers from CMU and Tsinghua University Propose Prompt2Model: A General Purpose Method that Generates Deployable AI Models from Natural Language Instructions

Researchers from CMU and Tsinghua University Propose Prompt2Model: A General Purpose Method that Generates Deployable AI Models from Natural Language Instructions

0
Researchers from CMU and Tsinghua University Propose Prompt2Model: A General Purpose Method that Generates Deployable AI Models from Natural Language Instructions

Imagine you want to construct an NLP model to resolve a given problem. You want to define the duty scope, then find or create data that specifies the intended system behaviour, select an appropriate model architecture, train the model, assess its performance through evaluation, after which deploy it for real-world usage. Researchers have made it possible to prototype such extensively made NLP models with a single line of code!

https://arxiv.org/abs/2308.12261

Prompt2Model is a system that retains the power to specify system behaviour using easy prompts and concurrently provides a deployable special purpose model preserving all its advantages. The figure above demonstrates the working architecture of our Prompt2Model. Essentially, it really works as an automatic pipeline, which extracts all of the needed details in regards to the task from user prompts after which gathers and combines task-related information and deploys using the next different channels.

  • Dataset retrieval: Given a prompt, the primary task is to find existing manually annotated data that may support a user’s task description.
  • Dataset generation: To support a wide selection of tasks, there exists a Dataset Generator to provide synthetic training data as per the user-specific requirements parsed by the Prompt Parser. The prompt parses consist of an LLM with in-context learning that’s utilised to segment user prompts, employing OpenAI’s gpt-3.5-turbo-0613.
  • Model retrieval: Using the provided prompt, a pre-trained language model is chosen with suitable knowledge for the user’s goal. This chosen model serves as the scholar model and is further fine-tuned and evaluated using the generated and retrieved data. 
  • WebApp: Finally, there exists an easy-to-use graphical user interface that enables downstream users to interact with the trained model. This web application, built using Gradio, can then be easily deployed publicly on a server. 

In conclusion, Prompt2Model is a tool for quickly constructing small and competent NLP systems. It could actually be directly used to provide task-specific models that outperform LLMs in just a few hours without manual data annotation or architecture. Given the model’s extensible design, it might probably offer a platform for exploring latest techniques in model distillation, dataset generation, synthetic evaluation, dataset retrieval, and model retrieval. 

Looking ahead, we will envision Prompt2Model as a catalyst for collaborative innovation. By proposing distinct challenges, researchers aim to foster the event of diverse implementations and enhancements across the framework’s components in the long run.


Take a look at the Paper and Github. All Credit For This Research Goes To the Researchers on This Project. Also, don’t forget to hitch our 29k+ ML SubReddit, 40k+ Facebook Community, Discord Channel, and Email Newsletter, where we share the newest AI research news, cool AI projects, and more.


Janhavi Lande, is an Engineering Physics graduate from IIT Guwahati, class of 2023. She is an upcoming data scientist and has been working on the planet of ml/ai research for the past two years. She is most fascinated by this ever changing world and its constant demand of humans to maintain up with it. In her pastime she enjoys traveling, reading and writing poems.


🚀 CodiumAI enables busy developers to generate meaningful tests (Sponsored)

LEAVE A REPLY

Please enter your comment!
Please enter your name here